-- Logs begin at Wed 2022-11-02 19:51:32 UTC, end at Wed 2022-11-02 20:44:41 UTC. -- Nov 02 20:16:27.687302 dv-cinder-862365-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Nov 02 20:16:27.699027 dv-cinder-862365-5-smb devstack@keystone.service[81391]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Nov 02 20:16:27.701064 dv-cinder-862365-5-smb devstack@keystone.service[81391]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 20:16:27 2022] *** Nov 02 20:16:27.701064 dv-cinder-862365-5-smb devstack@keystone.service[81391]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 20:16:27.701064 dv-cinder-862365-5-smb devstack@keystone.service[81391]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 20:16:27.701064 dv-cinder-862365-5-smb devstack@keystone.service[81391]: nodename: dv-cinder-862365-5-smb Nov 02 20:16:27.701064 dv-cinder-862365-5-smb devstack@keystone.service[81391]: machine: x86_64 Nov 02 20:16:27.701064 dv-cinder-862365-5-smb devstack@keystone.service[81391]: clock source: unix Nov 02 20:16:27.701064 dv-cinder-862365-5-smb devstack@keystone.service[81391]: pcre jit disabled Nov 02 20:16:27.701064 dv-cinder-862365-5-smb devstack@keystone.service[81391]: detected number of CPU cores: 4 Nov 02 20:16:27.701064 dv-cinder-862365-5-smb devstack@keystone.service[81391]: current working directory: / Nov 02 20:16:27.701064 dv-cinder-862365-5-smb devstack@keystone.service[81391]: detected binary path: /usr/bin/uwsgi-core Nov 02 20:16:27.701728 dv-cinder-862365-5-smb devstack@keystone.service[81391]: your processes number limit is 47680 Nov 02 20:16:27.701728 dv-cinder-862365-5-smb devstack@keystone.service[81391]: your memory page size is 4096 bytes Nov 02 20:16:27.701728 dv-cinder-862365-5-smb devstack@keystone.service[81391]: detected max file descriptor number: 2048 Nov 02 20:16:27.701728 dv-cinder-862365-5-smb devstack@keystone.service[81391]: lock engine: pthread robust mutexes Nov 02 20:16:27.701728 dv-cinder-862365-5-smb devstack@keystone.service[81391]: thunder lock: enabled Nov 02 20:16:27.701728 dv-cinder-862365-5-smb devstack@keystone.service[81391]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Nov 02 20:16:27.701728 dv-cinder-862365-5-smb devstack@keystone.service[81391]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 20:16:27.740292 dv-cinder-862365-5-smb devstack@keystone.service[81391]: Python main interpreter initialized at 0x55b1371969c0 Nov 02 20:16:27.740292 dv-cinder-862365-5-smb devstack@keystone.service[81391]: python threads support enabled Nov 02 20:16:27.740292 dv-cinder-862365-5-smb devstack@keystone.service[81391]: your server socket listen backlog is limited to 100 connections Nov 02 20:16:27.740292 dv-cinder-862365-5-smb devstack@keystone.service[81391]: your mercy for graceful operations on workers is 90 seconds Nov 02 20:16:27.740631 dv-cinder-862365-5-smb devstack@keystone.service[81391]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 20:16:27.740710 dv-cinder-862365-5-smb devstack@keystone.service[81391]: *** Operational MODE: preforking *** Nov 02 20:16:27.740981 dv-cinder-862365-5-smb devstack@keystone.service[81391]: *** uWSGI is running in multiple interpreter mode *** Nov 02 20:16:27.740981 dv-cinder-862365-5-smb devstack@keystone.service[81391]: spawned uWSGI master process (pid: 81391) Nov 02 20:16:27.741160 dv-cinder-862365-5-smb systemd[1]: Started Devstack devstack@keystone.service. Nov 02 20:16:27.742213 dv-cinder-862365-5-smb devstack@keystone.service[81391]: spawned uWSGI worker 1 (pid: 81402, cores: 1) Nov 02 20:16:27.742213 dv-cinder-862365-5-smb devstack@keystone.service[81391]: spawned uWSGI worker 2 (pid: 81403, cores: 1) Nov 02 20:16:27.742213 dv-cinder-862365-5-smb devstack@keystone.service[81391]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 20:16:32.010333 dv-cinder-862365-5-smb devstack@keystone.service[81403]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 20:16:32.010333 dv-cinder-862365-5-smb devstack@keystone.service[81403]: from cryptography.utils import int_from_bytes Nov 02 20:16:32.011179 dv-cinder-862365-5-smb devstack@keystone.service[81402]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 20:16:32.011179 dv-cinder-862365-5-smb devstack@keystone.service[81402]: from cryptography.utils import int_from_bytes Nov 02 20:16:32.011601 dv-cinder-862365-5-smb devstack@keystone.service[81403]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 20:16:32.011601 dv-cinder-862365-5-smb devstack@keystone.service[81403]: from cryptography.utils import int_from_bytes Nov 02 20:16:32.011706 dv-cinder-862365-5-smb devstack@keystone.service[81402]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 20:16:32.011706 dv-cinder-862365-5-smb devstack@keystone.service[81402]: from cryptography.utils import int_from_bytes Nov 02 20:16:32.060676 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 20:16:32.060868 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 20:16:32.061053 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 20:16:32.061147 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] command line args: [] {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 20:16:32.061252 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 20:16:32.061340 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 20:16:32.061452 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] command line args: [] {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 20:16:32.061544 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ================================================================================ {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 20:16:32.061718 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] admin_token = **** {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.061803 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 20:16:32.061883 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ================================================================================ {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 20:16:32.061960 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] config_dir = [] {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.062137 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] admin_token = **** {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.062224 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.062299 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] config_source = [] {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.062390 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] config_dir = [] {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.062475 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] debug = True {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.062582 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.062670 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.063893 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] config_source = [] {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.063893 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] debug = True {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.064008 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.064073 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.064169 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.064237 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.064297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.064361 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.064421 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.064490 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.064585 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] list_limit = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.064662 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.064724 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] log_config_append = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.064724 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.064834 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] list_limit = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.064901 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] log_dir = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.064966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] log_config_append = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.065031 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] log_file = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.065091 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.065149 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.065206 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] log_dir = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.065206 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] log_file = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.065326 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.065385 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.065448 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.065513 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.065572 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.065644 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.065705 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.065776 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.065843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.066173 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.066328 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.066328 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.066519 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.066603 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.066677 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.066802 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.066888 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.066962 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.067079 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.067156 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.067271 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.067348 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.067429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.067552 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.067636 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.067757 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.067874 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.067986 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.068300 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.068387 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.068468 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] publish_errors = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.068702 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.068796 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.068939 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.069025 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] publish_errors = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.069124 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.069214 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.069373 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.069453 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.069568 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.069662 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.069812 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.069912 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] standard_threads = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.070051 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.070139 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.070285 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] standard_threads = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.070377 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.070458 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.070537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.070617 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] use_journal = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.070754 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.070841 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] use_json = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.070970 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.071045 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] use_stderr = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.071118 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] use_journal = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.071190 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] use_syslog = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.071267 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] use_json = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.071341 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.071421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] use_stderr = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.071567 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.071647 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] use_syslog = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.071809 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.071888 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 20:16:32.072065 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.072156 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.072304 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.072383 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.072569 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.072652 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.072821 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.072913 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.073072 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.073151 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.073309 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.073388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.074095 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.074188 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.074343 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.074425 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.074593 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.074678 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.074831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.074920 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.075081 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.075162 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.075317 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.075396 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.075565 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.075656 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.075804 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.075888 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.076041 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.076121 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.076295 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.076382 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.076540 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.076648 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.076820 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.076900 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.077062 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.077219 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.077317 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.077397 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.077556 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.077635 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.077817 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.077899 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.078065 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.078151 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.078301 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.078428 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.078518 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.078600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.078754 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.078834 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.079001 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.079082 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.079234 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.079314 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.079479 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.079559 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.079707 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.079785 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.079941 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.080028 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.080192 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.080271 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.080424 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.080508 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.080694 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.080782 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.080946 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.081031 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.081177 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.081255 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.081416 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.081496 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.081649 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.081727 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.081879 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.081957 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.082113 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.082193 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.082529 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.082649 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.082764 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.082886 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.083080 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.083199 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.083321 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.083437 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.083564 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.083681 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.083806 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.083930 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.084046 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.084168 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.084168 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.084394 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.084394 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.084642 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.084770 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.084887 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.085002 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.085117 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.085117 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.085343 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.085464 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.085580 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.085695 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.085817 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.085946 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.086062 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.086183 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.086318 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.086434 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.086541 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.086640 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.086737 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.086834 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.086944 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.087042 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.087151 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.087265 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.087380 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.087505 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.087622 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.087737 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.087861 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.087997 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.088123 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.088241 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.088357 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.088501 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.088663 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.088780 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.088909 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.089034 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.089196 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.089830 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.089951 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.090068 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.090183 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.090300 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.090415 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.090542 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.090659 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.090765 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.090888 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.091005 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.091122 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.091238 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.091359 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.091482 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.091607 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.091724 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.091840 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.091946 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.092051 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.092166 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.092290 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.092407 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.092523 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.092670 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.092788 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.092904 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.093029 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.093148 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.093263 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.093379 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.093498 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.093621 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.093751 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.093869 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.093984 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.094100 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.094216 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.094332 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.094456 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.094574 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.094689 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.094805 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.094921 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.095037 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.095231 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.095358 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.095476 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.095598 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.095721 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.095851 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.095977 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.096104 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.096221 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.096338 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.096454 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.096609 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.096739 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.096865 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.096983 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.097098 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.097213 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.097330 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.097445 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.097570 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.097686 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.097802 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.097918 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.098033 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.098156 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.098282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.098407 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.098568 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.098702 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.098821 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] auth.external = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.098963 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.099090 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.099209 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.099335 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.099455 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] auth.external = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.099573 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.099690 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.099807 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] auth.password = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.099933 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.100060 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] auth.token = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.100178 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.100302 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.100421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] auth.password = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.100539 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.100678 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] auth.token = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.100811 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.100930 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.101047 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.101165 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.101281 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.101405 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.101533 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.101651 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.101768 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.101885 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.102002 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] credential.caching = True {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.102118 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.102243 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.102367 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.102493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.102612 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] credential.caching = True {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.102730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.102846 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.102972 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.103091 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.103209 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.103326 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.103443 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.103564 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.103693 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.103812 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.103929 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.104047 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.104164 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.104288 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.104417 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.104537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.104690 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.104937 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.105062 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.105187 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.105314 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.105432 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.105549 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.105666 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.105784 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.105900 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.106026 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] federation.caching = True {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.106153 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.106271 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.106388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.106505 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.106621 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] federation.caching = True {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.106751 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.106885 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.107005 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.107122 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.107239 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.107365 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.107484 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.107606 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.107724 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.107842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.107959 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.108085 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.108203 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.108321 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.108439 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.108637 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.108761 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.108761 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] identity.caching = True {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.108999 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.109117 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.109235 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.109360 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.109478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.109667 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.109788 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] identity.caching = True {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.109905 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.110024 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.110141 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.110258 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.110384 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.110502 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.110620 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.110737 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.110854 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.110973 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.111099 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.111217 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.111335 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.111453 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.111570 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.111687 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.111813 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.111932 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.112050 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.112167 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.112284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.112401 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.112527 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.112666 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.112784 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.112901 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.113019 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.113138 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.113267 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.113395 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.113513 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.113634 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.113752 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.113869 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.113995 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.114115 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.114232 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.114348 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.114472 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.114590 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.114716 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.114835 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.114952 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.115069 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.115187 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.115304 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.115430 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.115548 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.115665 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.115781 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.115898 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.116015 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.116141 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.116260 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.116376 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.116494 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.116667 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.116785 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.116915 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.117034 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.117151 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.117275 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.117393 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.117519 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.117637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.117754 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.117877 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.117995 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.118111 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.118237 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.118357 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.118474 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.118590 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.118739 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.118859 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.118985 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.119111 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.119229 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.119346 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.119464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.119580 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.119706 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.119824 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.119948 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.120066 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.120182 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.120299 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.120573 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.120702 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.120821 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.120938 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.121056 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.121173 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.121304 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.121424 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.user = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.121543 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.121670 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.121789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.121907 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.122033 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.122152 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.122270 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.user = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.122387 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.122506 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.122623 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.122749 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.122875 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.122994 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.123111 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.123228 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.123344 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.123470 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.123590 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.123711 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.123836 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.123955 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.124072 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.124198 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.124317 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.124434 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.124571 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.124691 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.124809 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.124938 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.125064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.125183 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.125300 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.125417 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.125534 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.125661 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.125780 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.125897 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.126014 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.126131 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.126248 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.126374 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.126492 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.126609 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.126727 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.126844 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.126961 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.127087 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.127206 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.127323 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.127447 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.127566 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.127683 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.127809 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.127928 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.128045 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.128170 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.128278 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.128377 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.128485 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.128652 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.128810 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.128931 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.129048 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.129165 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.129296 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.129416 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.129540 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.129664 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.129783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.129902 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.130028 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.130147 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.130265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.130383 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] resource.caching = True {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.130499 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.130617 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.130743 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.130862 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.130980 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.131097 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.131214 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] resource.caching = True {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.131331 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.131458 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.131577 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.131694 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.131811 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.131928 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.132046 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.132172 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.132292 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.132292 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.132512 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.132646 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] role.caching = True {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.132842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.132964 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] role.driver = sql {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.133083 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.133200 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.133317 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.133434 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.133566 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.133689 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.133808 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] role.caching = True {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.133925 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.134044 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] role.driver = sql {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.134161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.134287 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.134406 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.134524 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.134642 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.134759 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.134911 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.135040 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.135161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.135278 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.135395 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.135513 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.135630 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.135756 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.135875 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.135992 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.136694 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.136814 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.136932 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.137063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.137063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.137286 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.137403 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.137521 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.137637 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.137794 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.137935 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.138053 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.138053 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.138273 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.138399 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.138525 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.138663 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.138781 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.138933 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.139053 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.139179 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.139299 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.139416 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.139533 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.139650 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.139767 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.139892 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.140011 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.140129 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.140245 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.140363 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.140480 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.140623 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.140744 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.140862 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.140979 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.141097 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.141214 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.141339 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.141459 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.141576 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.141693 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.141810 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] token.caching = True {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.141927 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.142054 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.142172 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.142290 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.142407 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.142525 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.142643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.142768 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.142905 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] token.caching = True {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.143025 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.143142 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.143260 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.143376 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.143502 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.143621 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.143738 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.143854 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.143971 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.144088 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.144216 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.144334 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.144451 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.144623 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.144743 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.144860 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.144989 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.145108 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.145225 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.145341 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.145459 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.145586 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.145712 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.145839 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.145958 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.146075 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.146192 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] database.connection = **** {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.146309 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.146426 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.146551 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.146680 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.146815 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.146934 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.146934 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.147153 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.147270 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.147386 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] database.connection = **** {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.147512 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.147630 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.147748 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.147864 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.147982 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.148098 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.148224 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.148343 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.148460 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.148591 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.148711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.148828 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.148995 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.149117 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.149235 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.149352 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.149470 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.149587 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.149713 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.149833 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.149951 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.150067 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.150185 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.150302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.150429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.150547 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.150665 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 20:16:32.150783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.150783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.150783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.150783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.150783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 20:16:32.150783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 20:16:32.176263 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.176497 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.176619 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.176751 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.176837 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.177016 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.185326 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.185603 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.213942 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.214248 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.215226 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.215460 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.266360 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.267038 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.314908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.315035 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.315132 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.315259 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.471547 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.471898 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.472046 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.472183 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.472788 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.472788 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.473110 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.473270 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.473469 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.473838 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.474066 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.474290 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.496273 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.496511 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.496615 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.496773 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.496875 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.497005 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.497088 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.497227 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.497307 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.497440 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.497521 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.497655 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.497735 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.497872 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.508786 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.508947 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.522332 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.522487 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.522595 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.522722 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.522826 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.522926 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.523024 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.523124 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.523233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.523344 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.523443 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.523540 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.523638 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.523752 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81402) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 20:16:32.540137 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.540353 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 20:16:32.540500 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.540738 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.540821 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 20:16:32.540947 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 20:16:32.541079 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.541230 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.541311 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 20:16:32.541499 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.541588 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.541772 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.541853 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.542035 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.542329 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.542599 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.551672 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.551918 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.552001 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.552199 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.552281 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.552473 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.552579 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.552791 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.560027 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.560290 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.562957 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.563202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.563284 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.563489 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.563569 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.563774 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.563867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.564058 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.564139 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.564325 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.564407 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.564601 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.564684 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.564876 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.564959 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.565159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.565251 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.565435 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.565546 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.565709 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.565826 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.566098 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.588785 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.589098 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.590277 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.590568 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.590713 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.591003 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.595240 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.595530 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.595817 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.597404 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.597695 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.597981 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.602294 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.602589 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.604364 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.604683 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.608325 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.608664 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.608876 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.608959 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.609172 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.609266 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.609460 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.609540 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.609748 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.609830 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.610028 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.610111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.610305 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.610385 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.610593 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.610874 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.626944 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.627228 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.629954 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.630244 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.631089 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.634156 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.634313 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.634622 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.637513 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.637826 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.638910 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.642053 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.642139 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.645297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.645391 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.645600 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.645891 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.646191 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.646482 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.646762 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.648532 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.648859 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.649155 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.649453 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.649759 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.650059 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.662923 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.663213 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.663487 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.663758 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.666292 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.666585 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.666861 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.667134 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.670677 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.672210 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.673769 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.674068 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.674153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.675617 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.676724 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.677016 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.677198 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.677408 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.677491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.677698 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.677983 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.680145 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.680445 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.680769 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.681058 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.681451 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.689583 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.689872 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.690256 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.690543 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.690841 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.691146 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.691427 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.693110 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.693400 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.693688 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.693976 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.694384 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.694685 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.694984 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.706800 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.709732 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.710372 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.712711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.713325 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.714708 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.716315 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.716643 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.716803 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.716932 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.718230 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.719726 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.720016 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.720425 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.723244 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.724754 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.726809 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.727747 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.728042 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.728292 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.728375 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.728623 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.731250 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.731649 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.731945 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.732234 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.736436 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.736762 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.737048 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.740087 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.740383 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.740695 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.744797 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81402) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.745085 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.745878 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.746172 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.746456 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.746731 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.747009 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.747297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.747570 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.747897 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.748105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 20:16:32.748187 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.748396 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.748488 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.748705 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.748788 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.748971 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81402) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.749054 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.749259 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.749548 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.749829 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.750122 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.750400 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.750693 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.750972 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.751293 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.751566 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.751844 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 20:16:32.782319 dv-cinder-862365-5-smb devstack@keystone.service[81402]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b1371969c0 pid: 81402 (default app) Nov 02 20:16:32.785527 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e41ec-d6d4-47af-a0f3-80545b91690e None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:32.785822 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e41ec-d6d4-47af-a0f3-80545b91690e None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:32.786101 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e41ec-d6d4-47af-a0f3-80545b91690e None None] PATH_INFO: `/v3` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:32.786197 dv-cinder-862365-5-smb devstack@keystone.service[81403]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b1371969c0 pid: 81403 (default app) Nov 02 20:16:32.790299 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Wed Nov 2 20:16:32 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:16:39.487954 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee26727-7518-4d2c-8b82-05e1f51fdd5e None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:39.488465 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee26727-7518-4d2c-8b82-05e1f51fdd5e None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:39.488603 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee26727-7518-4d2c-8b82-05e1f51fdd5e None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:39.492773 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:16:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 20:16:39.498618 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fc079-9f1b-450b-85f4-4f59a6c58d80 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:39.499035 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fc079-9f1b-450b-85f4-4f59a6c58d80 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:39.499175 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fc079-9f1b-450b-85f4-4f59a6c58d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:39.569453 dv-cinder-862365-5-smb devstack@keystone.service[81402]: INFO dbcounter [None req-532fc079-9f1b-450b-85f4-4f59a6c58d80 None None] Registered counter for database keystone Nov 02 20:16:39.588255 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG oslo_db.sqlalchemy.engines [None req-532fc079-9f1b-450b-85f4-4f59a6c58d80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81402) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 20:16:39.594417 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writer thread running {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 20:16:39.771802 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG passlib.handlers.bcrypt [None req-532fc079-9f1b-450b-85f4-4f59a6c58d80 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81402) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 02 20:16:39.772112 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG passlib.handlers.bcrypt [None req-532fc079-9f1b-450b-85f4-4f59a6c58d80 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81402) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 02 20:16:39.829512 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-532fc079-9f1b-450b-85f4-4f59a6c58d80 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:16:39.831094 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-532fc079-9f1b-450b-85f4-4f59a6c58d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:16:39.957011 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:16:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 02 20:16:40.399861 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee26727-7518-4d2c-8b82-05e1f51fdd5e None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:16:40.469582 dv-cinder-862365-5-smb devstack@keystone.service[81403]: INFO dbcounter [None req-5ee26727-7518-4d2c-8b82-05e1f51fdd5e None None] Registered counter for database keystone Nov 02 20:16:40.490647 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG oslo_db.sqlalchemy.engines [None req-5ee26727-7518-4d2c-8b82-05e1f51fdd5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81403) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 20:16:40.496806 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writer thread running {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 20:16:40.615730 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee26727-7518-4d2c-8b82-05e1f51fdd5e None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:16:40.619941 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774072f-f2a9-46b5-a224-90fec2edf266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:16:40.620608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774072f-f2a9-46b5-a224-90fec2edf266 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:40.620895 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774072f-f2a9-46b5-a224-90fec2edf266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:40.621172 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774072f-f2a9-46b5-a224-90fec2edf266 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:40.629270 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774072f-f2a9-46b5-a224-90fec2edf266 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:16:40.679634 dv-cinder-862365-5-smb devstack@keystone.service[81403]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6774072f-f2a9-46b5-a224-90fec2edf266 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 02 20:16:40.679925 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774072f-f2a9-46b5-a224-90fec2edf266 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:16:40.690553 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Wed Nov 2 20:16:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 20:16:40.696490 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fc079-9f1b-450b-85f4-4f59a6c58d80 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:16:40.713172 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fc079-9f1b-450b-85f4-4f59a6c58d80 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:16:40.718135 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980ac05-59ab-4e42-abc6-aaf356a03e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:16:40.719227 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980ac05-59ab-4e42-abc6-aaf356a03e65 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:40.719516 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980ac05-59ab-4e42-abc6-aaf356a03e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:40.719807 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980ac05-59ab-4e42-abc6-aaf356a03e65 admin admin] PATH_INFO: `/v3/projects/14a9d6ea225146efb4d5d6e0861824b6` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:40.723608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980ac05-59ab-4e42-abc6-aaf356a03e65 admin admin] RBAC: Authorizing `identity:get_project(project_id=14a9d6ea225146efb4d5d6e0861824b6)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:16:40.773055 dv-cinder-862365-5-smb devstack@keystone.service[81402]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c980ac05-59ab-4e42-abc6-aaf356a03e65 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 02 20:16:40.773404 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980ac05-59ab-4e42-abc6-aaf356a03e65 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:16:40.778525 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Wed Nov 2 20:16:40 2022] GET /identity/v3/projects/14a9d6ea225146efb4d5d6e0861824b6 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:16:42.889952 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5932bc6-426a-4ee4-981e-8f10ba5f4ce4 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:42.890550 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5932bc6-426a-4ee4-981e-8f10ba5f4ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:42.890550 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5932bc6-426a-4ee4-981e-8f10ba5f4ce4 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:42.894565 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:16:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:16:42.899918 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fad0e-1d33-4ade-a19f-fb39b8efe8b0 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:42.900297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fad0e-1d33-4ade-a19f-fb39b8efe8b0 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:42.900490 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fad0e-1d33-4ade-a19f-fb39b8efe8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:42.920893 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-f50fad0e-1d33-4ade-a19f-fb39b8efe8b0 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:16:42.922421 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-f50fad0e-1d33-4ade-a19f-fb39b8efe8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:16:42.930185 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:16:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 20:16:43.196373 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5932bc6-426a-4ee4-981e-8f10ba5f4ce4 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:16:43.208299 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5932bc6-426a-4ee4-981e-8f10ba5f4ce4 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:16:43.212465 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc95bd-aca5-4ec8-9b89-687674067c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:16:43.213088 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc95bd-aca5-4ec8-9b89-687674067c52 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:43.213375 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc95bd-aca5-4ec8-9b89-687674067c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:43.214147 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc95bd-aca5-4ec8-9b89-687674067c52 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:43.221674 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc95bd-aca5-4ec8-9b89-687674067c52 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:16:43.223428 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc95bd-aca5-4ec8-9b89-687674067c52 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:16:43.232589 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Wed Nov 2 20:16:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 20:16:43.237959 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50fad0e-1d33-4ade-a19f-fb39b8efe8b0 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:16:43.246922 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50fad0e-1d33-4ade-a19f-fb39b8efe8b0 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:16:43.251226 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1bcb7-c6f2-42b7-b6ec-1eb07b6eff1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:16:43.251847 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1bcb7-c6f2-42b7-b6ec-1eb07b6eff1b admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:43.252136 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1bcb7-c6f2-42b7-b6ec-1eb07b6eff1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:43.252571 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1bcb7-c6f2-42b7-b6ec-1eb07b6eff1b admin admin] PATH_INFO: `/v3/users/8da8f4c56d9b4bd0a6e3eaa2f4387ea6` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:43.253751 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1bcb7-c6f2-42b7-b6ec-1eb07b6eff1b admin admin] RBAC: Authorizing `identity:get_user(user_id=8da8f4c56d9b4bd0a6e3eaa2f4387ea6)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:16:43.255585 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1bcb7-c6f2-42b7-b6ec-1eb07b6eff1b admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:16:43.257149 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Wed Nov 2 20:16:43 2022] GET /identity/v3/users/8da8f4c56d9b4bd0a6e3eaa2f4387ea6 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:16:45.412160 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc006f7f-86d5-40df-8a90-e8a22af02423 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:45.412720 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc006f7f-86d5-40df-8a90-e8a22af02423 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:45.412720 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc006f7f-86d5-40df-8a90-e8a22af02423 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:45.414041 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:16:45.419130 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4131278-6c97-4b25-b96e-d6c72c2c3fa6 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:45.419551 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4131278-6c97-4b25-b96e-d6c72c2c3fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:45.419818 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4131278-6c97-4b25-b96e-d6c72c2c3fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:45.438448 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-a4131278-6c97-4b25-b96e-d6c72c2c3fa6 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:16:45.439623 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-a4131278-6c97-4b25-b96e-d6c72c2c3fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:16:45.491706 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbe0cc-b7f1-4b40-a685-140e1aa40ee3 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:45.491991 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbe0cc-b7f1-4b40-a685-140e1aa40ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:45.492270 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbe0cc-b7f1-4b40-a685-140e1aa40ee3 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:45.493612 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 6/11] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 20:16:45.499289 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccb11a-6cf0-46d2-9c7c-e577ad2a42d1 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:45.499575 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccb11a-6cf0-46d2-9c7c-e577ad2a42d1 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:45.499852 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccb11a-6cf0-46d2-9c7c-e577ad2a42d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:45.523913 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 6/12] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:16:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:16:45.542637 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG passlib.handlers.bcrypt [None req-6bccb11a-6cf0-46d2-9c7c-e577ad2a42d1 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81403) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 02 20:16:45.543031 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG passlib.handlers.bcrypt [None req-6bccb11a-6cf0-46d2-9c7c-e577ad2a42d1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81403) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 02 20:16:45.592532 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-6bccb11a-6cf0-46d2-9c7c-e577ad2a42d1 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:16:45.594131 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-6bccb11a-6cf0-46d2-9c7c-e577ad2a42d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:16:45.693689 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:16:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 20:16:45.789396 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4131278-6c97-4b25-b96e-d6c72c2c3fa6 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:16:45.814059 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:16:45.892691 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4131278-6c97-4b25-b96e-d6c72c2c3fa6 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:16:45.924978 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b42af2-5bc6-4f74-bb19-839af6e488ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:16:45.925606 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b42af2-5bc6-4f74-bb19-839af6e488ad None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:45.925887 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b42af2-5bc6-4f74-bb19-839af6e488ad None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:45.926165 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b42af2-5bc6-4f74-bb19-839af6e488ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:45.937641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b42af2-5bc6-4f74-bb19-839af6e488ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:16:45.946367 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-59b42af2-5bc6-4f74-bb19-839af6e488ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:16:45.946367 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:16:45.946367 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:16:45.946367 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:16:45.946367 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:16:45.946367 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:16:45.946367 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:16:45.946367 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:16:45.946367 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:16:45.946367 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:16:45.946367 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:16:45.946367 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:16:45.946367 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:16:45.946367 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:16:45.946367 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:16:45.946367 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:16:45.947289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:16:45.947289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:16:45.947289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:16:45.947289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:16:45.947289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:16:45.947289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:16:45.947289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:16:45.947289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:16:45.947289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:16:45.947289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:16:45.947289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:16:45.947289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:16:45.947289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:16:45.947289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:16:45.947289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:16:45.947289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:16:45.948806 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:16:45.948806 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:16:45.948806 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:16:45.948806 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:16:45.948806 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:16:45.948806 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:16:45.948806 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:16:45.948806 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:16:45.948806 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:16:45.948806 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:16:45.948806 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:16:45.948806 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:16:45.948806 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 7/14] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Nov 2 20:16:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:16:45.953801 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bccb11a-6cf0-46d2-9c7c-e577ad2a42d1 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:16:45.969204 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b42af2-5bc6-4f74-bb19-839af6e488ad None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:16:46.046926 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:16:46.054964 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bccb11a-6cf0-46d2-9c7c-e577ad2a42d1 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:16:46.058732 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:16:46.065363 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b42af2-5bc6-4f74-bb19-839af6e488ad None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:16:46.095538 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71257202-26cc-46f8-b4ce-50a4ead786be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:16:46.096407 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71257202-26cc-46f8-b4ce-50a4ead786be None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:46.096724 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71257202-26cc-46f8-b4ce-50a4ead786be None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:46.097007 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71257202-26cc-46f8-b4ce-50a4ead786be None admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:46.097844 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71257202-26cc-46f8-b4ce-50a4ead786be None admin] RBAC: Adding query filter params (name=admin) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:16:46.098152 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71257202-26cc-46f8-b4ce-50a4ead786be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:16:46.099584 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71257202-26cc-46f8-b4ce-50a4ead786be None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:16:46.100058 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33c482-c9c6-4266-b065-47fc5135dd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:16:46.100701 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33c482-c9c6-4266-b065-47fc5135dd14 None admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:46.101038 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33c482-c9c6-4266-b065-47fc5135dd14 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:46.101314 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33c482-c9c6-4266-b065-47fc5135dd14 None admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:46.101986 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33c482-c9c6-4266-b065-47fc5135dd14 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:16:46.103356 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33c482-c9c6-4266-b065-47fc5135dd14 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:16:46.111057 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 8/15] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:16:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:16:46.114002 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.sql.core [None req-ae33c482-c9c6-4266-b065-47fc5135dd14 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 20:16:46.114002 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 20:16:46.114002 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [parameters: {'id': '2f306bbb79a14db69422d04f238d43b4', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 02 20:16:46.114002 dv-cinder-862365-5-smb devstack@keystone.service[81402]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81402) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 20:16:46.116770 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71257202-26cc-46f8-b4ce-50a4ead786be None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:16:46.131695 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-ae33c482-c9c6-4266-b065-47fc5135dd14 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Nov 02 20:16:46.131695 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:16:46.131695 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 20:16:46.131695 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 20:16:46.131695 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 20:16:46.131695 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 20:16:46.131695 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 20:16:46.131695 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 20:16:46.131695 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 20:16:46.131695 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application conn.query(q) Nov 02 20:16:46.131695 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 20:16:46.131695 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 20:16:46.131695 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 20:16:46.131695 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application result.read() Nov 02 20:16:46.132703 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 20:16:46.132703 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 20:16:46.132703 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 20:16:46.132703 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 20:16:46.132703 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 20:16:46.132703 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 20:16:46.132703 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 20:16:46.132703 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 20:16:46.132703 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 20:16:46.132703 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:16:46.132703 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 20:16:46.132703 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:16:46.132703 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:16:46.132703 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 20:16:46.132703 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 20:16:46.132703 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Nov 02 20:16:46.132703 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return project_ref.to_dict() Nov 02 20:16:46.132703 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 20:16:46.134054 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application next(self.gen) Nov 02 20:16:46.134054 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 20:16:46.134054 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application yield resource Nov 02 20:16:46.134054 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 20:16:46.134054 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application next(self.gen) Nov 02 20:16:46.134054 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 20:16:46.134054 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 20:16:46.134054 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 20:16:46.134054 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 20:16:46.134054 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 20:16:46.134054 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise self.value Nov 02 20:16:46.134054 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 20:16:46.134054 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 20:16:46.134054 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 20:16:46.134054 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application session.commit() Nov 02 20:16:46.134054 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 20:16:46.134054 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 20:16:46.135161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 20:16:46.135161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 20:16:46.135161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 20:16:46.135161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application self.session.flush() Nov 02 20:16:46.135161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 20:16:46.135161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 20:16:46.135161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 20:16:46.135161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 20:16:46.135161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 20:16:46.135161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application compat.raise_( Nov 02 20:16:46.135161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 20:16:46.135161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception Nov 02 20:16:46.135161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 20:16:46.135161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 20:16:46.135161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 20:16:46.135161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 20:16:46.135161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 20:16:46.136144 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 20:16:46.136144 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 20:16:46.136144 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 20:16:46.136144 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Nov 02 20:16:46.136144 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application c = connection._execute_20( Nov 02 20:16:46.136144 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 20:16:46.136144 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 20:16:46.136144 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 20:16:46.136144 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 20:16:46.136144 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 20:16:46.136144 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 20:16:46.136144 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 20:16:46.136144 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 20:16:46.136144 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 20:16:46.136144 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 20:16:46.136975 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 20:16:46.136975 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception Nov 02 20:16:46.136975 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 20:16:46.136975 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 20:16:46.136975 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 20:16:46.136975 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 20:16:46.136975 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 20:16:46.136975 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 20:16:46.136975 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 20:16:46.136975 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application conn.query(q) Nov 02 20:16:46.136975 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 20:16:46.136975 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 20:16:46.136975 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 20:16:46.136975 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application result.read() Nov 02 20:16:46.136975 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 20:16:46.136975 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 20:16:46.136975 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 20:16:46.138306 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 20:16:46.138306 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 20:16:46.138306 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 20:16:46.138306 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 20:16:46.138306 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 20:16:46.138306 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 20:16:46.138306 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 20:16:46.138306 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [parameters: {'id': '2f306bbb79a14db69422d04f238d43b4', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 02 20:16:46.138306 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 20:16:46.138306 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:16:46.138306 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 20:16:46.138306 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:16:46.138306 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:16:46.138306 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Nov 02 20:16:46.138306 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Nov 02 20:16:46.139121 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 20:16:46.139121 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 20:16:46.139121 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Nov 02 20:16:46.139121 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:16:46.139121 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 20:16:46.139121 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:16:46.139121 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:16:46.139121 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:16:46.139121 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:16:46.139121 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:16:46.139121 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:16:46.139121 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:16:46.139121 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:16:46.139121 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:16:46.139121 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:16:46.139121 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:16:46.139121 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:16:46.140231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Nov 02 20:16:46.140231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Nov 02 20:16:46.140231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:16:46.140231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:16:46.140231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Nov 02 20:16:46.140231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Nov 02 20:16:46.140231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:16:46.140231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:16:46.140231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Nov 02 20:16:46.140231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.Conflict( Nov 02 20:16:46.140231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Nov 02 20:16:46.140231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:16:46.140231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 8/16] 10.222.0.23 () {60 vars in 1137 bytes} [Wed Nov 2 20:16:45 2022] POST /identity/v3/domains => generated 190 bytes in 164 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Nov 02 20:16:46.140231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33c482-c9c6-4266-b065-47fc5135dd14 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:16:46.220637 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71257202-26cc-46f8-b4ce-50a4ead786be None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:16:46.239211 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33c482-c9c6-4266-b065-47fc5135dd14 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:16:46.253551 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f864b-6299-48ab-baf6-20163e465bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:16:46.254412 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f864b-6299-48ab-baf6-20163e465bbd None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:46.254698 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f864b-6299-48ab-baf6-20163e465bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:46.254975 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f864b-6299-48ab-baf6-20163e465bbd None admin] PATH_INFO: `/v3/users/8da8f4c56d9b4bd0a6e3eaa2f4387ea6` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:46.256456 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f864b-6299-48ab-baf6-20163e465bbd None admin] RBAC: Authorizing `identity:get_user(user_id=8da8f4c56d9b4bd0a6e3eaa2f4387ea6)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:16:46.257940 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f864b-6299-48ab-baf6-20163e465bbd None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:16:46.259501 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 9/17] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:16:46 2022] GET /identity/v3/users/8da8f4c56d9b4bd0a6e3eaa2f4387ea6 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:16:46.265091 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f864b-6299-48ab-baf6-20163e465bbd None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:16:46.277588 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46845079-57aa-4a36-a857-626a79a2cf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:16:46.278220 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46845079-57aa-4a36-a857-626a79a2cf7e None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:46.278503 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46845079-57aa-4a36-a857-626a79a2cf7e None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:46.278780 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46845079-57aa-4a36-a857-626a79a2cf7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:46.288575 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46845079-57aa-4a36-a857-626a79a2cf7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:16:46.290038 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46845079-57aa-4a36-a857-626a79a2cf7e None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:16:46.298297 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:16:46.299234 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:16:46.309350 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-46845079-57aa-4a36-a857-626a79a2cf7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:16:46.309350 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:16:46.309350 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:16:46.309350 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:16:46.309350 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:16:46.309350 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:16:46.309350 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:16:46.309350 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:16:46.309350 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:16:46.309350 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:16:46.309350 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:16:46.309350 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:16:46.309350 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:16:46.309350 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:16:46.309350 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:16:46.309350 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:16:46.310462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:16:46.310462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:16:46.310462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:16:46.310462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:16:46.310462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:16:46.310462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:16:46.310462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:16:46.310462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:16:46.310462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:16:46.310462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:16:46.310462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:16:46.310462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:16:46.310462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:16:46.310462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:16:46.310462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:16:46.310462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:16:46.310462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:16:46.311260 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:16:46.311260 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:16:46.311260 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:16:46.311260 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 9/18] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:16:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:16:46.317244 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46845079-57aa-4a36-a857-626a79a2cf7e None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:16:46.365761 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f864b-6299-48ab-baf6-20163e465bbd None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:16:46.398958 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e110bad-da80-4f43-af13-f3fbd9910681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:16:46.399592 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e110bad-da80-4f43-af13-f3fbd9910681 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:46.399872 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e110bad-da80-4f43-af13-f3fbd9910681 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:46.400148 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e110bad-da80-4f43-af13-f3fbd9910681 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:46.401307 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e110bad-da80-4f43-af13-f3fbd9910681 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:16:46.402739 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e110bad-da80-4f43-af13-f3fbd9910681 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:16:46.404456 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 10/19] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:16:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:16:46.409770 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e110bad-da80-4f43-af13-f3fbd9910681 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:16:46.413616 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46845079-57aa-4a36-a857-626a79a2cf7e None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:16:46.447155 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfced876-4d9d-4f33-9370-6c1d02dc19ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:16:46.447760 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfced876-4d9d-4f33-9370-6c1d02dc19ce None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:46.448075 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfced876-4d9d-4f33-9370-6c1d02dc19ce None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:46.448361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfced876-4d9d-4f33-9370-6c1d02dc19ce None admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:46.449034 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfced876-4d9d-4f33-9370-6c1d02dc19ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:16:46.449344 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfced876-4d9d-4f33-9370-6c1d02dc19ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:16:46.450725 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfced876-4d9d-4f33-9370-6c1d02dc19ce None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:16:46.467269 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 10/20] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:16:46.509652 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e110bad-da80-4f43-af13-f3fbd9910681 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:16:46.511692 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:16:46.547563 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3609a-0e60-4178-9441-c43d83f044f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:16:46.548249 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3609a-0e60-4178-9441-c43d83f044f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:46.548538 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3609a-0e60-4178-9441-c43d83f044f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:46.548867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3609a-0e60-4178-9441-c43d83f044f6 None admin] PATH_INFO: `/v3/domains/default/users/8da8f4c56d9b4bd0a6e3eaa2f4387ea6/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:46.550887 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3609a-0e60-4178-9441-c43d83f044f6 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8da8f4c56d9b4bd0a6e3eaa2f4387ea6, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:16:46.552378 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3609a-0e60-4178-9441-c43d83f044f6 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:16:46.671277 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 11/21] 10.222.0.23 () {58 vars in 1361 bytes} [Wed Nov 2 20:16:46 2022] PUT /identity/v3/domains/default/users/8da8f4c56d9b4bd0a6e3eaa2f4387ea6/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:16:48.896515 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31283545-d46c-4362-8791-a4c93c74f797 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:48.897038 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31283545-d46c-4362-8791-a4c93c74f797 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:48.897136 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31283545-d46c-4362-8791-a4c93c74f797 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:48.898723 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 11/22] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:16:48.912216 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c97a4-a20f-4420-9984-53ef9de201ea None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:48.912701 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c97a4-a20f-4420-9984-53ef9de201ea None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:48.912889 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c97a4-a20f-4420-9984-53ef9de201ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:48.941599 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-274c97a4-a20f-4420-9984-53ef9de201ea None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:16:48.943149 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-274c97a4-a20f-4420-9984-53ef9de201ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:16:49.026412 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 12/23] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:16:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 20:16:49.245277 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08039d-1418-4735-a935-7f2e1463e57c None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:49.245565 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08039d-1418-4735-a935-7f2e1463e57c None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:49.245770 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08039d-1418-4735-a935-7f2e1463e57c None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:49.247399 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 12/24] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:16:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:16:49.252447 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f73603-f1b7-4352-a210-26c432f143fe None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:49.252771 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f73603-f1b7-4352-a210-26c432f143fe None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:49.253061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f73603-f1b7-4352-a210-26c432f143fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:49.254238 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064b44b-65b6-44d1-9e16-3b644b08c3d7 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:49.254524 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064b44b-65b6-44d1-9e16-3b644b08c3d7 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:49.254795 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064b44b-65b6-44d1-9e16-3b644b08c3d7 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:49.256008 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 13/25] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:16:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 20:16:49.261189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1e493-8394-4115-b3cd-998802a12290 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:49.261481 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1e493-8394-4115-b3cd-998802a12290 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:49.261759 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1e493-8394-4115-b3cd-998802a12290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:49.296255 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-f8a1e493-8394-4115-b3cd-998802a12290 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:16:49.297489 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-f8a1e493-8394-4115-b3cd-998802a12290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:16:49.300315 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-74f73603-f1b7-4352-a210-26c432f143fe None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:16:49.301511 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-74f73603-f1b7-4352-a210-26c432f143fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:16:49.424597 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:16:49.464913 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 14/26] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:16:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 20:16:49.469823 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 13/27] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:16:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:16:49.471432 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1e493-8394-4115-b3cd-998802a12290 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:16:49.616309 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1e493-8394-4115-b3cd-998802a12290 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:16:49.661361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76569285-ec55-4efe-87c1-39f5cec9246e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:16:49.662001 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76569285-ec55-4efe-87c1-39f5cec9246e None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:49.662292 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76569285-ec55-4efe-87c1-39f5cec9246e None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:49.662575 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76569285-ec55-4efe-87c1-39f5cec9246e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:49.678488 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76569285-ec55-4efe-87c1-39f5cec9246e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:16:49.679979 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76569285-ec55-4efe-87c1-39f5cec9246e None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:16:49.699664 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-76569285-ec55-4efe-87c1-39f5cec9246e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:16:49.699664 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:16:49.699664 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:16:49.699664 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:16:49.699664 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:16:49.699664 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:16:49.699664 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:16:49.699664 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:16:49.699664 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:16:49.699664 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:16:49.699664 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:16:49.699664 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:16:49.699664 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:16:49.699664 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:16:49.699664 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:16:49.699664 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:16:49.700528 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:16:49.700528 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:16:49.700528 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:16:49.700528 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:16:49.700528 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:16:49.700528 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:16:49.700528 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:16:49.700528 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:16:49.700528 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:16:49.700528 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:16:49.700528 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:16:49.700528 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:16:49.700528 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:16:49.700528 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:16:49.700528 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:16:49.700528 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:16:49.700528 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:16:49.701389 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:16:49.701389 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:16:49.701389 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:16:49.701389 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 15/28] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:16:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:16:49.706795 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f73603-f1b7-4352-a210-26c432f143fe None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:16:49.761481 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:16:49.848851 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f73603-f1b7-4352-a210-26c432f143fe None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:16:49.849913 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76569285-ec55-4efe-87c1-39f5cec9246e None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:16:49.933340 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e24fc-2959-4ca6-b11b-1d63a9f82245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:16:49.934029 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e24fc-2959-4ca6-b11b-1d63a9f82245 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:49.934253 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e24fc-2959-4ca6-b11b-1d63a9f82245 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:49.934770 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e24fc-2959-4ca6-b11b-1d63a9f82245 None admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:49.937536 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e24fc-2959-4ca6-b11b-1d63a9f82245 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:16:49.937925 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e24fc-2959-4ca6-b11b-1d63a9f82245 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:16:49.939548 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e24fc-2959-4ca6-b11b-1d63a9f82245 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:16:49.954276 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:16:49.978624 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 14/29] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:16:49.979555 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e24fc-2959-4ca6-b11b-1d63a9f82245 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:16:50.053714 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76569285-ec55-4efe-87c1-39f5cec9246e None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:16:50.089893 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:16:50.107226 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934cfca-8db1-444c-a3d7-92f072bc367d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:16:50.108084 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934cfca-8db1-444c-a3d7-92f072bc367d None admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:50.108374 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934cfca-8db1-444c-a3d7-92f072bc367d None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:50.109128 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934cfca-8db1-444c-a3d7-92f072bc367d None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:50.110112 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934cfca-8db1-444c-a3d7-92f072bc367d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:16:50.111522 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934cfca-8db1-444c-a3d7-92f072bc367d None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:16:50.111830 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e24fc-2959-4ca6-b11b-1d63a9f82245 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:16:50.154953 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb35b8d-fd9d-40de-aca8-ef504e6de912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:16:50.155746 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb35b8d-fd9d-40de-aca8-ef504e6de912 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:50.156106 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb35b8d-fd9d-40de-aca8-ef504e6de912 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:50.156498 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb35b8d-fd9d-40de-aca8-ef504e6de912 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:50.170055 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb35b8d-fd9d-40de-aca8-ef504e6de912 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:16:50.180617 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-1bb35b8d-fd9d-40de-aca8-ef504e6de912 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:16:50.180617 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:16:50.180617 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:16:50.180617 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:16:50.180617 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:16:50.180617 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:16:50.180617 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:16:50.180617 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:16:50.180617 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:16:50.180617 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:16:50.180617 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:16:50.180617 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:16:50.180617 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:16:50.180617 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:16:50.180617 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:16:50.180617 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:16:50.181478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:16:50.181478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:16:50.181478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:16:50.181478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:16:50.181478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:16:50.181478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:16:50.181478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:16:50.181478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:16:50.181478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:16:50.181478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:16:50.181478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:16:50.181478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:16:50.181478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:16:50.181478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:16:50.181478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:16:50.181478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:16:50.183068 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:16:50.183068 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:16:50.183068 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:16:50.183068 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:16:50.183068 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:16:50.183068 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:16:50.183068 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:16:50.183068 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:16:50.183068 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:16:50.183068 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:16:50.183068 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:16:50.183068 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:16:50.183652 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 15/30] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Nov 2 20:16:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:16:50.185300 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb35b8d-fd9d-40de-aca8-ef504e6de912 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:16:50.263659 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 16/31] 10.222.0.23 () {60 vars in 1131 bytes} [Wed Nov 2 20:16:49 2022] POST /identity/v3/roles => generated 219 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:16:50.265189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee54e0-769d-4f80-8f09-f600177425bc None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:50.265482 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee54e0-769d-4f80-8f09-f600177425bc None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:50.265768 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee54e0-769d-4f80-8f09-f600177425bc None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:50.271313 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 17/32] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:16:50.272252 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee54e0-769d-4f80-8f09-f600177425bc None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:16:50.336517 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb35b8d-fd9d-40de-aca8-ef504e6de912 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:16:50.414694 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f17b74-bffb-4350-a24d-ff144bc27a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:16:50.415258 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f17b74-bffb-4350-a24d-ff144bc27a12 None admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:50.415547 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f17b74-bffb-4350-a24d-ff144bc27a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:50.415829 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f17b74-bffb-4350-a24d-ff144bc27a12 None admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:50.416562 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f17b74-bffb-4350-a24d-ff144bc27a12 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:16:50.418059 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f17b74-bffb-4350-a24d-ff144bc27a12 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:16:50.443631 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:16:50.452731 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee54e0-769d-4f80-8f09-f600177425bc None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:16:50.475601 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:16:50.498382 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 16/33] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Nov 2 20:16:50 2022] POST /identity/v3/projects => generated 301 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:16:50.504848 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff726c-106d-486a-bd4f-ae1fc11bbcc5 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:50.505138 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff726c-106d-486a-bd4f-ae1fc11bbcc5 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:50.505461 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff726c-106d-486a-bd4f-ae1fc11bbcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:50.522089 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369deb5-b23e-4779-8bf2-eb258488c430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:16:50.524817 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369deb5-b23e-4779-8bf2-eb258488c430 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:50.524817 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369deb5-b23e-4779-8bf2-eb258488c430 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:50.524817 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369deb5-b23e-4779-8bf2-eb258488c430 None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:50.524817 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369deb5-b23e-4779-8bf2-eb258488c430 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:16:50.524817 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369deb5-b23e-4779-8bf2-eb258488c430 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:16:50.526728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369deb5-b23e-4779-8bf2-eb258488c430 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:16:50.537241 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-56ff726c-106d-486a-bd4f-ae1fc11bbcc5 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:16:50.538561 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-56ff726c-106d-486a-bd4f-ae1fc11bbcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:16:50.554437 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 18/34] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:16:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:16:50.560540 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369deb5-b23e-4779-8bf2-eb258488c430 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:16:50.630210 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 17/35] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:16:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:16:50.631339 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa5a08-6aaa-4b0c-8bfe-218387ed439d None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:50.631630 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa5a08-6aaa-4b0c-8bfe-218387ed439d None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:50.631982 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa5a08-6aaa-4b0c-8bfe-218387ed439d None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:50.637863 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 18/36] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:16:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:16:50.644057 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056abde-b0e6-4179-8dae-6674144d1081 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:50.644352 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056abde-b0e6-4179-8dae-6674144d1081 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:50.644661 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056abde-b0e6-4179-8dae-6674144d1081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:50.686048 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-c056abde-b0e6-4179-8dae-6674144d1081 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:16:50.687701 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-c056abde-b0e6-4179-8dae-6674144d1081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:16:50.748817 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369deb5-b23e-4779-8bf2-eb258488c430 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:16:50.804654 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 19/37] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:16:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 20:16:50.806308 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcc127-46ae-4e74-98cb-6de306116e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:16:50.806969 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcc127-46ae-4e74-98cb-6de306116e65 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:50.808120 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcc127-46ae-4e74-98cb-6de306116e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:50.808355 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcc127-46ae-4e74-98cb-6de306116e65 None admin] PATH_INFO: `/v3/users/8da8f4c56d9b4bd0a6e3eaa2f4387ea6` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:50.812617 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcc127-46ae-4e74-98cb-6de306116e65 None admin] RBAC: Authorizing `identity:get_user(user_id=8da8f4c56d9b4bd0a6e3eaa2f4387ea6)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:16:50.812617 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcc127-46ae-4e74-98cb-6de306116e65 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:16:50.817325 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 19/38] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:16:50 2022] GET /identity/v3/users/8da8f4c56d9b4bd0a6e3eaa2f4387ea6 => generated 247 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:16:50.818658 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056abde-b0e6-4179-8dae-6674144d1081 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:16:50.891816 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:16:50.935669 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7432abe-5854-48a9-a538-ac368e501b20 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:50.935968 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7432abe-5854-48a9-a538-ac368e501b20 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:50.936288 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7432abe-5854-48a9-a538-ac368e501b20 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:50.937614 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 20/39] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 20:16:50.938484 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7432abe-5854-48a9-a538-ac368e501b20 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:16:50.947367 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056abde-b0e6-4179-8dae-6674144d1081 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:16:50.986426 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:16:50.988041 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd185d-5ae1-44f7-8dcd-6749a11be5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:16:50.988738 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd185d-5ae1-44f7-8dcd-6749a11be5e5 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:50.989028 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd185d-5ae1-44f7-8dcd-6749a11be5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:50.989312 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd185d-5ae1-44f7-8dcd-6749a11be5e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:50.991734 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd185d-5ae1-44f7-8dcd-6749a11be5e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:16:50.993115 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd185d-5ae1-44f7-8dcd-6749a11be5e5 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:16:50.994760 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 20/40] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:16:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:16:50.995899 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9ef3c-ad13-41f4-94aa-a703960dd3e8 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:50.996186 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9ef3c-ad13-41f4-94aa-a703960dd3e8 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:50.996467 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9ef3c-ad13-41f4-94aa-a703960dd3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:51.017301 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-27f9ef3c-ad13-41f4-94aa-a703960dd3e8 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:16:51.018487 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-27f9ef3c-ad13-41f4-94aa-a703960dd3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:16:51.070013 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7432abe-5854-48a9-a538-ac368e501b20 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:16:51.090375 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 21/41] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:16:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:16:51.091231 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9ef3c-ad13-41f4-94aa-a703960dd3e8 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:16:51.105312 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86837beb-da8a-40c8-9324-2d5b5d86217e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:16:51.105945 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86837beb-da8a-40c8-9324-2d5b5d86217e None admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:51.106235 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86837beb-da8a-40c8-9324-2d5b5d86217e None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:51.106517 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86837beb-da8a-40c8-9324-2d5b5d86217e None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:51.107203 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86837beb-da8a-40c8-9324-2d5b5d86217e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:16:51.108633 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86837beb-da8a-40c8-9324-2d5b5d86217e None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:16:51.124136 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 21/42] 10.222.0.23 () {60 vars in 1131 bytes} [Wed Nov 2 20:16:50 2022] POST /identity/v3/roles => generated 225 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:16:51.125765 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86837beb-da8a-40c8-9324-2d5b5d86217e None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:16:51.153259 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:16:51.218131 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9ef3c-ad13-41f4-94aa-a703960dd3e8 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:16:51.259451 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868f327-9081-49ff-ae45-9a644c13452b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:16:51.261040 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868f327-9081-49ff-ae45-9a644c13452b None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:51.261475 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868f327-9081-49ff-ae45-9a644c13452b None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:51.261891 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868f327-9081-49ff-ae45-9a644c13452b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:51.262913 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868f327-9081-49ff-ae45-9a644c13452b None admin] RBAC: Adding query filter params (role.id=bca2e686aa5e4fdc844fc679a4c41939, scope.domain.id=default, user.id=8da8f4c56d9b4bd0a6e3eaa2f4387ea6) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:16:51.263414 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868f327-9081-49ff-ae45-9a644c13452b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:16:51.265177 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868f327-9081-49ff-ae45-9a644c13452b None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:16:51.275014 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 22/43] 10.222.0.23 () {56 vars in 1322 bytes} [Wed Nov 2 20:16:51 2022] GET /identity/v3/role_assignments?user.id=8da8f4c56d9b4bd0a6e3eaa2f4387ea6&scope.domain.id=default&role.id=bca2e686aa5e4fdc844fc679a4c41939 => generated 530 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:16:51.360117 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:16:51.365650 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868f327-9081-49ff-ae45-9a644c13452b None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:16:51.374161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86837beb-da8a-40c8-9324-2d5b5d86217e None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:16:51.415662 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14073551-9c75-49a9-92ef-101eca9ab289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:16:51.417478 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14073551-9c75-49a9-92ef-101eca9ab289 None admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:51.418070 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14073551-9c75-49a9-92ef-101eca9ab289 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:51.418583 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14073551-9c75-49a9-92ef-101eca9ab289 None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:51.419468 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14073551-9c75-49a9-92ef-101eca9ab289 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:16:51.421203 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14073551-9c75-49a9-92ef-101eca9ab289 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:16:51.445017 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 22/44] 10.222.0.23 () {60 vars in 1131 bytes} [Wed Nov 2 20:16:51 2022] POST /identity/v3/roles => generated 223 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:16:51.498512 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868f327-9081-49ff-ae45-9a644c13452b None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:16:51.518031 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:16:51.540751 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69cc5b-de56-4245-8c79-c0d3aaced7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:16:51.541405 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69cc5b-de56-4245-8c79-c0d3aaced7b6 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:51.542225 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69cc5b-de56-4245-8c79-c0d3aaced7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:51.542503 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69cc5b-de56-4245-8c79-c0d3aaced7b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:51.543648 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a69cc5b-de56-4245-8c79-c0d3aaced7b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:16:51.545161 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a69cc5b-de56-4245-8c79-c0d3aaced7b6 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:16:51.546784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 23/45] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:16:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:16:51.552603 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14073551-9c75-49a9-92ef-101eca9ab289 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:16:51.659310 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14073551-9c75-49a9-92ef-101eca9ab289 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:16:51.693599 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae1fe5-6661-4315-86e3-927bf2d9e17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:16:51.694208 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae1fe5-6661-4315-86e3-927bf2d9e17d None admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:51.694493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae1fe5-6661-4315-86e3-927bf2d9e17d None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:51.694770 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae1fe5-6661-4315-86e3-927bf2d9e17d None admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:51.695413 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae1fe5-6661-4315-86e3-927bf2d9e17d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:16:51.696873 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae1fe5-6661-4315-86e3-927bf2d9e17d None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:16:51.721991 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 23/46] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Nov 2 20:16:51 2022] POST /identity/v3/projects => generated 312 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:16:53.858049 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9af128-bbd7-4f70-934e-5723a0ce767b None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:53.858543 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9af128-bbd7-4f70-934e-5723a0ce767b None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:53.858625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9af128-bbd7-4f70-934e-5723a0ce767b None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:53.859944 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 24/47] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:16:53.865224 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bac6e-dc8e-490b-a69a-ed71d4fa3fd7 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:53.865595 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bac6e-dc8e-490b-a69a-ed71d4fa3fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:53.865792 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bac6e-dc8e-490b-a69a-ed71d4fa3fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:53.872653 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:16:53.886004 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-739bac6e-dc8e-490b-a69a-ed71d4fa3fd7 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:16:53.887488 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-739bac6e-dc8e-490b-a69a-ed71d4fa3fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:16:53.951585 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 24/48] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:16:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:16:54.222611 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9af128-bbd7-4f70-934e-5723a0ce767b None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:16:54.320061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9af128-bbd7-4f70-934e-5723a0ce767b None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:16:54.351822 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964d9c1-74a4-462c-bed6-9fcf76b46629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:16:54.352452 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964d9c1-74a4-462c-bed6-9fcf76b46629 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:54.352759 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964d9c1-74a4-462c-bed6-9fcf76b46629 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:54.353042 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964d9c1-74a4-462c-bed6-9fcf76b46629 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:54.354193 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964d9c1-74a4-462c-bed6-9fcf76b46629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:16:54.355637 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964d9c1-74a4-462c-bed6-9fcf76b46629 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:16:54.357221 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 25/49] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:16:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:16:54.362601 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bac6e-dc8e-490b-a69a-ed71d4fa3fd7 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:16:54.458607 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bac6e-dc8e-490b-a69a-ed71d4fa3fd7 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:16:54.486437 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:16:54.491337 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e54090-82d0-4d6d-a89d-6b92459d448a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:16:54.491938 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e54090-82d0-4d6d-a89d-6b92459d448a None admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:54.492222 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e54090-82d0-4d6d-a89d-6b92459d448a None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:54.492497 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e54090-82d0-4d6d-a89d-6b92459d448a None admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:54.493172 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e54090-82d0-4d6d-a89d-6b92459d448a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:16:54.495135 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e54090-82d0-4d6d-a89d-6b92459d448a None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:16:54.520159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 25/50] 10.222.0.23 () {60 vars in 1140 bytes} [Wed Nov 2 20:16:54 2022] POST /identity/v3/projects => generated 298 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:16:56.626795 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214f8a6-e3dc-4d46-823f-af0bc4f4459f None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:56.627292 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214f8a6-e3dc-4d46-823f-af0bc4f4459f None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:56.627403 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214f8a6-e3dc-4d46-823f-af0bc4f4459f None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:56.628770 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 26/51] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:16:56.633920 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7293f9-8da9-4e54-84d1-fd4efe0c8fce None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:56.634307 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7293f9-8da9-4e54-84d1-fd4efe0c8fce None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:56.634477 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7293f9-8da9-4e54-84d1-fd4efe0c8fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:56.652843 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-ed7293f9-8da9-4e54-84d1-fd4efe0c8fce None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:16:56.654029 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-ed7293f9-8da9-4e54-84d1-fd4efe0c8fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:16:56.718752 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 26/52] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:16:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:16:56.989089 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214f8a6-e3dc-4d46-823f-af0bc4f4459f None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:16:57.041087 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:16:57.087695 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214f8a6-e3dc-4d46-823f-af0bc4f4459f None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:16:57.120557 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fec66-ecf6-4d07-9b8d-3dd28268f576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:16:57.121208 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fec66-ecf6-4d07-9b8d-3dd28268f576 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:57.121497 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fec66-ecf6-4d07-9b8d-3dd28268f576 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:57.121778 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fec66-ecf6-4d07-9b8d-3dd28268f576 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:57.122884 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fec66-ecf6-4d07-9b8d-3dd28268f576 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:16:57.124322 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fec66-ecf6-4d07-9b8d-3dd28268f576 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:16:57.126241 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 27/53] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:16:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:16:57.131431 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7293f9-8da9-4e54-84d1-fd4efe0c8fce None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:16:57.227932 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7293f9-8da9-4e54-84d1-fd4efe0c8fce None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:16:57.242566 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:16:57.262611 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d806c31-301f-46a5-8546-cd6e81259430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:16:57.263212 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d806c31-301f-46a5-8546-cd6e81259430 None admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:16:57.263502 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d806c31-301f-46a5-8546-cd6e81259430 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:16:57.263780 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d806c31-301f-46a5-8546-cd6e81259430 None admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:16:57.264427 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d806c31-301f-46a5-8546-cd6e81259430 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:16:57.265909 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d806c31-301f-46a5-8546-cd6e81259430 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:16:57.291052 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 27/54] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Nov 2 20:16:57 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:17:00.482724 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b044fed-489e-43ab-85af-613246b742a3 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:00.483775 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b044fed-489e-43ab-85af-613246b742a3 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:00.484281 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b044fed-489e-43ab-85af-613246b742a3 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:00.485897 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 28/55] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:00.494858 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff370a5d-bcf6-4ab3-8368-24e1c553d49c None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:00.495690 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff370a5d-bcf6-4ab3-8368-24e1c553d49c None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:00.496198 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff370a5d-bcf6-4ab3-8368-24e1c553d49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:00.538696 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-ff370a5d-bcf6-4ab3-8368-24e1c553d49c None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:00.540189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-ff370a5d-bcf6-4ab3-8368-24e1c553d49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:00.644850 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 28/56] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:00.706301 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fca5a-14c4-4847-a66f-4fdf388d2808 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:00.706924 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fca5a-14c4-4847-a66f-4fdf388d2808 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:00.707442 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fca5a-14c4-4847-a66f-4fdf388d2808 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:00.709050 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 29/57] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:00.714279 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cebd9-f27c-4960-a375-c943ff2a8b3e None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:00.714820 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cebd9-f27c-4960-a375-c943ff2a8b3e None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:00.715300 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cebd9-f27c-4960-a375-c943ff2a8b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:00.734941 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-aa6cebd9-f27c-4960-a375-c943ff2a8b3e None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:00.740568 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-aa6cebd9-f27c-4960-a375-c943ff2a8b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:00.838921 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 29/58] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:01.011342 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765fca5a-14c4-4847-a66f-4fdf388d2808 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:01.036712 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e166031-9fee-4375-8fdd-94fe378abb0a None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:01.037357 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e166031-9fee-4375-8fdd-94fe378abb0a None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:01.037840 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e166031-9fee-4375-8fdd-94fe378abb0a None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:01.039420 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 30/59] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:01.044817 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e0baa-19c7-4115-9a56-7a7d87e3590f None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:01.045378 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e0baa-19c7-4115-9a56-7a7d87e3590f None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:01.045860 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e0baa-19c7-4115-9a56-7a7d87e3590f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:01.067175 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-768e0baa-19c7-4115-9a56-7a7d87e3590f None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:01.073431 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-768e0baa-19c7-4115-9a56-7a7d87e3590f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:01.101342 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:01.148784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765fca5a-14c4-4847-a66f-4fdf388d2808 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:01.154772 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 31/60] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 20:17:01.156276 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990417d8-db97-4f04-8503-9e6ae6c274a4 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:01.156826 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990417d8-db97-4f04-8503-9e6ae6c274a4 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:01.157303 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990417d8-db97-4f04-8503-9e6ae6c274a4 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:01.158783 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 32/61] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:01.164391 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c4e3e-2ade-4a4f-9f73-c6b114565e81 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:01.164830 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c4e3e-2ade-4a4f-9f73-c6b114565e81 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:01.165318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c4e3e-2ade-4a4f-9f73-c6b114565e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:01.174331 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:01.185820 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-0c1c4e3e-2ade-4a4f-9f73-c6b114565e81 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:01.187238 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-0c1c4e3e-2ade-4a4f-9f73-c6b114565e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:01.191170 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe4756-3244-43df-96b0-9f108c62d259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:01.192056 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe4756-3244-43df-96b0-9f108c62d259 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:01.192538 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe4756-3244-43df-96b0-9f108c62d259 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:01.193056 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe4756-3244-43df-96b0-9f108c62d259 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:01.205507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe4756-3244-43df-96b0-9f108c62d259 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:01.211078 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-debe4756-3244-43df-96b0-9f108c62d259 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 20:17:01.211078 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:01.211078 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:01.211078 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:01.211078 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:01.211078 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:01.211078 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:01.211078 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:01.211078 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:01.211078 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:01.211078 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:01.211078 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:01.211078 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:01.211078 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:01.211078 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:01.211078 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:01.211931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:01.211931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:01.211931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:01.211931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:01.211931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:01.211931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:01.211931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:01.211931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:01.211931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:01.211931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:01.211931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:01.211931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:01.211931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:01.211931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:01.211931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:01.211931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:01.212717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:01.212717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:01.212717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:01.212717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:01.212717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:01.212717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:01.212717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:01.212717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:01.212717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:01.212717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:01.212717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 20:17:01.212717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:01.215439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 30/62] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:17:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:01.221827 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe4756-3244-43df-96b0-9f108c62d259 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:01.258579 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 33/63] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 20:17:01.259435 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c4e3e-2ade-4a4f-9f73-c6b114565e81 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:01.369476 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:01.380365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c4e3e-2ade-4a4f-9f73-c6b114565e81 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:01.418427 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af4bf0-f519-40b2-8f62-4677f63359c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:01.419710 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af4bf0-f519-40b2-8f62-4677f63359c7 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:01.420090 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af4bf0-f519-40b2-8f62-4677f63359c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:01.420374 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af4bf0-f519-40b2-8f62-4677f63359c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:01.434640 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af4bf0-f519-40b2-8f62-4677f63359c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:01.441889 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-e8af4bf0-f519-40b2-8f62-4677f63359c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:17:01.441889 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:01.441889 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:01.441889 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:01.441889 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:01.441889 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:01.441889 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:01.441889 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:01.441889 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:01.441889 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:01.441889 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:01.441889 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:01.441889 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:01.441889 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:01.441889 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:01.441889 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:01.442918 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:01.442918 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:01.442918 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:01.442918 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:01.442918 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:01.442918 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:01.442918 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:01.442918 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:01.442918 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:01.442918 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:01.442918 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:01.442918 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:01.442918 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:01.442918 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:01.442918 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:01.442918 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:01.443728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:01.443728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:01.443728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:01.443728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:01.443728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:01.443728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:01.443728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:01.443728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:01.443728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:01.443728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:01.443728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:17:01.443728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:01.443728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 34/64] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Nov 2 20:17:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:01.445719 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6b8f2-0799-441e-9680-580913745214 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:01.445976 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6b8f2-0799-441e-9680-580913745214 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:01.446266 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6b8f2-0799-441e-9680-580913745214 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:01.448052 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 35/65] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:01.451572 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6b8f2-0799-441e-9680-580913745214 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:01.453543 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe4756-3244-43df-96b0-9f108c62d259 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:01.491562 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774088ee-f3f3-4ef9-b1fa-4eb0d742388d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:01.492282 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774088ee-f3f3-4ef9-b1fa-4eb0d742388d None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:01.492842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774088ee-f3f3-4ef9-b1fa-4eb0d742388d None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:01.493292 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774088ee-f3f3-4ef9-b1fa-4eb0d742388d None admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:01.494221 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774088ee-f3f3-4ef9-b1fa-4eb0d742388d None admin] RBAC: Adding query filter params (name=member) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:01.494841 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774088ee-f3f3-4ef9-b1fa-4eb0d742388d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:01.496365 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774088ee-f3f3-4ef9-b1fa-4eb0d742388d None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:01.505499 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 31/66] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Nov 2 20:17:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:01.510565 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb7edc-7983-4c0e-bc82-5e015c7fc239 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:01.510565 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb7edc-7983-4c0e-bc82-5e015c7fc239 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:01.510565 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb7edc-7983-4c0e-bc82-5e015c7fc239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:01.531733 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-0ccb7edc-7983-4c0e-bc82-5e015c7fc239 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:01.532980 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-0ccb7edc-7983-4c0e-bc82-5e015c7fc239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:01.569391 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:01.570250 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6b8f2-0799-441e-9680-580913745214 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:01.600493 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 32/67] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:01.601384 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb7edc-7983-4c0e-bc82-5e015c7fc239 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:01.615528 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4604192-94fc-4962-8ef3-2b102a6be003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:01.616148 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4604192-94fc-4962-8ef3-2b102a6be003 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:01.616435 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4604192-94fc-4962-8ef3-2b102a6be003 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:01.616746 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4604192-94fc-4962-8ef3-2b102a6be003 None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:01.617440 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4604192-94fc-4962-8ef3-2b102a6be003 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:01.617732 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4604192-94fc-4962-8ef3-2b102a6be003 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:01.619243 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4604192-94fc-4962-8ef3-2b102a6be003 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:01.627695 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 36/68] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:17:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:17:01.628344 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4604192-94fc-4962-8ef3-2b102a6be003 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:01.646855 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:01.709653 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb7edc-7983-4c0e-bc82-5e015c7fc239 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:01.737588 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4604192-94fc-4962-8ef3-2b102a6be003 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:01.746944 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59993dc-f41c-4de0-b4db-7d62028c95b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:01.747585 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59993dc-f41c-4de0-b4db-7d62028c95b5 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:01.747873 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59993dc-f41c-4de0-b4db-7d62028c95b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:01.748155 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59993dc-f41c-4de0-b4db-7d62028c95b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:01.758827 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59993dc-f41c-4de0-b4db-7d62028c95b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:01.764196 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-b59993dc-f41c-4de0-b4db-7d62028c95b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 20:17:01.764196 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:01.764196 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:01.764196 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:01.764196 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:01.764196 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:01.764196 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:01.764196 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:01.764196 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:01.764196 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:01.764196 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:01.764196 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:01.764196 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:01.764196 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:01.764196 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:01.764196 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:01.765165 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:01.765165 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:01.765165 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:01.765165 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:01.765165 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:01.765165 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:01.765165 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:01.765165 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:01.765165 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:01.765165 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:01.765165 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:01.765165 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:01.765165 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:01.765165 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:01.765165 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:01.765165 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:01.765935 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:01.765935 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:01.765935 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:01.765935 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:01.765935 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:01.765935 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:01.765935 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:01.765935 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:01.765935 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:01.765935 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:01.765935 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 20:17:01.765935 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:01.765935 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 33/69] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:17:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:01.767259 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59993dc-f41c-4de0-b4db-7d62028c95b5 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:01.774904 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdd3b4-90de-4b58-81d4-e2429480a5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:01.776066 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdd3b4-90de-4b58-81d4-e2429480a5d1 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:01.776349 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdd3b4-90de-4b58-81d4-e2429480a5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:01.776648 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdd3b4-90de-4b58-81d4-e2429480a5d1 None admin] PATH_INFO: `/v3/users/fd569b70f63d4b6e81062c7234183a4c` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:01.793586 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acdd3b4-90de-4b58-81d4-e2429480a5d1 None admin] RBAC: Authorizing `identity:get_user(user_id=fd569b70f63d4b6e81062c7234183a4c)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:01.795067 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acdd3b4-90de-4b58-81d4-e2429480a5d1 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:01.801057 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 37/70] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:17:01 2022] GET /identity/v3/users/fd569b70f63d4b6e81062c7234183a4c => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:01.801057 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdd3b4-90de-4b58-81d4-e2429480a5d1 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:01.808403 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:01.883633 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:01.892866 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59993dc-f41c-4de0-b4db-7d62028c95b5 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:01.914430 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdd3b4-90de-4b58-81d4-e2429480a5d1 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:01.927111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299a7ff-c4cf-4fd4-a865-4c7a9cc6c1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:01.927746 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299a7ff-c4cf-4fd4-a865-4c7a9cc6c1b1 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:01.928047 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299a7ff-c4cf-4fd4-a865-4c7a9cc6c1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:01.928310 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299a7ff-c4cf-4fd4-a865-4c7a9cc6c1b1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:01.938987 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d299a7ff-c4cf-4fd4-a865-4c7a9cc6c1b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:01.943807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-d299a7ff-c4cf-4fd4-a865-4c7a9cc6c1b1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 20:17:01.943807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:01.943807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:01.943807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:01.943807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:01.943807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:01.943807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:01.943807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:01.943807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:01.943807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:01.943807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:01.943807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:01.943807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:01.943807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:01.943807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:01.943807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:01.944714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:01.944714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:01.944714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:01.944714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:01.944714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:01.944714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:01.944714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:01.944714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:01.944714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:01.944714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:01.944714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:01.944714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:01.944714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:01.944714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:01.944714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:01.944714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:01.945497 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:01.945497 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:01.945497 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:01.945497 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:01.945497 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:01.945497 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:01.945497 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:01.945497 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:01.945497 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:01.945497 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:01.945497 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 20:17:01.945497 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:01.945497 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 34/71] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Nov 2 20:17:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:01.946126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299a7ff-c4cf-4fd4-a865-4c7a9cc6c1b1 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:01.952027 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a174b-9686-4128-816a-d12c794a3a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:01.952694 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a174b-9686-4128-816a-d12c794a3a38 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:01.952976 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a174b-9686-4128-816a-d12c794a3a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:01.953252 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a174b-9686-4128-816a-d12c794a3a38 None admin] PATH_INFO: `/v3/users/8da8f4c56d9b4bd0a6e3eaa2f4387ea6` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:01.954377 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a174b-9686-4128-816a-d12c794a3a38 None admin] RBAC: Authorizing `identity:get_user(user_id=8da8f4c56d9b4bd0a6e3eaa2f4387ea6)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:01.955821 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a174b-9686-4128-816a-d12c794a3a38 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:01.957538 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 38/72] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:17:01 2022] GET /identity/v3/users/8da8f4c56d9b4bd0a6e3eaa2f4387ea6 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:01.958168 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a174b-9686-4128-816a-d12c794a3a38 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:02.034815 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:02.044406 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299a7ff-c4cf-4fd4-a865-4c7a9cc6c1b1 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:02.058563 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a174b-9686-4128-816a-d12c794a3a38 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:02.078075 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901f30a-b3fa-4e72-b9f4-8bb70261efb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:02.078680 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901f30a-b3fa-4e72-b9f4-8bb70261efb9 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:02.078962 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901f30a-b3fa-4e72-b9f4-8bb70261efb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:02.079239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901f30a-b3fa-4e72-b9f4-8bb70261efb9 None admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:02.079905 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0901f30a-b3fa-4e72-b9f4-8bb70261efb9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:02.080212 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0901f30a-b3fa-4e72-b9f4-8bb70261efb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:02.081645 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0901f30a-b3fa-4e72-b9f4-8bb70261efb9 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:02.089451 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 35/73] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Nov 2 20:17:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:02.090225 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901f30a-b3fa-4e72-b9f4-8bb70261efb9 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:02.095627 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac846a2e-602f-4f5a-a72f-18bfe809708f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:02.096273 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac846a2e-602f-4f5a-a72f-18bfe809708f None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:02.096590 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac846a2e-602f-4f5a-a72f-18bfe809708f None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:02.096879 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac846a2e-602f-4f5a-a72f-18bfe809708f None admin] PATH_INFO: `/v3/projects/54309652841a4da99a2089119546ac6d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:02.098028 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac846a2e-602f-4f5a-a72f-18bfe809708f None admin] RBAC: Authorizing `identity:get_project(project_id=54309652841a4da99a2089119546ac6d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:02.099487 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac846a2e-602f-4f5a-a72f-18bfe809708f None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:02.101162 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 39/74] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Nov 2 20:17:01 2022] GET /identity/v3/projects/54309652841a4da99a2089119546ac6d => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:02.101995 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac846a2e-602f-4f5a-a72f-18bfe809708f None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:02.111228 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:02.190221 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901f30a-b3fa-4e72-b9f4-8bb70261efb9 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:02.204848 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac846a2e-602f-4f5a-a72f-18bfe809708f None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:02.223491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c862a5-2431-4c4d-8e51-090490150ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:02.224129 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c862a5-2431-4c4d-8e51-090490150ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:02.224420 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c862a5-2431-4c4d-8e51-090490150ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:02.224734 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c862a5-2431-4c4d-8e51-090490150ec9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:02.225875 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c862a5-2431-4c4d-8e51-090490150ec9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:02.227315 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c862a5-2431-4c4d-8e51-090490150ec9 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:02.229441 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 36/75] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:17:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:02.230225 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c862a5-2431-4c4d-8e51-090490150ec9 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:02.241215 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63ea4b-cc0b-4201-8542-351fb2388020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:02.241829 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63ea4b-cc0b-4201-8542-351fb2388020 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:02.242116 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63ea4b-cc0b-4201-8542-351fb2388020 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:02.242397 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63ea4b-cc0b-4201-8542-351fb2388020 None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:02.243068 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63ea4b-cc0b-4201-8542-351fb2388020 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:02.243378 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63ea4b-cc0b-4201-8542-351fb2388020 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:02.245346 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63ea4b-cc0b-4201-8542-351fb2388020 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:02.253184 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 40/76] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:17:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:02.253968 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63ea4b-cc0b-4201-8542-351fb2388020 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:02.255315 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:02.319949 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:02.330934 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c862a5-2431-4c4d-8e51-090490150ec9 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:02.354705 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63ea4b-cc0b-4201-8542-351fb2388020 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:02.363472 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607e36a-67d2-4aba-825d-a563f30508ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:02.364104 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607e36a-67d2-4aba-825d-a563f30508ee None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:02.364396 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607e36a-67d2-4aba-825d-a563f30508ee None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:02.364711 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607e36a-67d2-4aba-825d-a563f30508ee None admin] PATH_INFO: `/v3/projects/54309652841a4da99a2089119546ac6d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:02.365866 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607e36a-67d2-4aba-825d-a563f30508ee None admin] RBAC: Authorizing `identity:get_project(project_id=54309652841a4da99a2089119546ac6d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:02.367304 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607e36a-67d2-4aba-825d-a563f30508ee None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:02.368966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 37/77] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Nov 2 20:17:02 2022] GET /identity/v3/projects/54309652841a4da99a2089119546ac6d => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:02.369779 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607e36a-67d2-4aba-825d-a563f30508ee None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:02.387769 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cb1ef-3d6b-470c-bbbc-760cb50ec8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:02.388396 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cb1ef-3d6b-470c-bbbc-760cb50ec8d1 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:02.388711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cb1ef-3d6b-470c-bbbc-760cb50ec8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:02.388992 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cb1ef-3d6b-470c-bbbc-760cb50ec8d1 None admin] PATH_INFO: `/v3/users/fd569b70f63d4b6e81062c7234183a4c` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:02.390114 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7cb1ef-3d6b-470c-bbbc-760cb50ec8d1 None admin] RBAC: Authorizing `identity:get_user(user_id=fd569b70f63d4b6e81062c7234183a4c)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:02.391553 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7cb1ef-3d6b-470c-bbbc-760cb50ec8d1 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:02.393164 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 41/78] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:17:02 2022] GET /identity/v3/users/fd569b70f63d4b6e81062c7234183a4c => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:02.393906 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cb1ef-3d6b-470c-bbbc-760cb50ec8d1 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:02.461789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:02.473116 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607e36a-67d2-4aba-825d-a563f30508ee None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:02.492512 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cb1ef-3d6b-470c-bbbc-760cb50ec8d1 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:02.505736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4447065-b69c-495a-9707-7c027ba2c1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:02.506393 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4447065-b69c-495a-9707-7c027ba2c1ea None admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:02.506680 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4447065-b69c-495a-9707-7c027ba2c1ea None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:02.506965 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4447065-b69c-495a-9707-7c027ba2c1ea None admin] PATH_INFO: `/v3/projects/54309652841a4da99a2089119546ac6d/users/fd569b70f63d4b6e81062c7234183a4c/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:02.508930 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4447065-b69c-495a-9707-7c027ba2c1ea None admin] RBAC: Authorizing `identity:create_grant(project_id=54309652841a4da99a2089119546ac6d, user_id=fd569b70f63d4b6e81062c7234183a4c, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:02.510397 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4447065-b69c-495a-9707-7c027ba2c1ea None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:02.524222 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 38/79] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Nov 2 20:17:02 2022] PUT /identity/v3/projects/54309652841a4da99a2089119546ac6d/users/fd569b70f63d4b6e81062c7234183a4c/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:17:02.530570 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4447065-b69c-495a-9707-7c027ba2c1ea None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:02.533112 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8993f-3284-46f8-aaa6-b6bec32180c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:02.533752 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8993f-3284-46f8-aaa6-b6bec32180c3 None admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:02.534044 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8993f-3284-46f8-aaa6-b6bec32180c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:02.534349 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8993f-3284-46f8-aaa6-b6bec32180c3 None admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:02.535038 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8993f-3284-46f8-aaa6-b6bec32180c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:02.536582 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8993f-3284-46f8-aaa6-b6bec32180c3 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:02.546874 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:02.572580 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 42/80] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Nov 2 20:17:02 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:17:02.572580 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8993f-3284-46f8-aaa6-b6bec32180c3 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:02.654985 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4447065-b69c-495a-9707-7c027ba2c1ea None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:02.696055 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36957db5-ee22-4abf-ad5b-c10c9421bf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:02.696814 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36957db5-ee22-4abf-ad5b-c10c9421bf74 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:02.697106 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36957db5-ee22-4abf-ad5b-c10c9421bf74 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:02.697462 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36957db5-ee22-4abf-ad5b-c10c9421bf74 None admin] PATH_INFO: `/v3/users/fd569b70f63d4b6e81062c7234183a4c` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:02.699229 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36957db5-ee22-4abf-ad5b-c10c9421bf74 None admin] RBAC: Authorizing `identity:get_user(user_id=fd569b70f63d4b6e81062c7234183a4c)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:02.700893 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36957db5-ee22-4abf-ad5b-c10c9421bf74 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:02.702609 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 39/81] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:17:02 2022] GET /identity/v3/users/fd569b70f63d4b6e81062c7234183a4c => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:02.703431 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36957db5-ee22-4abf-ad5b-c10c9421bf74 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:02.731406 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:02.736468 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8993f-3284-46f8-aaa6-b6bec32180c3 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:02.780682 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb39f7-14a5-42c4-8349-9152efadefe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:02.781363 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb39f7-14a5-42c4-8349-9152efadefe2 None admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:02.781653 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb39f7-14a5-42c4-8349-9152efadefe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:02.781931 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb39f7-14a5-42c4-8349-9152efadefe2 None admin] PATH_INFO: `/v3/projects/54309652841a4da99a2089119546ac6d/users/8da8f4c56d9b4bd0a6e3eaa2f4387ea6/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:02.783882 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb39f7-14a5-42c4-8349-9152efadefe2 None admin] RBAC: Authorizing `identity:create_grant(project_id=54309652841a4da99a2089119546ac6d, user_id=8da8f4c56d9b4bd0a6e3eaa2f4387ea6, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:02.786148 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb39f7-14a5-42c4-8349-9152efadefe2 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:02.803635 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 43/82] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Nov 2 20:17:02 2022] PUT /identity/v3/projects/54309652841a4da99a2089119546ac6d/users/8da8f4c56d9b4bd0a6e3eaa2f4387ea6/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:17:02.804535 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb39f7-14a5-42c4-8349-9152efadefe2 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:02.855614 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36957db5-ee22-4abf-ad5b-c10c9421bf74 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:02.870302 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:02.912616 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0095a-a2ab-4641-93bf-d1426437bd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:02.913563 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0095a-a2ab-4641-93bf-d1426437bd3f None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:02.913857 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0095a-a2ab-4641-93bf-d1426437bd3f None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:02.914145 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0095a-a2ab-4641-93bf-d1426437bd3f None admin] PATH_INFO: `/v3/projects/77ef8169d9104571a36f224821aa2452` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:02.915816 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0095a-a2ab-4641-93bf-d1426437bd3f None admin] RBAC: Authorizing `identity:get_project(project_id=77ef8169d9104571a36f224821aa2452)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:02.918152 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0095a-a2ab-4641-93bf-d1426437bd3f None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:02.921333 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 40/83] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Nov 2 20:17:02 2022] GET /identity/v3/projects/77ef8169d9104571a36f224821aa2452 => generated 312 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:02.927324 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0095a-a2ab-4641-93bf-d1426437bd3f None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:02.936036 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb39f7-14a5-42c4-8349-9152efadefe2 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:02.975994 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1e9cd-9a9a-482c-856c-2cd5a0407c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:02.976680 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1e9cd-9a9a-482c-856c-2cd5a0407c75 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:02.976973 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1e9cd-9a9a-482c-856c-2cd5a0407c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:02.977257 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1e9cd-9a9a-482c-856c-2cd5a0407c75 None admin] PATH_INFO: `/v3/projects/54309652841a4da99a2089119546ac6d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:02.978606 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1e9cd-9a9a-482c-856c-2cd5a0407c75 None admin] RBAC: Authorizing `identity:get_project(project_id=54309652841a4da99a2089119546ac6d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:02.980295 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1e9cd-9a9a-482c-856c-2cd5a0407c75 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:02.982477 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 44/84] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Nov 2 20:17:02 2022] GET /identity/v3/projects/54309652841a4da99a2089119546ac6d => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:02.989693 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1e9cd-9a9a-482c-856c-2cd5a0407c75 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:03.056396 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:03.079527 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0095a-a2ab-4641-93bf-d1426437bd3f None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:03.123696 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b38601-b7ef-41f1-8bcb-08cba5f0ea02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:03.125341 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b38601-b7ef-41f1-8bcb-08cba5f0ea02 None admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:03.125839 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b38601-b7ef-41f1-8bcb-08cba5f0ea02 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:03.126628 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b38601-b7ef-41f1-8bcb-08cba5f0ea02 None admin] PATH_INFO: `/v3/projects/77ef8169d9104571a36f224821aa2452/users/fd569b70f63d4b6e81062c7234183a4c/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:03.129176 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b38601-b7ef-41f1-8bcb-08cba5f0ea02 None admin] RBAC: Authorizing `identity:create_grant(project_id=77ef8169d9104571a36f224821aa2452, user_id=fd569b70f63d4b6e81062c7234183a4c, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:03.131272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b38601-b7ef-41f1-8bcb-08cba5f0ea02 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:03.140857 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1e9cd-9a9a-482c-856c-2cd5a0407c75 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:03.152397 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 41/85] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Nov 2 20:17:02 2022] PUT /identity/v3/projects/77ef8169d9104571a36f224821aa2452/users/fd569b70f63d4b6e81062c7234183a4c/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:17:03.173877 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:03.203594 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b97b8-1894-4bcb-a6a1-59f29e63e151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:03.204673 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b97b8-1894-4bcb-a6a1-59f29e63e151 None admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:03.205194 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b97b8-1894-4bcb-a6a1-59f29e63e151 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:03.205708 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b97b8-1894-4bcb-a6a1-59f29e63e151 None admin] PATH_INFO: `/v3/projects/54309652841a4da99a2089119546ac6d/users/fd569b70f63d4b6e81062c7234183a4c/roles/c415cff16e364aa9a9d40b79936ab4a9` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:03.208312 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b97b8-1894-4bcb-a6a1-59f29e63e151 None admin] RBAC: Authorizing `identity:create_grant(project_id=54309652841a4da99a2089119546ac6d, user_id=fd569b70f63d4b6e81062c7234183a4c, role_id=c415cff16e364aa9a9d40b79936ab4a9)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:03.210114 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b97b8-1894-4bcb-a6a1-59f29e63e151 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:03.230369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 45/86] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Nov 2 20:17:02 2022] PUT /identity/v3/projects/54309652841a4da99a2089119546ac6d/users/fd569b70f63d4b6e81062c7234183a4c/roles/c415cff16e364aa9a9d40b79936ab4a9 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:17:05.022767 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdb92c-f853-47db-8058-dea2a41cb5f0 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:05.023275 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdb92c-f853-47db-8058-dea2a41cb5f0 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:05.023348 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdb92c-f853-47db-8058-dea2a41cb5f0 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:05.024860 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 42/87] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:05.045855 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bba02-7e9c-43d4-8216-3da1f15cec34 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:05.046679 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bba02-7e9c-43d4-8216-3da1f15cec34 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:05.047106 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bba02-7e9c-43d4-8216-3da1f15cec34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:05.070458 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-299bba02-7e9c-43d4-8216-3da1f15cec34 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:05.071921 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-299bba02-7e9c-43d4-8216-3da1f15cec34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:05.158226 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 46/88] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:05.692836 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdb92c-f853-47db-8058-dea2a41cb5f0 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:05.816742 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdb92c-f853-47db-8058-dea2a41cb5f0 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:05.852669 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d34d66-70a7-422b-96c1-0c0e72016057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:05.853792 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d34d66-70a7-422b-96c1-0c0e72016057 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:05.854277 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d34d66-70a7-422b-96c1-0c0e72016057 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:05.854753 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d34d66-70a7-422b-96c1-0c0e72016057 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:05.866374 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d34d66-70a7-422b-96c1-0c0e72016057 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:05.877477 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-71d34d66-70a7-422b-96c1-0c0e72016057 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 20:17:05.877477 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:05.877477 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:05.877477 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:05.877477 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:05.877477 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:05.877477 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:05.877477 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:05.877477 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:05.877477 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:05.877477 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:05.877477 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:05.877477 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:05.877477 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:05.877477 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:05.877477 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:05.878367 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:05.878367 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:05.878367 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:05.878367 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:05.878367 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:05.878367 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:05.878367 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:05.878367 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:05.878367 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:05.878367 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:05.878367 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:05.878367 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:05.878367 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:05.878367 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:05.878367 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:05.878367 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:05.879150 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:05.879150 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:05.879150 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:05.879150 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:05.879150 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:05.879150 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:05.879150 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:05.879150 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:05.879150 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:05.879150 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:05.879150 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 20:17:05.879150 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:05.881525 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 43/89] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:17:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:05.888137 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bba02-7e9c-43d4-8216-3da1f15cec34 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:06.028714 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bba02-7e9c-43d4-8216-3da1f15cec34 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:06.042191 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:06.085354 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f1de5-c08e-4f2c-bf88-a245a822a0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:06.086750 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f1de5-c08e-4f2c-bf88-a245a822a0cf None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:06.087233 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f1de5-c08e-4f2c-bf88-a245a822a0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:06.087722 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f1de5-c08e-4f2c-bf88-a245a822a0cf None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:06.088674 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f1de5-c08e-4f2c-bf88-a245a822a0cf None admin] RBAC: Adding query filter params (name=member) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:06.089178 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f1de5-c08e-4f2c-bf88-a245a822a0cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:06.090774 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f1de5-c08e-4f2c-bf88-a245a822a0cf None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:06.099626 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 47/90] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Nov 2 20:17:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:06.105822 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d34d66-70a7-422b-96c1-0c0e72016057 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:06.115660 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:06.158617 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e44adb-f225-4d0b-84ad-9f72c8d68b99 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:06.158944 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e44adb-f225-4d0b-84ad-9f72c8d68b99 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:06.159186 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e44adb-f225-4d0b-84ad-9f72c8d68b99 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:06.164826 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 48/91] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 20:17:06.166815 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020f722-5c3e-408f-a58d-a0014da42142 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:06.167110 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020f722-5c3e-408f-a58d-a0014da42142 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:06.167393 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020f722-5c3e-408f-a58d-a0014da42142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:06.200138 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-3020f722-5c3e-408f-a58d-a0014da42142 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:06.207790 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-3020f722-5c3e-408f-a58d-a0014da42142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:06.242084 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d34d66-70a7-422b-96c1-0c0e72016057 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:06.315550 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419fd1c2-061f-42d1-a7b4-fde391335eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:06.317668 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fd1c2-061f-42d1-a7b4-fde391335eae None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:06.318332 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fd1c2-061f-42d1-a7b4-fde391335eae None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:06.319462 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fd1c2-061f-42d1-a7b4-fde391335eae None admin] PATH_INFO: `/v3/users/fd569b70f63d4b6e81062c7234183a4c` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:06.321026 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419fd1c2-061f-42d1-a7b4-fde391335eae None admin] RBAC: Authorizing `identity:get_user(user_id=fd569b70f63d4b6e81062c7234183a4c)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:06.324326 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419fd1c2-061f-42d1-a7b4-fde391335eae None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:06.327500 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 44/92] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:17:06 2022] GET /identity/v3/users/fd569b70f63d4b6e81062c7234183a4c => generated 275 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:06.328940 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71251723-b9e4-4b3e-a22e-d414377fdea1 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:06.329441 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71251723-b9e4-4b3e-a22e-d414377fdea1 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:06.330013 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71251723-b9e4-4b3e-a22e-d414377fdea1 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:06.331424 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 45/93] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:06.336739 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cc09e-4752-41b6-a7fc-a689bedc36be None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:06.337277 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cc09e-4752-41b6-a7fc-a689bedc36be None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:06.338456 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cc09e-4752-41b6-a7fc-a689bedc36be None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:06.340034 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 46/94] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:06.344596 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cc09e-4752-41b6-a7fc-a689bedc36be None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:06.347919 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 49/95] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 20:17:06.349082 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd1343-b0c1-4e45-af2d-b6d5d786e6fa None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:06.349376 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd1343-b0c1-4e45-af2d-b6d5d786e6fa None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:06.349713 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd1343-b0c1-4e45-af2d-b6d5d786e6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:06.368266 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-a0bd1343-b0c1-4e45-af2d-b6d5d786e6fa None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:06.370115 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-a0bd1343-b0c1-4e45-af2d-b6d5d786e6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:06.437687 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:06.461529 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 50/96] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:06.463671 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79503c47-b442-4f1f-bef5-f89f93dfc40b None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:06.463964 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79503c47-b442-4f1f-bef5-f89f93dfc40b None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:06.464510 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79503c47-b442-4f1f-bef5-f89f93dfc40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:06.468946 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cc09e-4752-41b6-a7fc-a689bedc36be None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:06.487333 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-79503c47-b442-4f1f-bef5-f89f93dfc40b None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:06.489214 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-79503c47-b442-4f1f-bef5-f89f93dfc40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:06.507554 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd2cbc-fc1f-49f7-9d8a-8621c4fc1383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:06.508730 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd2cbc-fc1f-49f7-9d8a-8621c4fc1383 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:06.509078 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd2cbc-fc1f-49f7-9d8a-8621c4fc1383 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:06.509640 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd2cbc-fc1f-49f7-9d8a-8621c4fc1383 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:06.527076 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:06.577828 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 51/97] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:06.579279 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddb4cc-5cf2-4c84-9906-6eb94a5cfecc None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:06.580933 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddb4cc-5cf2-4c84-9906-6eb94a5cfecc None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:06.581268 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddb4cc-5cf2-4c84-9906-6eb94a5cfecc None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:06.582738 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 52/98] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:06.590393 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11043359-614f-4536-b8fa-71a502afd564 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:06.590620 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11043359-614f-4536-b8fa-71a502afd564 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:06.591451 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11043359-614f-4536-b8fa-71a502afd564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:06.612397 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd2cbc-fc1f-49f7-9d8a-8621c4fc1383 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:06.613894 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd2cbc-fc1f-49f7-9d8a-8621c4fc1383 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:06.628843 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-11043359-614f-4536-b8fa-71a502afd564 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:06.630957 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-11043359-614f-4536-b8fa-71a502afd564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:06.713346 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 53/99] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 20:17:06.714204 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11043359-614f-4536-b8fa-71a502afd564 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:06.792080 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:06.835771 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 47/100] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Nov 2 20:17:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 20:17:06.841652 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd2cbc-fc1f-49f7-9d8a-8621c4fc1383 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:06.878950 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:06.899533 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11043359-614f-4536-b8fa-71a502afd564 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:06.954155 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd2cbc-fc1f-49f7-9d8a-8621c4fc1383 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:06.955105 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de9ff4-7c1d-4e1c-be89-99d185816076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:06.956220 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de9ff4-7c1d-4e1c-be89-99d185816076 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:06.956684 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de9ff4-7c1d-4e1c-be89-99d185816076 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:06.957243 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de9ff4-7c1d-4e1c-be89-99d185816076 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:06.968215 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de9ff4-7c1d-4e1c-be89-99d185816076 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:06.973232 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-94de9ff4-7c1d-4e1c-be89-99d185816076 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:17:06.973232 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:06.973232 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:06.973232 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:06.973232 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:06.973232 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:06.973232 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:06.973232 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:06.973232 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:06.973232 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:06.973232 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:06.973232 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:06.973232 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:06.973232 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:06.973232 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:06.973232 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:06.974071 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:06.974071 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:06.974071 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:06.974071 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:06.974071 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:06.974071 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:06.974071 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:06.974071 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:06.974071 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:06.974071 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:06.974071 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:06.974071 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:06.974071 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:06.974071 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:06.974071 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:06.974071 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:06.974820 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:06.974820 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:06.974820 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:06.974820 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:06.974820 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:06.974820 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:06.974820 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:06.974820 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:06.974820 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:06.974820 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:06.974820 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:17:06.974820 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:06.974820 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 54/101] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Nov 2 20:17:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:06.975443 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de9ff4-7c1d-4e1c-be89-99d185816076 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:06.997898 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525eb979-3801-4424-a5c0-934fcb73c3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:06.998548 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525eb979-3801-4424-a5c0-934fcb73c3cb None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:06.998835 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525eb979-3801-4424-a5c0-934fcb73c3cb None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:06.999120 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525eb979-3801-4424-a5c0-934fcb73c3cb None admin] PATH_INFO: `/v3/projects/54309652841a4da99a2089119546ac6d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:07.000247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525eb979-3801-4424-a5c0-934fcb73c3cb None admin] RBAC: Authorizing `identity:get_project(project_id=54309652841a4da99a2089119546ac6d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:07.001769 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525eb979-3801-4424-a5c0-934fcb73c3cb None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:07.003404 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 48/102] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Nov 2 20:17:06 2022] GET /identity/v3/projects/54309652841a4da99a2089119546ac6d => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:17:07.008887 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525eb979-3801-4424-a5c0-934fcb73c3cb None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:07.053918 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:07.091612 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de9ff4-7c1d-4e1c-be89-99d185816076 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:07.110799 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525eb979-3801-4424-a5c0-934fcb73c3cb None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:07.125311 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65310c-404f-4166-952c-e6c1fdb39ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:07.125932 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65310c-404f-4166-952c-e6c1fdb39ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:07.126219 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65310c-404f-4166-952c-e6c1fdb39ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:07.126496 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65310c-404f-4166-952c-e6c1fdb39ee7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:07.139163 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65310c-404f-4166-952c-e6c1fdb39ee7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:07.143919 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-ac65310c-404f-4166-952c-e6c1fdb39ee7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 20:17:07.143919 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:07.143919 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:07.143919 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:07.143919 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:07.143919 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:07.143919 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:07.143919 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:07.143919 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:07.143919 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:07.143919 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:07.143919 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:07.143919 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:07.143919 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:07.143919 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:07.143919 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:07.144848 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:07.144848 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:07.144848 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:07.144848 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:07.144848 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:07.144848 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:07.144848 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:07.144848 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:07.144848 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:07.144848 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:07.144848 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:07.144848 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:07.144848 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:07.144848 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:07.144848 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:07.144848 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:07.145602 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:07.145602 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:07.145602 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:07.145602 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:07.145602 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:07.145602 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:07.145602 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:07.145602 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:07.145602 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:07.145602 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:07.145602 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 20:17:07.145602 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:07.145602 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 55/103] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:17:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:07.146223 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9340891-6fa4-4258-a4e3-b76b2f4d1fc9 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:07.146871 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9340891-6fa4-4258-a4e3-b76b2f4d1fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:07.146871 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9340891-6fa4-4258-a4e3-b76b2f4d1fc9 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:07.147985 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d4160-eeb4-4ab0-b825-c946bdb5e2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:07.152459 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d4160-eeb4-4ab0-b825-c946bdb5e2de None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:07.152620 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 56/104] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:07.152713 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d4160-eeb4-4ab0-b825-c946bdb5e2de None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:07.152713 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d4160-eeb4-4ab0-b825-c946bdb5e2de None admin] PATH_INFO: `/v3/domains/default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:07.152875 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9340891-6fa4-4258-a4e3-b76b2f4d1fc9 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:07.153059 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d4160-eeb4-4ab0-b825-c946bdb5e2de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:07.154513 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d4160-eeb4-4ab0-b825-c946bdb5e2de None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:07.160660 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 49/105] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:17:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:07.160660 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d4160-eeb4-4ab0-b825-c946bdb5e2de None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:07.167420 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:07.255172 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d4160-eeb4-4ab0-b825-c946bdb5e2de None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:07.255739 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9340891-6fa4-4258-a4e3-b76b2f4d1fc9 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:07.266073 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:07.289172 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaafda2f-ab58-41a0-a733-86b51615e8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:07.289781 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaafda2f-ab58-41a0-a733-86b51615e8f2 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:07.290063 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaafda2f-ab58-41a0-a733-86b51615e8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:07.290155 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1adbf-ae32-4f8a-82d5-c973f396b781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:07.290336 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaafda2f-ab58-41a0-a733-86b51615e8f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:07.290721 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1adbf-ae32-4f8a-82d5-c973f396b781 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:07.291538 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaafda2f-ab58-41a0-a733-86b51615e8f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:07.291635 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1adbf-ae32-4f8a-82d5-c973f396b781 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:07.291815 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1adbf-ae32-4f8a-82d5-c973f396b781 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:07.291899 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaafda2f-ab58-41a0-a733-86b51615e8f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:07.292539 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1adbf-ae32-4f8a-82d5-c973f396b781 None admin] RBAC: Adding query filter params (role.id=a1e0072f698b484b8cde5a22e350c67d, scope.project.id=54309652841a4da99a2089119546ac6d, user.id=fd569b70f63d4b6e81062c7234183a4c) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:07.292855 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1adbf-ae32-4f8a-82d5-c973f396b781 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:07.293257 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaafda2f-ab58-41a0-a733-86b51615e8f2 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:07.294304 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1adbf-ae32-4f8a-82d5-c973f396b781 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:07.300305 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 50/106] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Nov 2 20:17:07 2022] GET /identity/v3/role_assignments?user.id=fd569b70f63d4b6e81062c7234183a4c&scope.project.id=54309652841a4da99a2089119546ac6d&role.id=a1e0072f698b484b8cde5a22e350c67d => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:07.301112 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1adbf-ae32-4f8a-82d5-c973f396b781 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:07.302249 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 57/107] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:17:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:07.303131 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaafda2f-ab58-41a0-a733-86b51615e8f2 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:07.387810 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:07.417965 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaafda2f-ab58-41a0-a733-86b51615e8f2 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:07.429597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1adbf-ae32-4f8a-82d5-c973f396b781 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:07.456398 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d073d-5bf3-43fa-8e60-ed41ca9ae4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:07.457077 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d073d-5bf3-43fa-8e60-ed41ca9ae4c4 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:07.457366 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d073d-5bf3-43fa-8e60-ed41ca9ae4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:07.457679 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d073d-5bf3-43fa-8e60-ed41ca9ae4c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:07.458361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d073d-5bf3-43fa-8e60-ed41ca9ae4c4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:07.458674 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d073d-5bf3-43fa-8e60-ed41ca9ae4c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:07.460087 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d073d-5bf3-43fa-8e60-ed41ca9ae4c4 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:07.473535 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 58/108] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Nov 2 20:17:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:07.473713 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b5fb6-4ad7-4502-9eaa-2da0be8cfa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:07.473713 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b5fb6-4ad7-4502-9eaa-2da0be8cfa26 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:07.473713 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b5fb6-4ad7-4502-9eaa-2da0be8cfa26 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:07.473940 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c627508-094a-4bd8-89a3-43631f9e6051 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:07.474010 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b5fb6-4ad7-4502-9eaa-2da0be8cfa26 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:07.474075 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c627508-094a-4bd8-89a3-43631f9e6051 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:07.474075 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c627508-094a-4bd8-89a3-43631f9e6051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:07.486561 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b5fb6-4ad7-4502-9eaa-2da0be8cfa26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:07.491933 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-5c627508-094a-4bd8-89a3-43631f9e6051 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:07.492059 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-581b5fb6-4ad7-4502-9eaa-2da0be8cfa26 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 20:17:07.492059 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:07.492059 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:07.492059 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:07.492059 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:07.492059 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:07.492059 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:07.492059 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:07.492059 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:07.492059 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:07.492059 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:07.492059 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:07.492059 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:07.492059 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:07.492059 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:07.492059 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:07.493167 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:07.493167 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:07.493167 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:07.493167 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:07.493167 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:07.493167 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:07.493167 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:07.493167 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:07.493167 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:07.493167 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:07.493167 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:07.493167 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:07.493167 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:07.493167 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:07.493167 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:07.493167 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:07.493918 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:07.493918 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:07.493918 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:07.493918 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:07.493918 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:07.493918 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:07.493918 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:07.493918 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:07.493918 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:07.493918 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:07.493918 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 20:17:07.493918 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:07.493918 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 51/109] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:17:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:07.495108 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-5c627508-094a-4bd8-89a3-43631f9e6051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:07.495183 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b5fb6-4ad7-4502-9eaa-2da0be8cfa26 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:07.534487 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:07.574350 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 59/110] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:07.584801 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c627508-094a-4bd8-89a3-43631f9e6051 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:07.606155 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b5fb6-4ad7-4502-9eaa-2da0be8cfa26 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:07.641866 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e5481-7206-4ee7-812c-f9ee53e22399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:07.642508 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e5481-7206-4ee7-812c-f9ee53e22399 None admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:07.642789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e5481-7206-4ee7-812c-f9ee53e22399 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:07.643074 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e5481-7206-4ee7-812c-f9ee53e22399 None admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:07.643735 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e5481-7206-4ee7-812c-f9ee53e22399 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:07.645199 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e5481-7206-4ee7-812c-f9ee53e22399 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:07.650666 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:07.672306 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 52/111] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Nov 2 20:17:07 2022] POST /identity/v3/projects => generated 302 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:17:07.682179 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e5481-7206-4ee7-812c-f9ee53e22399 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:07.690596 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c627508-094a-4bd8-89a3-43631f9e6051 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:07.730914 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6338848-6a06-4d49-944f-06e8045b5258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:07.731617 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6338848-6a06-4d49-944f-06e8045b5258 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:07.731902 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6338848-6a06-4d49-944f-06e8045b5258 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:07.732182 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6338848-6a06-4d49-944f-06e8045b5258 None admin] PATH_INFO: `/v3/users/8da8f4c56d9b4bd0a6e3eaa2f4387ea6` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:07.733512 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6338848-6a06-4d49-944f-06e8045b5258 None admin] RBAC: Authorizing `identity:get_user(user_id=8da8f4c56d9b4bd0a6e3eaa2f4387ea6)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:07.735093 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6338848-6a06-4d49-944f-06e8045b5258 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:07.741848 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 60/112] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:17:07 2022] GET /identity/v3/users/8da8f4c56d9b4bd0a6e3eaa2f4387ea6 => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:07.742826 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6338848-6a06-4d49-944f-06e8045b5258 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:07.810029 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:07.828701 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e5481-7206-4ee7-812c-f9ee53e22399 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:07.870014 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a8dc0-55e0-408c-8784-93b4d38d8825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:07.870599 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a8dc0-55e0-408c-8784-93b4d38d8825 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:07.870886 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a8dc0-55e0-408c-8784-93b4d38d8825 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:07.871163 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a8dc0-55e0-408c-8784-93b4d38d8825 None admin] PATH_INFO: `/v3/users/198a4d656c1a4b149584d50cc9d20cca` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:07.874606 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6338848-6a06-4d49-944f-06e8045b5258 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:07.889622 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a8dc0-55e0-408c-8784-93b4d38d8825 None admin] RBAC: Authorizing `identity:get_user(user_id=198a4d656c1a4b149584d50cc9d20cca)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:07.891211 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a8dc0-55e0-408c-8784-93b4d38d8825 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:07.893004 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 53/113] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:17:07 2022] GET /identity/v3/users/198a4d656c1a4b149584d50cc9d20cca => generated 289 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:07.893725 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a8dc0-55e0-408c-8784-93b4d38d8825 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:07.914747 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb865034-0017-4562-9f7a-b34cb1bdd7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:07.915366 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb865034-0017-4562-9f7a-b34cb1bdd7fd None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:07.915680 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb865034-0017-4562-9f7a-b34cb1bdd7fd None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:07.916000 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb865034-0017-4562-9f7a-b34cb1bdd7fd None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:07.917014 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb865034-0017-4562-9f7a-b34cb1bdd7fd None admin] RBAC: Adding query filter params (name=member) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:07.917116 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb865034-0017-4562-9f7a-b34cb1bdd7fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:07.918520 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb865034-0017-4562-9f7a-b34cb1bdd7fd None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:07.919840 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:07.932826 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 61/114] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Nov 2 20:17:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:07.932826 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb865034-0017-4562-9f7a-b34cb1bdd7fd None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:08.006763 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a8dc0-55e0-408c-8784-93b4d38d8825 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:08.034986 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb865034-0017-4562-9f7a-b34cb1bdd7fd None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:08.043224 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4698b3c-6649-4bc9-b914-739616737875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:08.043845 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4698b3c-6649-4bc9-b914-739616737875 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:08.044137 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4698b3c-6649-4bc9-b914-739616737875 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:08.044424 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4698b3c-6649-4bc9-b914-739616737875 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:08.060588 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:08.071299 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd7a15-8341-4f19-b236-99ae2926aa40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:08.071885 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd7a15-8341-4f19-b236-99ae2926aa40 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:08.072734 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd7a15-8341-4f19-b236-99ae2926aa40 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:08.073213 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd7a15-8341-4f19-b236-99ae2926aa40 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:08.083928 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd7a15-8341-4f19-b236-99ae2926aa40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:08.089369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-96fd7a15-8341-4f19-b236-99ae2926aa40 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 20:17:08.089369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:08.089369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:08.089369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:08.089369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:08.089369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:08.089369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:08.089369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:08.089369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:08.089369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:08.089369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:08.089369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:08.089369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:08.089369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:08.089369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:08.089369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:08.090244 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:08.090244 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:08.090244 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:08.090244 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:08.090244 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:08.090244 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:08.090244 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:08.090244 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:08.090244 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:08.090244 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:08.090244 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:08.090244 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:08.090244 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:08.090244 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:08.090244 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:08.090244 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:08.091361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:08.091361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:08.091361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:08.091361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:08.091361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:08.091361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:08.091361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:08.091361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:08.091361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:08.091361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:08.091361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 20:17:08.091361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:08.091361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 62/115] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Nov 2 20:17:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:08.093383 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd7a15-8341-4f19-b236-99ae2926aa40 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:08.122136 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4698b3c-6649-4bc9-b914-739616737875 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:08.123709 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4698b3c-6649-4bc9-b914-739616737875 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:08.152231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:08.200249 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd7a15-8341-4f19-b236-99ae2926aa40 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:08.232425 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 54/116] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Nov 2 20:17:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 20:17:08.233659 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4698b3c-6649-4bc9-b914-739616737875 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:08.239565 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26c131-4309-4141-a87b-3140408d06ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:08.240217 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26c131-4309-4141-a87b-3140408d06ed None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:08.240505 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26c131-4309-4141-a87b-3140408d06ed None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:08.240820 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26c131-4309-4141-a87b-3140408d06ed None admin] PATH_INFO: `/v3/projects/54309652841a4da99a2089119546ac6d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:08.241959 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae26c131-4309-4141-a87b-3140408d06ed None admin] RBAC: Authorizing `identity:get_project(project_id=54309652841a4da99a2089119546ac6d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:08.243423 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae26c131-4309-4141-a87b-3140408d06ed None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:08.245820 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 63/117] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Nov 2 20:17:08 2022] GET /identity/v3/projects/54309652841a4da99a2089119546ac6d => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:08.251061 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26c131-4309-4141-a87b-3140408d06ed None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:08.285965 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:08.343306 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4698b3c-6649-4bc9-b914-739616737875 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:08.352994 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26c131-4309-4141-a87b-3140408d06ed None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:08.376936 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:08.378345 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e1725-b9d4-4ad2-94bd-7052c2e448f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:08.379037 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e1725-b9d4-4ad2-94bd-7052c2e448f0 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:08.379368 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e1725-b9d4-4ad2-94bd-7052c2e448f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:08.379700 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e1725-b9d4-4ad2-94bd-7052c2e448f0 None admin] PATH_INFO: `/v3/users/fd569b70f63d4b6e81062c7234183a4c` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:08.380927 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e1725-b9d4-4ad2-94bd-7052c2e448f0 None admin] RBAC: Authorizing `identity:get_user(user_id=fd569b70f63d4b6e81062c7234183a4c)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:08.382381 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e1725-b9d4-4ad2-94bd-7052c2e448f0 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:08.389020 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 55/118] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:17:08 2022] GET /identity/v3/users/fd569b70f63d4b6e81062c7234183a4c => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:08.389747 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21df39-5834-48b7-997d-536f860f4806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:08.389925 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e1725-b9d4-4ad2-94bd-7052c2e448f0 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:08.390374 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21df39-5834-48b7-997d-536f860f4806 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:08.390788 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21df39-5834-48b7-997d-536f860f4806 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:08.391080 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21df39-5834-48b7-997d-536f860f4806 None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:08.391762 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21df39-5834-48b7-997d-536f860f4806 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:08.392079 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21df39-5834-48b7-997d-536f860f4806 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:08.393496 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21df39-5834-48b7-997d-536f860f4806 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:08.406321 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 64/119] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:17:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:08.406321 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21df39-5834-48b7-997d-536f860f4806 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:08.498683 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e1725-b9d4-4ad2-94bd-7052c2e448f0 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:08.502980 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21df39-5834-48b7-997d-536f860f4806 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:08.512793 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:08.542709 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9bd6bf-6ee5-464f-af5f-401b2810fc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:08.542881 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a6759-94a2-4e6d-b765-ad308f5174d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:08.543377 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a6759-94a2-4e6d-b765-ad308f5174d0 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:08.543668 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a6759-94a2-4e6d-b765-ad308f5174d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:08.543951 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a6759-94a2-4e6d-b765-ad308f5174d0 None admin] PATH_INFO: `/v3/projects/54309652841a4da99a2089119546ac6d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:08.544284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bd6bf-6ee5-464f-af5f-401b2810fc8f None admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:08.544768 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bd6bf-6ee5-464f-af5f-401b2810fc8f None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:08.545098 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a6759-94a2-4e6d-b765-ad308f5174d0 None admin] RBAC: Authorizing `identity:get_project(project_id=54309652841a4da99a2089119546ac6d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:08.545389 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bd6bf-6ee5-464f-af5f-401b2810fc8f None admin] PATH_INFO: `/v3/projects/54309652841a4da99a2089119546ac6d/users/198a4d656c1a4b149584d50cc9d20cca/roles/62bfa3f89b8f4618a7a6b1f8d628fd0f` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:08.546548 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a6759-94a2-4e6d-b765-ad308f5174d0 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:08.547650 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9bd6bf-6ee5-464f-af5f-401b2810fc8f None admin] RBAC: Authorizing `identity:create_grant(project_id=54309652841a4da99a2089119546ac6d, user_id=198a4d656c1a4b149584d50cc9d20cca, role_id=62bfa3f89b8f4618a7a6b1f8d628fd0f)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:08.548187 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 56/120] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Nov 2 20:17:08 2022] GET /identity/v3/projects/54309652841a4da99a2089119546ac6d => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:08.548983 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a6759-94a2-4e6d-b765-ad308f5174d0 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:08.549729 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9bd6bf-6ee5-464f-af5f-401b2810fc8f None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:08.564865 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 65/121] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Nov 2 20:17:08 2022] PUT /identity/v3/projects/54309652841a4da99a2089119546ac6d/users/198a4d656c1a4b149584d50cc9d20cca/roles/62bfa3f89b8f4618a7a6b1f8d628fd0f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:17:08.565799 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9bd6bf-6ee5-464f-af5f-401b2810fc8f None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:08.632826 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:08.700890 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a6759-94a2-4e6d-b765-ad308f5174d0 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:08.738572 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9bd6bf-6ee5-464f-af5f-401b2810fc8f None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:08.777701 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ebe7d-b8ae-40ff-b103-e9d8516aaac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:08.780952 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ebe7d-b8ae-40ff-b103-e9d8516aaac7 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:08.781317 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ebe7d-b8ae-40ff-b103-e9d8516aaac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:08.781671 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ebe7d-b8ae-40ff-b103-e9d8516aaac7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:08.809478 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165b282-6318-429b-ba0b-0251af25d722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:08.809478 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165b282-6318-429b-ba0b-0251af25d722 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:08.809478 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165b282-6318-429b-ba0b-0251af25d722 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:08.809478 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165b282-6318-429b-ba0b-0251af25d722 None admin] PATH_INFO: `/v3/users/fd569b70f63d4b6e81062c7234183a4c` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:08.810714 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165b282-6318-429b-ba0b-0251af25d722 None admin] RBAC: Authorizing `identity:get_user(user_id=fd569b70f63d4b6e81062c7234183a4c)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:08.813874 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165b282-6318-429b-ba0b-0251af25d722 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:08.816128 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 66/122] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:17:08 2022] GET /identity/v3/users/fd569b70f63d4b6e81062c7234183a4c => generated 275 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:08.817442 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165b282-6318-429b-ba0b-0251af25d722 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:08.858075 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:08.879304 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ebe7d-b8ae-40ff-b103-e9d8516aaac7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:08.880808 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ebe7d-b8ae-40ff-b103-e9d8516aaac7 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:08.988419 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 57/123] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Nov 2 20:17:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 20:17:08.989107 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ebe7d-b8ae-40ff-b103-e9d8516aaac7 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:09.015910 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165b282-6318-429b-ba0b-0251af25d722 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:09.036054 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:09.076523 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:09.091713 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a281f1-05cb-4bd6-9c3a-568bd5105756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:09.092346 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a281f1-05cb-4bd6-9c3a-568bd5105756 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:09.092922 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a281f1-05cb-4bd6-9c3a-568bd5105756 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:09.092922 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a281f1-05cb-4bd6-9c3a-568bd5105756 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:09.093688 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a281f1-05cb-4bd6-9c3a-568bd5105756 None admin] RBAC: Adding query filter params (role.id=bca2e686aa5e4fdc844fc679a4c41939, scope.project.id=54309652841a4da99a2089119546ac6d, user.id=8da8f4c56d9b4bd0a6e3eaa2f4387ea6) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:09.093973 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a281f1-05cb-4bd6-9c3a-568bd5105756 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:09.095429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a281f1-05cb-4bd6-9c3a-568bd5105756 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:09.100899 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ebe7d-b8ae-40ff-b103-e9d8516aaac7 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:09.115995 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 67/124] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Nov 2 20:17:08 2022] GET /identity/v3/role_assignments?user.id=8da8f4c56d9b4bd0a6e3eaa2f4387ea6&scope.project.id=54309652841a4da99a2089119546ac6d&role.id=bca2e686aa5e4fdc844fc679a4c41939 => generated 608 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:09.121153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a281f1-05cb-4bd6-9c3a-568bd5105756 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:09.192747 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd9b25-5fcb-41a8-a1ad-7c3df491dca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:09.193782 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd9b25-5fcb-41a8-a1ad-7c3df491dca5 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:09.196334 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd9b25-5fcb-41a8-a1ad-7c3df491dca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:09.196766 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd9b25-5fcb-41a8-a1ad-7c3df491dca5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:09.346397 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd9b25-5fcb-41a8-a1ad-7c3df491dca5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:09.347974 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd9b25-5fcb-41a8-a1ad-7c3df491dca5 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:09.377554 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a281f1-05cb-4bd6-9c3a-568bd5105756 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:09.421359 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0157648-0853-42d2-8264-2ed1c1f4f02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:09.422152 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0157648-0853-42d2-8264-2ed1c1f4f02c None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:09.422536 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0157648-0853-42d2-8264-2ed1c1f4f02c None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:09.423407 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0157648-0853-42d2-8264-2ed1c1f4f02c None admin] PATH_INFO: `/v3/projects/77ef8169d9104571a36f224821aa2452` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:09.424931 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0157648-0853-42d2-8264-2ed1c1f4f02c None admin] RBAC: Authorizing `identity:get_project(project_id=77ef8169d9104571a36f224821aa2452)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:09.426654 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0157648-0853-42d2-8264-2ed1c1f4f02c None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:09.429557 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 68/125] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Nov 2 20:17:09 2022] GET /identity/v3/projects/77ef8169d9104571a36f224821aa2452 => generated 312 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:09.436106 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0157648-0853-42d2-8264-2ed1c1f4f02c None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:09.442320 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:09.465478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 58/126] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Nov 2 20:17:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 20:17:09.473537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd9b25-5fcb-41a8-a1ad-7c3df491dca5 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:09.500206 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:09.563227 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0157648-0853-42d2-8264-2ed1c1f4f02c None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:09.597567 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd9b25-5fcb-41a8-a1ad-7c3df491dca5 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:09.601738 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc845a58-381a-4dff-b726-addfb4dff1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:09.602376 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc845a58-381a-4dff-b726-addfb4dff1c1 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:09.602667 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc845a58-381a-4dff-b726-addfb4dff1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:09.602953 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc845a58-381a-4dff-b726-addfb4dff1c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:09.604250 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc845a58-381a-4dff-b726-addfb4dff1c1 None admin] RBAC: Adding query filter params (role.id=a1e0072f698b484b8cde5a22e350c67d, scope.project.id=77ef8169d9104571a36f224821aa2452, user.id=fd569b70f63d4b6e81062c7234183a4c) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:09.604584 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc845a58-381a-4dff-b726-addfb4dff1c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:09.606171 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc845a58-381a-4dff-b726-addfb4dff1c1 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:09.612946 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 69/127] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Nov 2 20:17:09 2022] GET /identity/v3/role_assignments?user.id=fd569b70f63d4b6e81062c7234183a4c&scope.project.id=77ef8169d9104571a36f224821aa2452&role.id=a1e0072f698b484b8cde5a22e350c67d => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:09.643299 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e6a57-6432-44ea-b37c-463c334b54c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:09.643970 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e6a57-6432-44ea-b37c-463c334b54c8 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:09.644262 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e6a57-6432-44ea-b37c-463c334b54c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:09.644565 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e6a57-6432-44ea-b37c-463c334b54c8 None admin] PATH_INFO: `/v3/projects/54309652841a4da99a2089119546ac6d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:09.645813 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e6a57-6432-44ea-b37c-463c334b54c8 None admin] RBAC: Authorizing `identity:get_project(project_id=54309652841a4da99a2089119546ac6d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:09.647502 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e6a57-6432-44ea-b37c-463c334b54c8 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:09.649371 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 59/128] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Nov 2 20:17:09 2022] GET /identity/v3/projects/54309652841a4da99a2089119546ac6d => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:09.655483 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc845a58-381a-4dff-b726-addfb4dff1c1 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:09.769893 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc845a58-381a-4dff-b726-addfb4dff1c1 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:09.786434 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:09.809371 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f1248-e2cf-4801-a32c-299725209dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:09.809992 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f1248-e2cf-4801-a32c-299725209dce None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:09.810284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f1248-e2cf-4801-a32c-299725209dce None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:09.810576 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f1248-e2cf-4801-a32c-299725209dce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:09.811314 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f1248-e2cf-4801-a32c-299725209dce None admin] RBAC: Adding query filter params (role.id=c415cff16e364aa9a9d40b79936ab4a9, scope.project.id=54309652841a4da99a2089119546ac6d, user.id=fd569b70f63d4b6e81062c7234183a4c) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:09.811634 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f1248-e2cf-4801-a32c-299725209dce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:09.813139 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f1248-e2cf-4801-a32c-299725209dce None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:09.819451 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 70/129] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Nov 2 20:17:09 2022] GET /identity/v3/role_assignments?user.id=fd569b70f63d4b6e81062c7234183a4c&scope.project.id=54309652841a4da99a2089119546ac6d&role.id=c415cff16e364aa9a9d40b79936ab4a9 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:09.975518 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac78fd-db31-468c-8c90-857bd05f3975 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:09.975863 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac78fd-db31-468c-8c90-857bd05f3975 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:09.976058 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac78fd-db31-468c-8c90-857bd05f3975 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:09.977457 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 60/130] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:09.983803 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4f781-ccfc-40d2-bd4b-08fdf2466af2 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:09.984102 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4f781-ccfc-40d2-bd4b-08fdf2466af2 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:09.984394 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4f781-ccfc-40d2-bd4b-08fdf2466af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:10.003092 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-e4a4f781-ccfc-40d2-bd4b-08fdf2466af2 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:10.004294 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-e4a4f781-ccfc-40d2-bd4b-08fdf2466af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:10.076174 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 71/131] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:10.347298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac78fd-db31-468c-8c90-857bd05f3975 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:10.397392 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:10.449263 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac78fd-db31-468c-8c90-857bd05f3975 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:10.481864 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a39db-5641-465f-8cc9-f1dba2e71f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:10.482494 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a39db-5641-465f-8cc9-f1dba2e71f12 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:10.482779 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a39db-5641-465f-8cc9-f1dba2e71f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:10.483058 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a39db-5641-465f-8cc9-f1dba2e71f12 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:10.484153 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a39db-5641-465f-8cc9-f1dba2e71f12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:10.485636 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a39db-5641-465f-8cc9-f1dba2e71f12 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:10.487208 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 61/132] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:17:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:10.492750 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4f781-ccfc-40d2-bd4b-08fdf2466af2 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:10.591892 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4f781-ccfc-40d2-bd4b-08fdf2466af2 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:10.595006 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:10.628684 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf9be0-dfd0-4b52-adc2-6d85ab152ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:10.629220 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf9be0-dfd0-4b52-adc2-6d85ab152ea5 None admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:10.629506 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf9be0-dfd0-4b52-adc2-6d85ab152ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:10.629787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf9be0-dfd0-4b52-adc2-6d85ab152ea5 None admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:10.630438 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf9be0-dfd0-4b52-adc2-6d85ab152ea5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:10.631904 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf9be0-dfd0-4b52-adc2-6d85ab152ea5 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:10.652322 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 72/133] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Nov 2 20:17:10 2022] POST /identity/v3/users => generated 283 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:17:10.871549 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a9bf4-2d4f-4340-a6c0-0b9b5a6b403d None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:10.871838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a9bf4-2d4f-4340-a6c0-0b9b5a6b403d None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:10.872148 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a9bf4-2d4f-4340-a6c0-0b9b5a6b403d None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:10.873559 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 62/134] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:10.878888 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe574bd-8aa5-4299-b0b5-f973ae866606 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:10.879121 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe574bd-8aa5-4299-b0b5-f973ae866606 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:10.879397 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe574bd-8aa5-4299-b0b5-f973ae866606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:10.897902 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-fbe574bd-8aa5-4299-b0b5-f973ae866606 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:10.899079 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-fbe574bd-8aa5-4299-b0b5-f973ae866606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:10.972433 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 73/135] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:11.242379 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a9bf4-2d4f-4340-a6c0-0b9b5a6b403d None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:11.345700 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a9bf4-2d4f-4340-a6c0-0b9b5a6b403d None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:11.363568 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:11.381825 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab849b-56e2-42bd-bc87-3de9c8d81989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:11.382466 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab849b-56e2-42bd-bc87-3de9c8d81989 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:11.382762 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab849b-56e2-42bd-bc87-3de9c8d81989 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:11.383050 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab849b-56e2-42bd-bc87-3de9c8d81989 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:11.394103 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab849b-56e2-42bd-bc87-3de9c8d81989 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:11.398979 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-97ab849b-56e2-42bd-bc87-3de9c8d81989 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 20:17:11.398979 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:11.398979 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:11.398979 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:11.398979 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:11.398979 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:11.398979 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:11.398979 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:11.398979 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:11.398979 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:11.398979 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:11.398979 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:11.398979 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:11.398979 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:11.398979 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:11.398979 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:11.399806 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:11.399806 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:11.399806 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:11.399806 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:11.399806 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:11.399806 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:11.399806 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:11.399806 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:11.399806 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:11.399806 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:11.399806 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:11.399806 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:11.399806 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:11.399806 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:11.399806 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:11.399806 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:11.400969 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:11.400969 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:11.400969 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:11.400969 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:11.400969 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:11.400969 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:11.400969 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:11.400969 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:11.400969 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:11.400969 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:11.400969 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 20:17:11.400969 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:11.400969 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 63/136] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:17:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:11.405987 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe574bd-8aa5-4299-b0b5-f973ae866606 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:11.500584 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:11.515785 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe574bd-8aa5-4299-b0b5-f973ae866606 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:11.553344 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee32061-a976-4473-8f1d-c70b242d5599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:11.553962 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee32061-a976-4473-8f1d-c70b242d5599 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:11.554246 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee32061-a976-4473-8f1d-c70b242d5599 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:11.554526 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee32061-a976-4473-8f1d-c70b242d5599 None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:11.555201 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee32061-a976-4473-8f1d-c70b242d5599 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:11.555506 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee32061-a976-4473-8f1d-c70b242d5599 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:11.557448 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee32061-a976-4473-8f1d-c70b242d5599 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:11.566453 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 74/137] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Nov 2 20:17:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:11.572190 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab849b-56e2-42bd-bc87-3de9c8d81989 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:11.680586 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab849b-56e2-42bd-bc87-3de9c8d81989 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:11.718986 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4ba7b-efa5-40bb-81d5-3bee9281643a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:11.719630 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4ba7b-efa5-40bb-81d5-3bee9281643a None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:11.719919 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4ba7b-efa5-40bb-81d5-3bee9281643a None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:11.720266 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4ba7b-efa5-40bb-81d5-3bee9281643a None admin] PATH_INFO: `/v3/users/198a4d656c1a4b149584d50cc9d20cca` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:11.721455 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4ba7b-efa5-40bb-81d5-3bee9281643a None admin] RBAC: Authorizing `identity:get_user(user_id=198a4d656c1a4b149584d50cc9d20cca)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:11.722908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4ba7b-efa5-40bb-81d5-3bee9281643a None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:11.724501 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 64/138] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:17:11 2022] GET /identity/v3/users/198a4d656c1a4b149584d50cc9d20cca => generated 289 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:11.733640 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee32061-a976-4473-8f1d-c70b242d5599 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:11.846401 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee32061-a976-4473-8f1d-c70b242d5599 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:11.881369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36f27e-68ab-4594-b1b2-f07e24b0f82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:11.882025 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36f27e-68ab-4594-b1b2-f07e24b0f82c None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:11.882310 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36f27e-68ab-4594-b1b2-f07e24b0f82c None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:11.882644 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36f27e-68ab-4594-b1b2-f07e24b0f82c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:11.904746 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:11.953749 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36f27e-68ab-4594-b1b2-f07e24b0f82c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:11.955262 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36f27e-68ab-4594-b1b2-f07e24b0f82c None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:12.058339 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 75/139] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Nov 2 20:17:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 20:17:12.064131 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4ba7b-efa5-40bb-81d5-3bee9281643a None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:12.113175 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:12.168957 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4ba7b-efa5-40bb-81d5-3bee9281643a None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:12.204656 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5b5f6-f42f-48eb-922c-a80209a1d9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:12.205725 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5b5f6-f42f-48eb-922c-a80209a1d9f2 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:12.206020 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5b5f6-f42f-48eb-922c-a80209a1d9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:12.206303 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5b5f6-f42f-48eb-922c-a80209a1d9f2 None admin] PATH_INFO: `/v3/projects/54309652841a4da99a2089119546ac6d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:12.207452 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5b5f6-f42f-48eb-922c-a80209a1d9f2 None admin] RBAC: Authorizing `identity:get_project(project_id=54309652841a4da99a2089119546ac6d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:12.208925 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5b5f6-f42f-48eb-922c-a80209a1d9f2 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:12.210855 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 65/140] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Nov 2 20:17:12 2022] GET /identity/v3/projects/54309652841a4da99a2089119546ac6d => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:12.217291 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36f27e-68ab-4594-b1b2-f07e24b0f82c None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:12.270925 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:12.323607 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36f27e-68ab-4594-b1b2-f07e24b0f82c None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:12.358652 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4058b40-5235-4873-8b18-c1fca20cc9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:12.359260 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4058b40-5235-4873-8b18-c1fca20cc9a4 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:12.359546 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4058b40-5235-4873-8b18-c1fca20cc9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:12.359823 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4058b40-5235-4873-8b18-c1fca20cc9a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:12.360560 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4058b40-5235-4873-8b18-c1fca20cc9a4 None admin] RBAC: Adding query filter params (role.id=62bfa3f89b8f4618a7a6b1f8d628fd0f, scope.project.id=54309652841a4da99a2089119546ac6d, user.id=198a4d656c1a4b149584d50cc9d20cca) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:12.360880 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4058b40-5235-4873-8b18-c1fca20cc9a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:12.362328 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4058b40-5235-4873-8b18-c1fca20cc9a4 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:12.368131 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 76/141] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Nov 2 20:17:12 2022] GET /identity/v3/role_assignments?user.id=198a4d656c1a4b149584d50cc9d20cca&scope.project.id=54309652841a4da99a2089119546ac6d&role.id=62bfa3f89b8f4618a7a6b1f8d628fd0f => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:13.036308 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d05d8-9eeb-4323-806b-6d00cfa7e9d6 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:13.036843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d05d8-9eeb-4323-806b-6d00cfa7e9d6 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:13.036939 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d05d8-9eeb-4323-806b-6d00cfa7e9d6 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:13.038407 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 66/142] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:13.043388 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebdc14-a576-479c-84e3-b8dac62c9814 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:13.043756 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebdc14-a576-479c-84e3-b8dac62c9814 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:13.043957 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebdc14-a576-479c-84e3-b8dac62c9814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:13.063285 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-4aebdc14-a576-479c-84e3-b8dac62c9814 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:13.064477 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-4aebdc14-a576-479c-84e3-b8dac62c9814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:13.096202 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f7659-7a6a-4198-8dba-2ea01f03af52 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:13.096492 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f7659-7a6a-4198-8dba-2ea01f03af52 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:13.096802 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f7659-7a6a-4198-8dba-2ea01f03af52 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:13.098144 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 67/143] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:13.103090 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e762df-846b-44a9-84d3-7044f33e52ad None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:13.103549 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e762df-846b-44a9-84d3-7044f33e52ad None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:13.103832 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e762df-846b-44a9-84d3-7044f33e52ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:13.122115 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-d3e762df-846b-44a9-84d3-7044f33e52ad None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:13.123505 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-d3e762df-846b-44a9-84d3-7044f33e52ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:13.132819 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 77/144] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:13.133944 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969e6b4-9a71-4f45-9453-5803e9d1442e None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:13.134227 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969e6b4-9a71-4f45-9453-5803e9d1442e None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:13.134504 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969e6b4-9a71-4f45-9453-5803e9d1442e None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:13.136328 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 78/145] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:13.141410 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11582f-9d2a-412c-8219-a77b8dac91e1 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:13.141700 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11582f-9d2a-412c-8219-a77b8dac91e1 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:13.141982 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11582f-9d2a-412c-8219-a77b8dac91e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:13.159411 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-0a11582f-9d2a-412c-8219-a77b8dac91e1 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:13.160608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-0a11582f-9d2a-412c-8219-a77b8dac91e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:13.200431 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 68/146] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 20:17:13.205068 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:13.233453 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 79/147] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 20:17:13.408113 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e762df-846b-44a9-84d3-7044f33e52ad None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:13.453148 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:13.463969 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11582f-9d2a-412c-8219-a77b8dac91e1 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:13.511548 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e762df-846b-44a9-84d3-7044f33e52ad None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:13.546815 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2eb60c-3c0c-497f-8e42-d284c70f3e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:13.547456 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2eb60c-3c0c-497f-8e42-d284c70f3e31 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:13.547743 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2eb60c-3c0c-497f-8e42-d284c70f3e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:13.548024 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2eb60c-3c0c-497f-8e42-d284c70f3e31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:13.558255 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2eb60c-3c0c-497f-8e42-d284c70f3e31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:13.563434 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-aa2eb60c-3c0c-497f-8e42-d284c70f3e31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:17:13.563434 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:13.563434 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:13.563434 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:13.563434 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:13.563434 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:13.563434 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:13.563434 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:13.563434 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:13.563434 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:13.563434 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:13.563434 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:13.563434 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:13.563434 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:13.563434 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:13.563434 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:13.564482 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:13.564482 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:13.564482 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:13.564482 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:13.564482 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:13.564482 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:13.564482 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:13.564482 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:13.564482 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:13.564482 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:13.564482 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:13.564482 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:13.564482 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:13.564482 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:13.564482 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:13.564482 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:13.565659 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:13.565659 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:13.565659 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:13.565659 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:13.565659 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:13.565659 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:13.565659 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:13.565659 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:13.565659 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:13.565659 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:13.565659 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:17:13.565659 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:13.566502 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11582f-9d2a-412c-8219-a77b8dac91e1 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:13.566594 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 69/148] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Nov 2 20:17:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:13.566594 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2eb60c-3c0c-497f-8e42-d284c70f3e31 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:13.601001 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68367d-2bbe-48f0-8a01-15165beac33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:13.601625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68367d-2bbe-48f0-8a01-15165beac33a None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:13.601904 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68367d-2bbe-48f0-8a01-15165beac33a None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:13.602175 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68367d-2bbe-48f0-8a01-15165beac33a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:13.603300 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68367d-2bbe-48f0-8a01-15165beac33a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:13.604769 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68367d-2bbe-48f0-8a01-15165beac33a None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:13.606326 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 80/149] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:17:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:17:13.609410 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68367d-2bbe-48f0-8a01-15165beac33a None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:13.654194 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:13.667083 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2eb60c-3c0c-497f-8e42-d284c70f3e31 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:13.668641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:13.704599 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927e1d0-5e28-4125-93f7-53386b1c6e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:13.705235 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927e1d0-5e28-4125-93f7-53386b1c6e76 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:13.705517 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927e1d0-5e28-4125-93f7-53386b1c6e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:13.705791 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927e1d0-5e28-4125-93f7-53386b1c6e76 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:13.707788 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68367d-2bbe-48f0-8a01-15165beac33a None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:13.715532 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5927e1d0-5e28-4125-93f7-53386b1c6e76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:13.720324 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-5927e1d0-5e28-4125-93f7-53386b1c6e76 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 20:17:13.720324 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:13.720324 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:13.720324 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:13.720324 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:13.720324 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:13.720324 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:13.720324 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:13.720324 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:13.720324 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:13.720324 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:13.720324 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:13.720324 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:13.720324 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:13.720324 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:13.720324 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:13.721229 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:13.721229 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:13.721229 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:13.721229 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:13.721229 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:13.721229 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:13.721229 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:13.721229 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:13.721229 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:13.721229 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:13.721229 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:13.721229 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:13.721229 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:13.721229 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:13.721229 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:13.721229 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:13.726572 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:13.726572 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:13.726572 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:13.726572 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:13.726572 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:13.726572 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:13.726572 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:13.726572 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:13.726572 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:13.726572 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:13.726572 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 20:17:13.726572 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:13.726572 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 70/150] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Nov 2 20:17:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:13.726572 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927e1d0-5e28-4125-93f7-53386b1c6e76 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:13.740639 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ea832-1757-450f-8fc6-950b7974d020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:13.741239 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ea832-1757-450f-8fc6-950b7974d020 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:13.741518 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ea832-1757-450f-8fc6-950b7974d020 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:13.741784 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ea832-1757-450f-8fc6-950b7974d020 None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:13.742438 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ea832-1757-450f-8fc6-950b7974d020 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:13.742737 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ea832-1757-450f-8fc6-950b7974d020 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:13.744634 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ea832-1757-450f-8fc6-950b7974d020 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:13.752387 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 81/151] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:17:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:13.753190 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ea832-1757-450f-8fc6-950b7974d020 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:13.825736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927e1d0-5e28-4125-93f7-53386b1c6e76 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:13.850041 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ea832-1757-450f-8fc6-950b7974d020 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:13.856672 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:13.858428 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b631bf-11fe-4abd-ba2e-25fac931db35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:13.859042 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b631bf-11fe-4abd-ba2e-25fac931db35 None admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:13.859332 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b631bf-11fe-4abd-ba2e-25fac931db35 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:13.859611 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b631bf-11fe-4abd-ba2e-25fac931db35 None admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:13.860266 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b631bf-11fe-4abd-ba2e-25fac931db35 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:13.861753 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b631bf-11fe-4abd-ba2e-25fac931db35 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:13.883655 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c805b-9308-4bba-9b0f-b1af9a903987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:13.884273 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c805b-9308-4bba-9b0f-b1af9a903987 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:13.884655 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c805b-9308-4bba-9b0f-b1af9a903987 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:13.884945 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c805b-9308-4bba-9b0f-b1af9a903987 None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:13.885595 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c805b-9308-4bba-9b0f-b1af9a903987 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:13.885903 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c805b-9308-4bba-9b0f-b1af9a903987 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:13.887263 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c805b-9308-4bba-9b0f-b1af9a903987 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:13.890120 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 71/152] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Nov 2 20:17:13 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:17:13.891012 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b631bf-11fe-4abd-ba2e-25fac931db35 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:13.904874 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 82/153] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:17:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:13.906497 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c805b-9308-4bba-9b0f-b1af9a903987 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:13.917979 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:14.011212 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b631bf-11fe-4abd-ba2e-25fac931db35 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:14.030617 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c805b-9308-4bba-9b0f-b1af9a903987 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:14.049769 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480bef18-06b7-4a93-b0d3-25786bb0edbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:14.050476 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480bef18-06b7-4a93-b0d3-25786bb0edbd None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:14.050708 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480bef18-06b7-4a93-b0d3-25786bb0edbd None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:14.050990 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480bef18-06b7-4a93-b0d3-25786bb0edbd None admin] PATH_INFO: `/v3/users/8e3cd42f82474d9d9cb54eb02c950dbd` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:14.069410 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480bef18-06b7-4a93-b0d3-25786bb0edbd None admin] RBAC: Authorizing `identity:get_user(user_id=8e3cd42f82474d9d9cb54eb02c950dbd)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:14.069607 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d23f9-a638-4352-9d6d-3fe26165e7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:14.070848 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d23f9-a638-4352-9d6d-3fe26165e7c2 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:14.070848 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d23f9-a638-4352-9d6d-3fe26165e7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:14.070848 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d23f9-a638-4352-9d6d-3fe26165e7c2 None admin] PATH_INFO: `/v3/users/8e3cd42f82474d9d9cb54eb02c950dbd` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:14.071262 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480bef18-06b7-4a93-b0d3-25786bb0edbd None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:14.071880 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d23f9-a638-4352-9d6d-3fe26165e7c2 None admin] RBAC: Authorizing `identity:get_user(user_id=8e3cd42f82474d9d9cb54eb02c950dbd)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:14.073881 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 72/154] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:17:13 2022] GET /identity/v3/users/8e3cd42f82474d9d9cb54eb02c950dbd => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:14.073993 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d23f9-a638-4352-9d6d-3fe26165e7c2 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:14.075480 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 83/155] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:17:13 2022] GET /identity/v3/users/8e3cd42f82474d9d9cb54eb02c950dbd => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:17:14.079065 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480bef18-06b7-4a93-b0d3-25786bb0edbd None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:14.081470 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d23f9-a638-4352-9d6d-3fe26165e7c2 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:14.120913 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:14.176857 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:14.197347 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d23f9-a638-4352-9d6d-3fe26165e7c2 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:14.204503 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480bef18-06b7-4a93-b0d3-25786bb0edbd None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:14.239875 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3edd68-4156-45ba-91e1-12577cf58866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:14.240798 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3edd68-4156-45ba-91e1-12577cf58866 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:14.241229 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3edd68-4156-45ba-91e1-12577cf58866 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:14.241651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3edd68-4156-45ba-91e1-12577cf58866 None admin] PATH_INFO: `/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:14.242918 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3edd68-4156-45ba-91e1-12577cf58866 None admin] RBAC: Authorizing `identity:get_project(project_id=99ca9e0a0fa1499f9f61aa0f83fd5d23)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:14.243037 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517503a-3789-4d42-9486-6d6db8225ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:14.243684 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517503a-3789-4d42-9486-6d6db8225ece None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:14.244029 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517503a-3789-4d42-9486-6d6db8225ece None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:14.244308 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517503a-3789-4d42-9486-6d6db8225ece None admin] PATH_INFO: `/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:14.244860 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3edd68-4156-45ba-91e1-12577cf58866 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:14.245680 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517503a-3789-4d42-9486-6d6db8225ece None admin] RBAC: Authorizing `identity:get_project(project_id=99ca9e0a0fa1499f9f61aa0f83fd5d23)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:14.247542 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 84/156] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Nov 2 20:17:14 2022] GET /identity/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:14.248318 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517503a-3789-4d42-9486-6d6db8225ece None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:14.251111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 73/157] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Nov 2 20:17:14 2022] GET /identity/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:17:14.253469 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3edd68-4156-45ba-91e1-12577cf58866 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:14.257180 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517503a-3789-4d42-9486-6d6db8225ece None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:14.363966 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3edd68-4156-45ba-91e1-12577cf58866 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:14.367043 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:14.368140 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517503a-3789-4d42-9486-6d6db8225ece None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:14.407067 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2e933-7ce9-4b94-966f-35c0b211ce36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:14.408001 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2e933-7ce9-4b94-966f-35c0b211ce36 None admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:14.408435 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2e933-7ce9-4b94-966f-35c0b211ce36 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:14.408903 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2e933-7ce9-4b94-966f-35c0b211ce36 None admin] PATH_INFO: `/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23/users/8e3cd42f82474d9d9cb54eb02c950dbd/roles/c415cff16e364aa9a9d40b79936ab4a9` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:14.409210 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae07a2-d553-4718-a638-2d5a6fbc8738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:14.409938 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae07a2-d553-4718-a638-2d5a6fbc8738 None admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:14.410283 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae07a2-d553-4718-a638-2d5a6fbc8738 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:14.410621 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae07a2-d553-4718-a638-2d5a6fbc8738 None admin] PATH_INFO: `/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23/users/8e3cd42f82474d9d9cb54eb02c950dbd/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:14.411923 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2e933-7ce9-4b94-966f-35c0b211ce36 None admin] RBAC: Authorizing `identity:create_grant(project_id=99ca9e0a0fa1499f9f61aa0f83fd5d23, user_id=8e3cd42f82474d9d9cb54eb02c950dbd, role_id=c415cff16e364aa9a9d40b79936ab4a9)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:14.412668 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae07a2-d553-4718-a638-2d5a6fbc8738 None admin] RBAC: Authorizing `identity:create_grant(project_id=99ca9e0a0fa1499f9f61aa0f83fd5d23, user_id=8e3cd42f82474d9d9cb54eb02c950dbd, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:14.413712 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2e933-7ce9-4b94-966f-35c0b211ce36 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:14.414224 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae07a2-d553-4718-a638-2d5a6fbc8738 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:14.428539 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 74/158] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Nov 2 20:17:14 2022] PUT /identity/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23/users/8e3cd42f82474d9d9cb54eb02c950dbd/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:17:14.429249 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 85/159] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Nov 2 20:17:14 2022] PUT /identity/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23/users/8e3cd42f82474d9d9cb54eb02c950dbd/roles/c415cff16e364aa9a9d40b79936ab4a9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:17:16.202065 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d862b7d-3797-4110-8107-5d9081d06203 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:16.202606 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d862b7d-3797-4110-8107-5d9081d06203 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:16.202606 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d862b7d-3797-4110-8107-5d9081d06203 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:16.204109 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 75/160] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:16.209314 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46587287-6113-4112-abff-4bb1eebe3525 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:16.209719 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46587287-6113-4112-abff-4bb1eebe3525 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:16.209909 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46587287-6113-4112-abff-4bb1eebe3525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:16.228581 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-46587287-6113-4112-abff-4bb1eebe3525 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:16.229767 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-46587287-6113-4112-abff-4bb1eebe3525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:16.300707 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 86/161] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:16.306488 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613f01b-c2be-4cc6-aeb2-c1736127960b None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:16.306868 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613f01b-c2be-4cc6-aeb2-c1736127960b None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:16.307216 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613f01b-c2be-4cc6-aeb2-c1736127960b None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:16.309145 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 76/162] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:16.314147 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dcb72-82bd-4e52-8fe5-8ef328d55cb3 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:16.314441 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dcb72-82bd-4e52-8fe5-8ef328d55cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:16.314719 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dcb72-82bd-4e52-8fe5-8ef328d55cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:16.334630 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-3e0dcb72-82bd-4e52-8fe5-8ef328d55cb3 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:16.335803 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-3e0dcb72-82bd-4e52-8fe5-8ef328d55cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:16.405707 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 87/163] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:16.569748 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613f01b-c2be-4cc6-aeb2-c1736127960b None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:16.574974 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:16.611161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377909e-a10b-4643-a92d-7a154e9a16be None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:16.611499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377909e-a10b-4643-a92d-7a154e9a16be None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:16.611714 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377909e-a10b-4643-a92d-7a154e9a16be None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:16.613080 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 88/164] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:16.621807 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba132d-c199-4c64-8077-66f272548b44 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:16.622322 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba132d-c199-4c64-8077-66f272548b44 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:16.622811 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba132d-c199-4c64-8077-66f272548b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:16.645823 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-79ba132d-c199-4c64-8077-66f272548b44 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:16.647494 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-79ba132d-c199-4c64-8077-66f272548b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:16.668906 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:16.689494 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613f01b-c2be-4cc6-aeb2-c1736127960b None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:16.723330 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6ffae-4946-4760-975f-78e9514f2ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:16.723962 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6ffae-4946-4760-975f-78e9514f2ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:16.724246 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6ffae-4946-4760-975f-78e9514f2ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:16.724385 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 89/165] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:16.724583 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6ffae-4946-4760-975f-78e9514f2ba4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:16.725662 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec60051-9e88-4a58-a6d6-35293550a5a2 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:16.725949 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec60051-9e88-4a58-a6d6-35293550a5a2 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:16.726225 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec60051-9e88-4a58-a6d6-35293550a5a2 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:16.727460 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 90/166] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:16.728181 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec60051-9e88-4a58-a6d6-35293550a5a2 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:16.742917 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6ffae-4946-4760-975f-78e9514f2ba4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:16.748464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-e9c6ffae-4946-4760-975f-78e9514f2ba4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 20:17:16.748464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:16.748464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:16.748464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:16.748464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:16.748464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:16.748464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:16.748464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:16.748464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:16.748464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:16.748464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:16.748464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:16.748464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:16.748464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:16.748464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:16.748464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:16.749389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:16.749389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:16.749389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:16.749389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:16.749389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:16.749389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:16.749389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:16.749389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:16.749389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:16.749389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:16.749389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:16.749389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:16.749389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:16.749389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:16.749389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:16.749389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:16.753096 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:16.753096 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:16.753096 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:16.753096 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:16.753096 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:16.753096 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:16.753096 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:16.753096 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:16.753096 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:16.753096 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:16.753096 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 20:17:16.753096 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:16.753096 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 77/167] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:17:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:16.753096 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac514a-0d3e-4b98-9d2a-cbc02a23734a None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:16.753851 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac514a-0d3e-4b98-9d2a-cbc02a23734a None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:16.753851 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac514a-0d3e-4b98-9d2a-cbc02a23734a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:16.771150 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-f1ac514a-0d3e-4b98-9d2a-cbc02a23734a None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:16.772368 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-f1ac514a-0d3e-4b98-9d2a-cbc02a23734a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:16.834111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:16.843359 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec60051-9e88-4a58-a6d6-35293550a5a2 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:16.843730 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 78/168] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:16.846363 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac514a-0d3e-4b98-9d2a-cbc02a23734a None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:16.877059 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93423964-5248-473f-b988-d3a34698047e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:16.877794 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93423964-5248-473f-b988-d3a34698047e None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:16.877969 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93423964-5248-473f-b988-d3a34698047e None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:16.878231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93423964-5248-473f-b988-d3a34698047e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:16.879494 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93423964-5248-473f-b988-d3a34698047e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:16.880805 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93423964-5248-473f-b988-d3a34698047e None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:16.882371 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 91/169] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:17:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:16.888323 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93423964-5248-473f-b988-d3a34698047e None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:16.928968 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:16.980169 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac514a-0d3e-4b98-9d2a-cbc02a23734a None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:16.992157 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93423964-5248-473f-b988-d3a34698047e None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:17.020239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975bc0b-7733-4c81-9d2b-fb7b815f34c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:17.020887 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975bc0b-7733-4c81-9d2b-fb7b815f34c5 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:17.021237 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975bc0b-7733-4c81-9d2b-fb7b815f34c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:17.021443 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975bc0b-7733-4c81-9d2b-fb7b815f34c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:17.022115 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975bc0b-7733-4c81-9d2b-fb7b815f34c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:17.022426 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975bc0b-7733-4c81-9d2b-fb7b815f34c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:17.023964 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975bc0b-7733-4c81-9d2b-fb7b815f34c5 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:17.027063 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886700b-8b7f-433e-8c61-4c99a78e46fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:17.027672 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886700b-8b7f-433e-8c61-4c99a78e46fa None admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:17.027954 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886700b-8b7f-433e-8c61-4c99a78e46fa None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:17.028232 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886700b-8b7f-433e-8c61-4c99a78e46fa None admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:17.028917 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b886700b-8b7f-433e-8c61-4c99a78e46fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:17.030816 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b886700b-8b7f-433e-8c61-4c99a78e46fa None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:17.036580 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 79/170] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Nov 2 20:17:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:17.036580 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975bc0b-7733-4c81-9d2b-fb7b815f34c5 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:17.058208 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 92/171] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Nov 2 20:17:16 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:17:17.061638 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886700b-8b7f-433e-8c61-4c99a78e46fa None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:17.105566 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:17.160868 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975bc0b-7733-4c81-9d2b-fb7b815f34c5 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:17.173740 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:17.203246 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886700b-8b7f-433e-8c61-4c99a78e46fa None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:17.206299 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9235723-ce80-4009-a266-db162693d51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:17.206953 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9235723-ce80-4009-a266-db162693d51e None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:17.207239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9235723-ce80-4009-a266-db162693d51e None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:17.207519 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9235723-ce80-4009-a266-db162693d51e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:17.220293 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9235723-ce80-4009-a266-db162693d51e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:17.225940 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-d9235723-ce80-4009-a266-db162693d51e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:17:17.225940 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:17.225940 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:17.225940 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:17.225940 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:17.225940 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:17.225940 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:17.225940 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:17.225940 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:17.225940 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:17.225940 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:17.225940 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:17.225940 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:17.225940 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:17.225940 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:17.225940 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:17.226864 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:17.226864 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:17.226864 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:17.226864 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:17.226864 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:17.226864 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:17.226864 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:17.226864 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:17.226864 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:17.226864 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:17.226864 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:17.226864 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:17.226864 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:17.226864 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:17.226864 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:17.226864 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:17.227640 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:17.227640 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:17.227640 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:17.227640 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:17.227640 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:17.227640 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:17.227640 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:17.227640 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:17.227640 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:17.227640 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:17.227640 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:17:17.227640 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:17.227640 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 80/172] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Nov 2 20:17:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:17.228286 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9235723-ce80-4009-a266-db162693d51e None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:17.250190 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8765f-f8fb-4e73-b7dd-96586433b064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:17.251113 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8765f-f8fb-4e73-b7dd-96586433b064 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:17.251113 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8765f-f8fb-4e73-b7dd-96586433b064 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:17.251382 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8765f-f8fb-4e73-b7dd-96586433b064 None admin] PATH_INFO: `/v3/users/6ae5c933fdc4473199bb84c66a5c6408` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:17.269242 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8765f-f8fb-4e73-b7dd-96586433b064 None admin] RBAC: Authorizing `identity:get_user(user_id=6ae5c933fdc4473199bb84c66a5c6408)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:17.271534 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8765f-f8fb-4e73-b7dd-96586433b064 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:17.273607 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 93/173] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:17:17 2022] GET /identity/v3/users/6ae5c933fdc4473199bb84c66a5c6408 => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:17.276654 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8765f-f8fb-4e73-b7dd-96586433b064 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:17.353983 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9235723-ce80-4009-a266-db162693d51e None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:17.372483 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:17.395606 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882376a-7fb9-47b4-9ca3-5afe3287f0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:17.396384 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882376a-7fb9-47b4-9ca3-5afe3287f0ff None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:17.396635 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882376a-7fb9-47b4-9ca3-5afe3287f0ff None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:17.396919 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882376a-7fb9-47b4-9ca3-5afe3287f0ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:17.398221 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8765f-f8fb-4e73-b7dd-96586433b064 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:17.410699 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9882376a-7fb9-47b4-9ca3-5afe3287f0ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:17.417154 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-9882376a-7fb9-47b4-9ca3-5afe3287f0ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 20:17:17.417154 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:17.417154 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:17.417154 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:17.417154 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:17.417154 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:17.417154 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:17.417154 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:17.417154 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:17.417154 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:17.417154 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:17.417154 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:17.417154 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:17.417154 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:17.417154 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:17.417154 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:17.418024 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:17.418024 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:17.418024 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:17.418024 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:17.418024 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:17.418024 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:17.418024 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:17.418024 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:17.418024 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:17.418024 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:17.418024 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:17.418024 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:17.418024 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:17.418024 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:17.418024 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:17.418024 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:17.418821 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:17.418821 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:17.418821 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:17.418821 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:17.418821 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:17.418821 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:17.418821 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:17.418821 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:17.418821 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:17.418821 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:17.418821 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 20:17:17.418821 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:17.420798 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 81/174] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Nov 2 20:17:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:17.421718 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882376a-7fb9-47b4-9ca3-5afe3287f0ff None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:17.440369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f2c10-a0a9-4930-9455-9b49a39c3aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:17.442153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f2c10-a0a9-4930-9455-9b49a39c3aee None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:17.442153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f2c10-a0a9-4930-9455-9b49a39c3aee None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:17.442340 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f2c10-a0a9-4930-9455-9b49a39c3aee None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:17.442958 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f2c10-a0a9-4930-9455-9b49a39c3aee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:17.443438 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f2c10-a0a9-4930-9455-9b49a39c3aee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:17.447921 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f2c10-a0a9-4930-9455-9b49a39c3aee None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:17.448455 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:17.458291 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 94/175] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:17:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:17.459107 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f2c10-a0a9-4930-9455-9b49a39c3aee None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:17.557055 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882376a-7fb9-47b4-9ca3-5afe3287f0ff None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:17.582896 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f2c10-a0a9-4930-9455-9b49a39c3aee None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:17.595076 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9f322-c738-4c47-81f3-d2af52cca579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:17.596178 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9f322-c738-4c47-81f3-d2af52cca579 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:17.596828 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9f322-c738-4c47-81f3-d2af52cca579 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:17.597320 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9f322-c738-4c47-81f3-d2af52cca579 None admin] PATH_INFO: `/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:17.598694 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9f322-c738-4c47-81f3-d2af52cca579 None admin] RBAC: Authorizing `identity:get_project(project_id=99ca9e0a0fa1499f9f61aa0f83fd5d23)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:17.600662 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9f322-c738-4c47-81f3-d2af52cca579 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:17.602957 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 82/176] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Nov 2 20:17:17 2022] GET /identity/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:17.604299 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9f322-c738-4c47-81f3-d2af52cca579 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:17.617959 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c3b78-b961-41a6-b87d-dc3932ff69bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:17.618624 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c3b78-b961-41a6-b87d-dc3932ff69bb None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:17.619390 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c3b78-b961-41a6-b87d-dc3932ff69bb None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:17.619676 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c3b78-b961-41a6-b87d-dc3932ff69bb None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:17.620349 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c3b78-b961-41a6-b87d-dc3932ff69bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:17.620790 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c3b78-b961-41a6-b87d-dc3932ff69bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:17.622087 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c3b78-b961-41a6-b87d-dc3932ff69bb None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:17.630598 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 95/177] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:17:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:17.631472 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c3b78-b961-41a6-b87d-dc3932ff69bb None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:17.673012 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:17.697842 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:17.722129 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9f322-c738-4c47-81f3-d2af52cca579 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:17.741740 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c3b78-b961-41a6-b87d-dc3932ff69bb None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:17.761495 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f70d2-4133-4164-9663-cf68316824c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:17.762480 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f70d2-4133-4164-9663-cf68316824c3 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:17.762964 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f70d2-4133-4164-9663-cf68316824c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:17.763441 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f70d2-4133-4164-9663-cf68316824c3 None admin] PATH_INFO: `/v3/users/8e3cd42f82474d9d9cb54eb02c950dbd` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:17.764825 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f70d2-4133-4164-9663-cf68316824c3 None admin] RBAC: Authorizing `identity:get_user(user_id=8e3cd42f82474d9d9cb54eb02c950dbd)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:17.766483 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f70d2-4133-4164-9663-cf68316824c3 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:17.768279 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 83/178] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:17:17 2022] GET /identity/v3/users/8e3cd42f82474d9d9cb54eb02c950dbd => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:17.769479 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f70d2-4133-4164-9663-cf68316824c3 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:17.782270 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d1a45-5fa6-4f78-b129-6ad021cba363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:17.782869 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d1a45-5fa6-4f78-b129-6ad021cba363 None admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:17.783159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d1a45-5fa6-4f78-b129-6ad021cba363 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:17.783439 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d1a45-5fa6-4f78-b129-6ad021cba363 None admin] PATH_INFO: `/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23/users/6ae5c933fdc4473199bb84c66a5c6408/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:17.785470 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d1a45-5fa6-4f78-b129-6ad021cba363 None admin] RBAC: Authorizing `identity:create_grant(project_id=99ca9e0a0fa1499f9f61aa0f83fd5d23, user_id=6ae5c933fdc4473199bb84c66a5c6408, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:17.786892 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d1a45-5fa6-4f78-b129-6ad021cba363 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:17.801759 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 96/179] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Nov 2 20:17:17 2022] PUT /identity/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23/users/6ae5c933fdc4473199bb84c66a5c6408/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:17:17.802556 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d1a45-5fa6-4f78-b129-6ad021cba363 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:17.925559 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f70d2-4133-4164-9663-cf68316824c3 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:17.939611 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d1a45-5fa6-4f78-b129-6ad021cba363 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:17.960285 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:17.980402 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:18.005308 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0826d-9acb-4138-a48e-bd07ae3a7173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:18.006352 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0826d-9acb-4138-a48e-bd07ae3a7173 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:18.006880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0826d-9acb-4138-a48e-bd07ae3a7173 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:18.007363 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0826d-9acb-4138-a48e-bd07ae3a7173 None admin] PATH_INFO: `/v3/users/8e3cd42f82474d9d9cb54eb02c950dbd` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:18.007552 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c08e6b-b29b-499d-873e-d0b06d68aaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:18.008160 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c08e6b-b29b-499d-873e-d0b06d68aaa7 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:18.008454 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c08e6b-b29b-499d-873e-d0b06d68aaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:18.008792 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c08e6b-b29b-499d-873e-d0b06d68aaa7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:18.010166 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a0826d-9acb-4138-a48e-bd07ae3a7173 None admin] RBAC: Authorizing `identity:get_user(user_id=8e3cd42f82474d9d9cb54eb02c950dbd)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:18.011846 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a0826d-9acb-4138-a48e-bd07ae3a7173 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:18.013870 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 84/180] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:17:17 2022] GET /identity/v3/users/8e3cd42f82474d9d9cb54eb02c950dbd => generated 283 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:18.019415 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0826d-9acb-4138-a48e-bd07ae3a7173 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:18.120144 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c08e6b-b29b-499d-873e-d0b06d68aaa7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:18.121671 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c08e6b-b29b-499d-873e-d0b06d68aaa7 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:18.184359 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0826d-9acb-4138-a48e-bd07ae3a7173 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:18.269340 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b655db4-a7ee-41e1-91b6-c775c821aae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:18.270785 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b655db4-a7ee-41e1-91b6-c775c821aae9 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:18.271270 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b655db4-a7ee-41e1-91b6-c775c821aae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:18.271747 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b655db4-a7ee-41e1-91b6-c775c821aae9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:18.279157 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 97/181] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Nov 2 20:17:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 20:17:18.289625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c08e6b-b29b-499d-873e-d0b06d68aaa7 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:18.329801 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:18.334667 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:18.358297 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b655db4-a7ee-41e1-91b6-c775c821aae9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:18.360080 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b655db4-a7ee-41e1-91b6-c775c821aae9 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:18.473744 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c08e6b-b29b-499d-873e-d0b06d68aaa7 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:18.492077 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 85/182] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Nov 2 20:17:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 20:17:18.498399 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b655db4-a7ee-41e1-91b6-c775c821aae9 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:18.546570 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81de9df-1922-4d88-840a-88bba403309c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:18.547225 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81de9df-1922-4d88-840a-88bba403309c None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:18.547510 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81de9df-1922-4d88-840a-88bba403309c None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:18.547790 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81de9df-1922-4d88-840a-88bba403309c None admin] PATH_INFO: `/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:18.549575 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81de9df-1922-4d88-840a-88bba403309c None admin] RBAC: Authorizing `identity:get_project(project_id=99ca9e0a0fa1499f9f61aa0f83fd5d23)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:18.552327 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81de9df-1922-4d88-840a-88bba403309c None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:18.555673 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 98/183] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Nov 2 20:17:18 2022] GET /identity/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23 => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:18.564569 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81de9df-1922-4d88-840a-88bba403309c None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:18.627189 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:18.648315 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b655db4-a7ee-41e1-91b6-c775c821aae9 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:18.684591 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cefbe-57d9-42f8-99eb-9ecff058019c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:18.685207 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cefbe-57d9-42f8-99eb-9ecff058019c None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:18.685490 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cefbe-57d9-42f8-99eb-9ecff058019c None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:18.685765 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cefbe-57d9-42f8-99eb-9ecff058019c None admin] PATH_INFO: `/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:18.686967 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cefbe-57d9-42f8-99eb-9ecff058019c None admin] RBAC: Authorizing `identity:get_project(project_id=99ca9e0a0fa1499f9f61aa0f83fd5d23)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:18.688464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cefbe-57d9-42f8-99eb-9ecff058019c None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:18.690195 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 86/184] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Nov 2 20:17:18 2022] GET /identity/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:17:18.695932 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cefbe-57d9-42f8-99eb-9ecff058019c None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:18.717137 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:18.743989 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81de9df-1922-4d88-840a-88bba403309c None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:18.802409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cefbe-57d9-42f8-99eb-9ecff058019c None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:18.818281 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6d828-0571-41ea-a68a-a17d0c641297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:18.818904 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6d828-0571-41ea-a68a-a17d0c641297 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:18.819186 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6d828-0571-41ea-a68a-a17d0c641297 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:18.819463 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6d828-0571-41ea-a68a-a17d0c641297 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:18.820300 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6d828-0571-41ea-a68a-a17d0c641297 None admin] RBAC: Adding query filter params (role.id=bca2e686aa5e4fdc844fc679a4c41939, scope.project.id=99ca9e0a0fa1499f9f61aa0f83fd5d23, user.id=8e3cd42f82474d9d9cb54eb02c950dbd) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:18.820643 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6d828-0571-41ea-a68a-a17d0c641297 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:18.822746 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6d828-0571-41ea-a68a-a17d0c641297 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:18.839699 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 99/185] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Nov 2 20:17:18 2022] GET /identity/v3/role_assignments?user.id=8e3cd42f82474d9d9cb54eb02c950dbd&scope.project.id=99ca9e0a0fa1499f9f61aa0f83fd5d23&role.id=bca2e686aa5e4fdc844fc679a4c41939 => generated 608 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:17:18.842793 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa9f53-633f-4e8e-8963-41b7bd3ad640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:18.843425 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa9f53-633f-4e8e-8963-41b7bd3ad640 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:18.843709 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa9f53-633f-4e8e-8963-41b7bd3ad640 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:18.843987 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa9f53-633f-4e8e-8963-41b7bd3ad640 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:18.844768 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa9f53-633f-4e8e-8963-41b7bd3ad640 None admin] RBAC: Adding query filter params (role.id=c415cff16e364aa9a9d40b79936ab4a9, scope.project.id=99ca9e0a0fa1499f9f61aa0f83fd5d23, user.id=8e3cd42f82474d9d9cb54eb02c950dbd) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:18.845085 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa9f53-633f-4e8e-8963-41b7bd3ad640 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:18.846648 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa9f53-633f-4e8e-8963-41b7bd3ad640 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:18.854059 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 87/186] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Nov 2 20:17:18 2022] GET /identity/v3/role_assignments?user.id=8e3cd42f82474d9d9cb54eb02c950dbd&scope.project.id=99ca9e0a0fa1499f9f61aa0f83fd5d23&role.id=c415cff16e364aa9a9d40b79936ab4a9 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:17:19.447618 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e93ba-692f-4af8-9432-9b555afe24f5 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:19.448152 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e93ba-692f-4af8-9432-9b555afe24f5 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:19.448152 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e93ba-692f-4af8-9432-9b555afe24f5 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:19.449556 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 100/187] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:19.454617 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29e6b0-11c4-484a-8fce-91f9ac26815b None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:19.454989 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29e6b0-11c4-484a-8fce-91f9ac26815b None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:19.455173 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29e6b0-11c4-484a-8fce-91f9ac26815b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:19.472944 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-8c29e6b0-11c4-484a-8fce-91f9ac26815b None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:19.474134 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-8c29e6b0-11c4-484a-8fce-91f9ac26815b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:19.482303 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:19.548482 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 88/188] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:19.663600 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b8b4a-46b1-4e45-973e-813bc6bd9975 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:19.663902 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b8b4a-46b1-4e45-973e-813bc6bd9975 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:19.664163 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b8b4a-46b1-4e45-973e-813bc6bd9975 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:19.665704 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 101/189] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:19.670999 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a34e5-0ce9-4443-bfb9-4bbe4a47d9ed None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:19.671286 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a34e5-0ce9-4443-bfb9-4bbe4a47d9ed None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:19.671561 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a34e5-0ce9-4443-bfb9-4bbe4a47d9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:19.690264 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-6e2a34e5-0ce9-4443-bfb9-4bbe4a47d9ed None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:19.691423 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-6e2a34e5-0ce9-4443-bfb9-4bbe4a47d9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:19.757649 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 89/190] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:19.814822 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b8b4a-46b1-4e45-973e-813bc6bd9975 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:19.917849 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b8b4a-46b1-4e45-973e-813bc6bd9975 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:19.950785 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c06802-ad63-40e3-b286-d9a23fe2e308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:19.951418 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c06802-ad63-40e3-b286-d9a23fe2e308 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:19.951698 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c06802-ad63-40e3-b286-d9a23fe2e308 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:19.951974 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c06802-ad63-40e3-b286-d9a23fe2e308 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:19.962016 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c06802-ad63-40e3-b286-d9a23fe2e308 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:19.967821 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-43c06802-ad63-40e3-b286-d9a23fe2e308 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 20:17:19.967821 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:19.967821 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:19.967821 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:19.967821 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:19.967821 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:19.967821 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:19.967821 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:19.967821 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:19.967821 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:19.967821 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:19.967821 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:19.967821 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:19.967821 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:19.967821 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:19.967821 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:19.968681 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:19.968681 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:19.968681 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:19.968681 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:19.968681 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:19.968681 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:19.968681 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:19.968681 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:19.968681 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:19.968681 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:19.968681 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:19.968681 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:19.968681 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:19.968681 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:19.968681 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:19.968681 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:19.969450 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:19.969450 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:19.969450 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:19.969450 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:19.969450 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:19.969450 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:19.969450 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:19.969450 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:19.969450 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:19.969450 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:19.969450 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 20:17:19.969450 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:19.969450 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 102/191] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:17:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:19.974676 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a34e5-0ce9-4443-bfb9-4bbe4a47d9ed None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:20.028243 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c06802-ad63-40e3-b286-d9a23fe2e308 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:20.043599 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:20.046076 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:20.075427 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a34e5-0ce9-4443-bfb9-4bbe4a47d9ed None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:20.111491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5a3af-31da-45f8-8e15-3e2d1e2a8d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:20.112109 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5a3af-31da-45f8-8e15-3e2d1e2a8d34 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:20.112394 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5a3af-31da-45f8-8e15-3e2d1e2a8d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:20.112703 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5a3af-31da-45f8-8e15-3e2d1e2a8d34 None admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:20.113376 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5a3af-31da-45f8-8e15-3e2d1e2a8d34 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:20.113685 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5a3af-31da-45f8-8e15-3e2d1e2a8d34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:20.115064 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5a3af-31da-45f8-8e15-3e2d1e2a8d34 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:20.123151 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 90/192] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Nov 2 20:17:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:20.128721 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5a3af-31da-45f8-8e15-3e2d1e2a8d34 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:20.138932 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c06802-ad63-40e3-b286-d9a23fe2e308 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:20.174423 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d3ab6-6734-4e17-8aba-258aa8d82be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:20.175051 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d3ab6-6734-4e17-8aba-258aa8d82be2 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:20.175330 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d3ab6-6734-4e17-8aba-258aa8d82be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:20.175602 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d3ab6-6734-4e17-8aba-258aa8d82be2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:20.177133 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d3ab6-6734-4e17-8aba-258aa8d82be2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:20.178936 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d3ab6-6734-4e17-8aba-258aa8d82be2 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:20.180837 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 103/193] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:17:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:17:20.186879 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d3ab6-6734-4e17-8aba-258aa8d82be2 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:20.243158 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5a3af-31da-45f8-8e15-3e2d1e2a8d34 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:20.269417 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:20.279903 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d1ebd-c9c8-4abc-9165-af03c31430ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:20.280711 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d1ebd-c9c8-4abc-9165-af03c31430ac None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:20.281394 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d1ebd-c9c8-4abc-9165-af03c31430ac None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:20.281675 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d1ebd-c9c8-4abc-9165-af03c31430ac None admin] PATH_INFO: `/v3/users/93777b5b55bc46e2868772f8ef14b97b` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:20.284708 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:20.291727 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d3ab6-6734-4e17-8aba-258aa8d82be2 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:20.301357 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d1ebd-c9c8-4abc-9165-af03c31430ac None admin] RBAC: Authorizing `identity:get_user(user_id=93777b5b55bc46e2868772f8ef14b97b)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:20.302866 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d1ebd-c9c8-4abc-9165-af03c31430ac None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:20.304847 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 91/194] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:17:20 2022] GET /identity/v3/users/93777b5b55bc46e2868772f8ef14b97b => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:17:20.310992 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d1ebd-c9c8-4abc-9165-af03c31430ac None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:20.330309 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601499e-9a8b-4abf-8fdb-914253d6ea67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:20.330910 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601499e-9a8b-4abf-8fdb-914253d6ea67 None admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:20.331204 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601499e-9a8b-4abf-8fdb-914253d6ea67 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:20.331458 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601499e-9a8b-4abf-8fdb-914253d6ea67 None admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:20.332108 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601499e-9a8b-4abf-8fdb-914253d6ea67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:20.333580 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601499e-9a8b-4abf-8fdb-914253d6ea67 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:20.358465 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 104/195] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Nov 2 20:17:20 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:17:20.411719 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc70d6a-8cde-4a31-8f6d-2d10c68024c5 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:20.412693 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc70d6a-8cde-4a31-8f6d-2d10c68024c5 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:20.413005 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc70d6a-8cde-4a31-8f6d-2d10c68024c5 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:20.415262 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 105/196] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 20:17:20.421522 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23a4bf-c9a2-4d32-8653-361dbb29a513 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:20.421837 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23a4bf-c9a2-4d32-8653-361dbb29a513 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:20.422402 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23a4bf-c9a2-4d32-8653-361dbb29a513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:20.441706 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d1ebd-c9c8-4abc-9165-af03c31430ac None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:20.444969 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-7f23a4bf-c9a2-4d32-8653-361dbb29a513 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:20.445750 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-7f23a4bf-c9a2-4d32-8653-361dbb29a513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:20.479969 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d5f38-8314-4a37-9843-bbae5afab7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:20.480853 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d5f38-8314-4a37-9843-bbae5afab7d2 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:20.480948 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d5f38-8314-4a37-9843-bbae5afab7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:20.481209 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d5f38-8314-4a37-9843-bbae5afab7d2 None admin] PATH_INFO: `/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:20.482369 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d5f38-8314-4a37-9843-bbae5afab7d2 None admin] RBAC: Authorizing `identity:get_project(project_id=99ca9e0a0fa1499f9f61aa0f83fd5d23)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:20.483831 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d5f38-8314-4a37-9843-bbae5afab7d2 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:20.485741 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 92/197] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Nov 2 20:17:20 2022] GET /identity/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:20.491444 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d5f38-8314-4a37-9843-bbae5afab7d2 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:20.527149 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 106/198] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:20.567011 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:20.611440 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d5f38-8314-4a37-9843-bbae5afab7d2 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:20.646978 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946d92f-9ca0-4e6d-a649-050f81f9be6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:20.647736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946d92f-9ca0-4e6d-a649-050f81f9be6b None admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:20.648099 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946d92f-9ca0-4e6d-a649-050f81f9be6b None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:20.648430 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946d92f-9ca0-4e6d-a649-050f81f9be6b None admin] PATH_INFO: `/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23/users/93777b5b55bc46e2868772f8ef14b97b/roles/62bfa3f89b8f4618a7a6b1f8d628fd0f` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:20.651037 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946d92f-9ca0-4e6d-a649-050f81f9be6b None admin] RBAC: Authorizing `identity:create_grant(project_id=99ca9e0a0fa1499f9f61aa0f83fd5d23, user_id=93777b5b55bc46e2868772f8ef14b97b, role_id=62bfa3f89b8f4618a7a6b1f8d628fd0f)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:20.652537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946d92f-9ca0-4e6d-a649-050f81f9be6b None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:20.666858 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 93/199] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Nov 2 20:17:20 2022] PUT /identity/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23/users/93777b5b55bc46e2868772f8ef14b97b/roles/62bfa3f89b8f4618a7a6b1f8d628fd0f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:17:20.798724 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23a4bf-c9a2-4d32-8653-361dbb29a513 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:20.870805 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:20.908877 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23a4bf-c9a2-4d32-8653-361dbb29a513 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:20.944334 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e2bdd-fbcf-40de-9f86-434489d5003f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:20.945015 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e2bdd-fbcf-40de-9f86-434489d5003f None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:20.945298 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e2bdd-fbcf-40de-9f86-434489d5003f None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:20.945572 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e2bdd-fbcf-40de-9f86-434489d5003f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:20.956646 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e2bdd-fbcf-40de-9f86-434489d5003f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:20.961470 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-3b0e2bdd-fbcf-40de-9f86-434489d5003f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 20:17:20.961470 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:20.961470 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:20.961470 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:20.961470 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:20.961470 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:20.961470 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:20.961470 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:20.961470 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:20.961470 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:20.961470 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:20.961470 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:20.961470 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:20.961470 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:20.961470 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:20.961470 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:20.962337 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:20.962337 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:20.962337 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:20.962337 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:20.962337 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:20.962337 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:20.962337 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:20.962337 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:20.962337 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:20.962337 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:20.962337 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:20.962337 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:20.962337 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:20.962337 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:20.962337 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:20.962337 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:20.963368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:20.963368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:20.963368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:20.963368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:20.963368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:20.963368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:20.963368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:20.963368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:20.963368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:20.963368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:20.963368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 20:17:20.963368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:20.963368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 107/200] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:17:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:20.968888 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946d92f-9ca0-4e6d-a649-050f81f9be6b None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:21.072952 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946d92f-9ca0-4e6d-a649-050f81f9be6b None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:21.093517 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:21.110065 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98be7c1-2d79-4538-89c6-ce8bc51c4d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:21.110682 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98be7c1-2d79-4538-89c6-ce8bc51c4d35 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:21.110964 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98be7c1-2d79-4538-89c6-ce8bc51c4d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:21.111240 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98be7c1-2d79-4538-89c6-ce8bc51c4d35 None admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:21.111909 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98be7c1-2d79-4538-89c6-ce8bc51c4d35 None admin] RBAC: Adding query filter params (name=member) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:21.112216 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98be7c1-2d79-4538-89c6-ce8bc51c4d35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:21.113615 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98be7c1-2d79-4538-89c6-ce8bc51c4d35 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:21.122545 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 94/201] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Nov 2 20:17:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:21.127861 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e2bdd-fbcf-40de-9f86-434489d5003f None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:21.236260 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e2bdd-fbcf-40de-9f86-434489d5003f None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:21.265154 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:21.276835 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9846072-cfec-4533-b361-60ce6898eb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:21.277826 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9846072-cfec-4533-b361-60ce6898eb4b None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:21.278336 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9846072-cfec-4533-b361-60ce6898eb4b None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:21.278814 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9846072-cfec-4533-b361-60ce6898eb4b None admin] PATH_INFO: `/v3/users/6ae5c933fdc4473199bb84c66a5c6408` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:21.280219 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9846072-cfec-4533-b361-60ce6898eb4b None admin] RBAC: Authorizing `identity:get_user(user_id=6ae5c933fdc4473199bb84c66a5c6408)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:21.281944 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9846072-cfec-4533-b361-60ce6898eb4b None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:21.283797 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 108/202] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:17:21 2022] GET /identity/v3/users/6ae5c933fdc4473199bb84c66a5c6408 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:21.289649 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98be7c1-2d79-4538-89c6-ce8bc51c4d35 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:21.398352 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98be7c1-2d79-4538-89c6-ce8bc51c4d35 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:21.434440 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9aaae3-5778-4657-8448-eb407602a100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:21.435066 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9aaae3-5778-4657-8448-eb407602a100 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:21.435352 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9aaae3-5778-4657-8448-eb407602a100 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:21.435630 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9aaae3-5778-4657-8448-eb407602a100 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:21.492466 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:21.516221 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9aaae3-5778-4657-8448-eb407602a100 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:21.517848 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9aaae3-5778-4657-8448-eb407602a100 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:21.621379 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 95/203] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Nov 2 20:17:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 20:17:21.629624 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9846072-cfec-4533-b361-60ce6898eb4b None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:21.735830 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9846072-cfec-4533-b361-60ce6898eb4b None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:21.770512 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e28fa-c83d-442b-a338-6d953c054172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:21.771150 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e28fa-c83d-442b-a338-6d953c054172 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:21.771432 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e28fa-c83d-442b-a338-6d953c054172 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:21.771710 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e28fa-c83d-442b-a338-6d953c054172 None admin] PATH_INFO: `/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:21.772863 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e28fa-c83d-442b-a338-6d953c054172 None admin] RBAC: Authorizing `identity:get_project(project_id=99ca9e0a0fa1499f9f61aa0f83fd5d23)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:21.774328 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e28fa-c83d-442b-a338-6d953c054172 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:21.776286 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 109/204] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Nov 2 20:17:21 2022] GET /identity/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:21.782100 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9aaae3-5778-4657-8448-eb407602a100 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:21.869407 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:21.890363 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9aaae3-5778-4657-8448-eb407602a100 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:21.925941 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440c1d4-0428-4b99-a7e8-fd94afd2a4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:21.926559 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440c1d4-0428-4b99-a7e8-fd94afd2a4a4 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:21.926845 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440c1d4-0428-4b99-a7e8-fd94afd2a4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:21.927126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440c1d4-0428-4b99-a7e8-fd94afd2a4a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:21.927859 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440c1d4-0428-4b99-a7e8-fd94afd2a4a4 None admin] RBAC: Adding query filter params (role.id=a1e0072f698b484b8cde5a22e350c67d, scope.project.id=99ca9e0a0fa1499f9f61aa0f83fd5d23, user.id=6ae5c933fdc4473199bb84c66a5c6408) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:21.928185 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440c1d4-0428-4b99-a7e8-fd94afd2a4a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:21.929654 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440c1d4-0428-4b99-a7e8-fd94afd2a4a4 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:21.936306 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 96/205] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Nov 2 20:17:21 2022] GET /identity/v3/role_assignments?user.id=6ae5c933fdc4473199bb84c66a5c6408&scope.project.id=99ca9e0a0fa1499f9f61aa0f83fd5d23&role.id=a1e0072f698b484b8cde5a22e350c67d => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:22.722605 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec977595-4f54-456d-b8ae-e506566f3654 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:22.723105 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec977595-4f54-456d-b8ae-e506566f3654 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:22.723185 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec977595-4f54-456d-b8ae-e506566f3654 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:22.724504 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 110/206] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:22.729668 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3b337-f77c-43e8-b642-6fda9ab74049 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:22.730079 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3b337-f77c-43e8-b642-6fda9ab74049 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:22.730274 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3b337-f77c-43e8-b642-6fda9ab74049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:22.748701 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-e9a3b337-f77c-43e8-b642-6fda9ab74049 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:22.749878 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-e9a3b337-f77c-43e8-b642-6fda9ab74049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:22.797541 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8e55f-bd47-4971-9efc-a88f19268a04 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:22.797824 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8e55f-bd47-4971-9efc-a88f19268a04 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:22.798026 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8e55f-bd47-4971-9efc-a88f19268a04 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:22.799369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 111/207] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:22.804344 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861c009-73ff-417f-91e6-1539181edf2a None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:22.804667 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861c009-73ff-417f-91e6-1539181edf2a None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:22.804952 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861c009-73ff-417f-91e6-1539181edf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:22.816607 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 97/208] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:22.824564 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-f861c009-73ff-417f-91e6-1539181edf2a None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:22.826286 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-f861c009-73ff-417f-91e6-1539181edf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:22.890225 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:22.902587 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 112/209] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 20:17:22.978746 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae00ff5-1912-4887-9196-736470f93568 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:22.979030 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae00ff5-1912-4887-9196-736470f93568 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:22.979308 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae00ff5-1912-4887-9196-736470f93568 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:22.980868 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 98/210] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 20:17:22.985866 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b8df9-7cce-4c6a-818a-7bd0089b4b4a None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:22.986160 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b8df9-7cce-4c6a-818a-7bd0089b4b4a None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:22.986437 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b8df9-7cce-4c6a-818a-7bd0089b4b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:23.004506 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-5a0b8df9-7cce-4c6a-818a-7bd0089b4b4a None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:23.005703 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-5a0b8df9-7cce-4c6a-818a-7bd0089b4b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:23.072585 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 113/211] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:23.087650 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae00ff5-1912-4887-9196-736470f93568 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:23.164966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:23.174525 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b8df9-7cce-4c6a-818a-7bd0089b4b4a None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:23.198349 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae00ff5-1912-4887-9196-736470f93568 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:23.231908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae437f9-49cc-4496-a8cf-a4bb274b952b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:23.232535 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae437f9-49cc-4496-a8cf-a4bb274b952b None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:23.232840 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae437f9-49cc-4496-a8cf-a4bb274b952b None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:23.233112 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae437f9-49cc-4496-a8cf-a4bb274b952b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:23.234494 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae437f9-49cc-4496-a8cf-a4bb274b952b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:23.235917 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae437f9-49cc-4496-a8cf-a4bb274b952b None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:23.237676 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 99/212] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:17:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:23.242849 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae437f9-49cc-4496-a8cf-a4bb274b952b None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:23.288234 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b8df9-7cce-4c6a-818a-7bd0089b4b4a None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:23.311723 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:23.326622 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64e336-ab49-4e22-9b05-b692494cf85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:23.327179 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64e336-ab49-4e22-9b05-b692494cf85e None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:23.327456 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64e336-ab49-4e22-9b05-b692494cf85e None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:23.327723 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64e336-ab49-4e22-9b05-b692494cf85e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:23.339183 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64e336-ab49-4e22-9b05-b692494cf85e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:23.344063 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-dd64e336-ab49-4e22-9b05-b692494cf85e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 20:17:23.344063 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:23.344063 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:23.344063 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:23.344063 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:23.344063 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:23.344063 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:23.344063 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:23.344063 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:23.344063 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:23.344063 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:23.344063 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:23.344063 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:23.344063 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:23.344063 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:23.344063 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:23.345186 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:23.345186 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:23.345186 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:23.345186 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:23.345186 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:23.345186 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:23.345186 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:23.345186 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:23.345186 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:23.345186 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:23.345186 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:23.345186 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:23.345186 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:23.345186 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:23.345186 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:23.345186 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:23.345988 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:23.345988 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:23.345988 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:23.345988 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:23.345988 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:23.345988 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:23.345988 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:23.345988 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:23.345988 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:23.345988 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:23.345988 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 20:17:23.345988 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:23.345988 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 114/213] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:17:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 20:17:23.346630 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae437f9-49cc-4496-a8cf-a4bb274b952b None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:23.346710 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64e336-ab49-4e22-9b05-b692494cf85e None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:23.381663 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7aaaad-630a-496e-8c2c-07dfa4644ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:23.382272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7aaaad-630a-496e-8c2c-07dfa4644ee0 None admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:23.382553 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7aaaad-630a-496e-8c2c-07dfa4644ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:23.382830 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7aaaad-630a-496e-8c2c-07dfa4644ee0 None admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:23.383481 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7aaaad-630a-496e-8c2c-07dfa4644ee0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:23.384939 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7aaaad-630a-496e-8c2c-07dfa4644ee0 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:23.402547 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:23.415426 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 100/214] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Nov 2 20:17:23 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:17:23.415426 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7aaaad-630a-496e-8c2c-07dfa4644ee0 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:23.466434 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64e336-ab49-4e22-9b05-b692494cf85e None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:23.505779 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b8af7-398e-4dd5-8238-4376eca5c7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:23.506423 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b8af7-398e-4dd5-8238-4376eca5c7a4 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:23.506702 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b8af7-398e-4dd5-8238-4376eca5c7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:23.506975 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b8af7-398e-4dd5-8238-4376eca5c7a4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:23.520101 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b8af7-398e-4dd5-8238-4376eca5c7a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:23.525351 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-046b8af7-398e-4dd5-8238-4376eca5c7a4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 20:17:23.525351 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:23.525351 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:23.525351 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:23.525351 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:23.525351 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:23.525351 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:23.525351 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:23.525351 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:23.525351 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:23.525351 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:23.525351 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:23.525351 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:23.525351 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:23.525351 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:23.525351 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:23.526273 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:23.526273 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:23.526273 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:23.526273 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:23.526273 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:23.526273 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:23.526273 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:23.526273 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:23.526273 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:23.526273 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:23.526273 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:23.526273 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:23.526273 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:23.526273 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:23.526273 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:23.526273 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:23.527064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:23.527064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:23.527064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:23.527064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:23.527064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:23.527064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:23.527064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:23.527064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:23.527064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:23.527064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:23.527064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 20:17:23.527064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:23.527064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 115/215] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:17:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:23.532738 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b8af7-398e-4dd5-8238-4376eca5c7a4 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:23.536784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7aaaad-630a-496e-8c2c-07dfa4644ee0 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:23.576347 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c15c9d-7d83-45fa-a969-4fe2435b16de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:23.577437 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c15c9d-7d83-45fa-a969-4fe2435b16de None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:23.577651 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c15c9d-7d83-45fa-a969-4fe2435b16de None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:23.577930 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c15c9d-7d83-45fa-a969-4fe2435b16de None admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:23.578601 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c15c9d-7d83-45fa-a969-4fe2435b16de None admin] RBAC: Adding query filter params (name=member) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:23.578915 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c15c9d-7d83-45fa-a969-4fe2435b16de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:23.579961 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:23.580293 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c15c9d-7d83-45fa-a969-4fe2435b16de None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:23.592117 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 101/216] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Nov 2 20:17:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:23.596793 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c15c9d-7d83-45fa-a969-4fe2435b16de None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:23.647818 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b8af7-398e-4dd5-8238-4376eca5c7a4 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:23.668840 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:23.690231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774f91e-e95e-47f4-a27c-61d6c1f0eb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:23.690840 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774f91e-e95e-47f4-a27c-61d6c1f0eb5c None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:23.691120 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774f91e-e95e-47f4-a27c-61d6c1f0eb5c None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:23.691853 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774f91e-e95e-47f4-a27c-61d6c1f0eb5c None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:23.692541 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774f91e-e95e-47f4-a27c-61d6c1f0eb5c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:23.692901 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774f91e-e95e-47f4-a27c-61d6c1f0eb5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:23.694679 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d774f91e-e95e-47f4-a27c-61d6c1f0eb5c None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:23.704808 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 116/217] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Nov 2 20:17:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:17:23.713261 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774f91e-e95e-47f4-a27c-61d6c1f0eb5c None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:23.727681 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c15c9d-7d83-45fa-a969-4fe2435b16de None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:23.772391 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27958bca-3498-4fb1-ba6d-802ba1d399ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:23.773064 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27958bca-3498-4fb1-ba6d-802ba1d399ac None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:23.773342 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27958bca-3498-4fb1-ba6d-802ba1d399ac None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:23.773620 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27958bca-3498-4fb1-ba6d-802ba1d399ac None admin] PATH_INFO: `/v3/users/fd20177ccd554b7e9988e859156517e7` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:23.788278 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27958bca-3498-4fb1-ba6d-802ba1d399ac None admin] RBAC: Authorizing `identity:get_user(user_id=fd20177ccd554b7e9988e859156517e7)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:23.789960 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27958bca-3498-4fb1-ba6d-802ba1d399ac None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:23.792253 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 102/218] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:17:23 2022] GET /identity/v3/users/fd20177ccd554b7e9988e859156517e7 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:17:23.801566 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27958bca-3498-4fb1-ba6d-802ba1d399ac None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:23.829135 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774f91e-e95e-47f4-a27c-61d6c1f0eb5c None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:23.832904 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:23.864946 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff89efd-0586-4e89-b7b5-7c7a9fc6a54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:23.865684 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff89efd-0586-4e89-b7b5-7c7a9fc6a54a None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:23.866128 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff89efd-0586-4e89-b7b5-7c7a9fc6a54a None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:23.866366 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff89efd-0586-4e89-b7b5-7c7a9fc6a54a None admin] PATH_INFO: `/v3/users/93777b5b55bc46e2868772f8ef14b97b` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:23.867676 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff89efd-0586-4e89-b7b5-7c7a9fc6a54a None admin] RBAC: Authorizing `identity:get_user(user_id=93777b5b55bc46e2868772f8ef14b97b)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:23.869301 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff89efd-0586-4e89-b7b5-7c7a9fc6a54a None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:23.871309 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 117/219] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:17:23 2022] GET /identity/v3/users/93777b5b55bc46e2868772f8ef14b97b => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:17:23.877455 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff89efd-0586-4e89-b7b5-7c7a9fc6a54a None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:23.935022 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27958bca-3498-4fb1-ba6d-802ba1d399ac None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:23.957104 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:23.973231 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3f874-8576-4d3b-baf3-b70a7a1ad1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:23.973891 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3f874-8576-4d3b-baf3-b70a7a1ad1a1 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:23.974174 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3f874-8576-4d3b-baf3-b70a7a1ad1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:23.974449 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3f874-8576-4d3b-baf3-b70a7a1ad1a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:23.975429 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3f874-8576-4d3b-baf3-b70a7a1ad1a1 None admin] RBAC: Adding query filter params (role.id=a1e0072f698b484b8cde5a22e350c67d, user.id=fd20177ccd554b7e9988e859156517e7, scope.system=all) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:23.975537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3f874-8576-4d3b-baf3-b70a7a1ad1a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:23.976996 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3f874-8576-4d3b-baf3-b70a7a1ad1a1 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:23.988363 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 103/220] 10.222.0.23 () {56 vars in 1308 bytes} [Wed Nov 2 20:17:23 2022] GET /identity/v3/role_assignments?user.id=fd20177ccd554b7e9988e859156517e7&scope.system=all&role.id=a1e0072f698b484b8cde5a22e350c67d => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:24.014765 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff89efd-0586-4e89-b7b5-7c7a9fc6a54a None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:24.053921 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb43be0-9dd2-4813-9be2-4b4dc34387da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:24.054931 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb43be0-9dd2-4813-9be2-4b4dc34387da None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:24.055411 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb43be0-9dd2-4813-9be2-4b4dc34387da None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:24.055879 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb43be0-9dd2-4813-9be2-4b4dc34387da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:24.105141 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:24.136876 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb43be0-9dd2-4813-9be2-4b4dc34387da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:24.138810 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb43be0-9dd2-4813-9be2-4b4dc34387da None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:24.245696 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 118/221] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Nov 2 20:17:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 20:17:24.251571 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3f874-8576-4d3b-baf3-b70a7a1ad1a1 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:24.356473 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3f874-8576-4d3b-baf3-b70a7a1ad1a1 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:24.393791 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6139bfa0-2932-4f88-9cb3-b7bf5b80c94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:24.394769 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139bfa0-2932-4f88-9cb3-b7bf5b80c94c None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:24.395270 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139bfa0-2932-4f88-9cb3-b7bf5b80c94c None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:24.395736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139bfa0-2932-4f88-9cb3-b7bf5b80c94c None admin] PATH_INFO: `/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:24.397091 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6139bfa0-2932-4f88-9cb3-b7bf5b80c94c None admin] RBAC: Authorizing `identity:get_project(project_id=99ca9e0a0fa1499f9f61aa0f83fd5d23)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:24.398860 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6139bfa0-2932-4f88-9cb3-b7bf5b80c94c None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:24.400838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 104/222] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Nov 2 20:17:24 2022] GET /identity/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:24.406951 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb43be0-9dd2-4813-9be2-4b4dc34387da None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:24.482250 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:24.519805 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb43be0-9dd2-4813-9be2-4b4dc34387da None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:24.554816 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a12e90-d768-4556-868e-e8b9e01e5bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:24.555451 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a12e90-d768-4556-868e-e8b9e01e5bcc None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:24.555738 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a12e90-d768-4556-868e-e8b9e01e5bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:24.556061 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a12e90-d768-4556-868e-e8b9e01e5bcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:24.556822 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a12e90-d768-4556-868e-e8b9e01e5bcc None admin] RBAC: Adding query filter params (role.id=62bfa3f89b8f4618a7a6b1f8d628fd0f, scope.project.id=99ca9e0a0fa1499f9f61aa0f83fd5d23, user.id=93777b5b55bc46e2868772f8ef14b97b) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:24.557140 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a12e90-d768-4556-868e-e8b9e01e5bcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:24.558841 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a12e90-d768-4556-868e-e8b9e01e5bcc None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:24.564578 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 119/223] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Nov 2 20:17:24 2022] GET /identity/v3/role_assignments?user.id=93777b5b55bc46e2868772f8ef14b97b&scope.project.id=99ca9e0a0fa1499f9f61aa0f83fd5d23&role.id=62bfa3f89b8f4618a7a6b1f8d628fd0f => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:25.764968 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500f22c-06c3-4419-9b20-a63791c9eb33 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:25.765501 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500f22c-06c3-4419-9b20-a63791c9eb33 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:25.765501 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500f22c-06c3-4419-9b20-a63791c9eb33 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:25.766889 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 105/224] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:25.772337 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f5edb-4fc9-43b7-a55a-86420c8cb85a None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:25.772743 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf782143-fa2e-4f12-8fa2-e4ac78d263dc None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:25.772834 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f5edb-4fc9-43b7-a55a-86420c8cb85a None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:25.772905 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf782143-fa2e-4f12-8fa2-e4ac78d263dc None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:25.772971 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f5edb-4fc9-43b7-a55a-86420c8cb85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:25.773036 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf782143-fa2e-4f12-8fa2-e4ac78d263dc None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:25.774148 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 106/225] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 20:17:25.779439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666a9e9-6796-4264-a7ce-5be37f248f67 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:25.780000 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666a9e9-6796-4264-a7ce-5be37f248f67 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:25.780283 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666a9e9-6796-4264-a7ce-5be37f248f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:25.791788 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-928f5edb-4fc9-43b7-a55a-86420c8cb85a None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:25.793001 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-928f5edb-4fc9-43b7-a55a-86420c8cb85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:25.800333 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-a666a9e9-6796-4264-a7ce-5be37f248f67 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:25.801795 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-a666a9e9-6796-4264-a7ce-5be37f248f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:25.853201 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:25.864226 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 120/226] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:25.875088 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 107/227] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 20:17:26.131002 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f5edb-4fc9-43b7-a55a-86420c8cb85a None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:26.144384 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666a9e9-6796-4264-a7ce-5be37f248f67 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:26.197779 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:26.233326 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f5edb-4fc9-43b7-a55a-86420c8cb85a None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:26.247400 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666a9e9-6796-4264-a7ce-5be37f248f67 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:26.267073 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c206e5-6a4b-47ab-b77e-95d8daa89186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:26.267709 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c206e5-6a4b-47ab-b77e-95d8daa89186 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:26.267988 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c206e5-6a4b-47ab-b77e-95d8daa89186 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:26.268262 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c206e5-6a4b-47ab-b77e-95d8daa89186 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:26.269389 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c206e5-6a4b-47ab-b77e-95d8daa89186 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:26.270836 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c206e5-6a4b-47ab-b77e-95d8daa89186 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:26.272396 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 121/228] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:17:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:26.273612 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f465d4-13ea-4e96-a923-85fdfc14d43e None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:26.273790 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f465d4-13ea-4e96-a923-85fdfc14d43e None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:26.274068 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f465d4-13ea-4e96-a923-85fdfc14d43e None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:26.275953 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 122/229] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:26.278728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f465d4-13ea-4e96-a923-85fdfc14d43e None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:26.283704 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0be3a3-7586-424c-964e-487b24605a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:26.284338 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0be3a3-7586-424c-964e-487b24605a7d None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:26.284654 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0be3a3-7586-424c-964e-487b24605a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:26.284936 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0be3a3-7586-424c-964e-487b24605a7d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:26.295064 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0be3a3-7586-424c-964e-487b24605a7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:26.299931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-8f0be3a3-7586-424c-964e-487b24605a7d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 20:17:26.299931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:26.299931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:26.299931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:26.299931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:26.299931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:26.299931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:26.299931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:26.299931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:26.299931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:26.299931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:26.299931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:26.299931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:26.299931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:26.299931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:26.299931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:26.300950 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:26.300950 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:26.300950 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:26.300950 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:26.300950 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:26.300950 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:26.300950 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:26.300950 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:26.300950 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:26.300950 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:26.300950 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:26.300950 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:26.300950 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:26.300950 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:26.300950 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:26.300950 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:26.302538 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:26.302538 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:26.302538 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:26.302538 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:26.302538 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:26.302538 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:26.302538 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:26.302538 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:26.302538 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:26.302538 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:26.302538 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 20:17:26.302538 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:26.302538 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 108/230] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:17:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:26.304765 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd721876-e402-40bf-a921-d5f008f9683a None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:26.305213 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd721876-e402-40bf-a921-d5f008f9683a None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:26.305481 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd721876-e402-40bf-a921-d5f008f9683a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:26.323421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-bd721876-e402-40bf-a921-d5f008f9683a None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:26.324625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-bd721876-e402-40bf-a921-d5f008f9683a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:26.359817 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:26.381835 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f465d4-13ea-4e96-a923-85fdfc14d43e None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:26.390760 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 109/231] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:26.391577 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd721876-e402-40bf-a921-d5f008f9683a None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:26.430659 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f709c17-4f6f-4c71-8e8b-571aeb657594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:26.431814 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f709c17-4f6f-4c71-8e8b-571aeb657594 None admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:26.432080 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f709c17-4f6f-4c71-8e8b-571aeb657594 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:26.432356 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f709c17-4f6f-4c71-8e8b-571aeb657594 None admin] PATH_INFO: `/v3/groups` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:26.433376 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f709c17-4f6f-4c71-8e8b-571aeb657594 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:26.434821 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f709c17-4f6f-4c71-8e8b-571aeb657594 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:26.439237 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:26.453432 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 123/232] 10.222.0.23 () {60 vars in 1134 bytes} [Wed Nov 2 20:17:26 2022] POST /identity/v3/groups => generated 229 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:17:26.499405 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd721876-e402-40bf-a921-d5f008f9683a None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:26.543481 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cd106-a1ad-4b20-8d42-1b777f94d500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:26.544118 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cd106-a1ad-4b20-8d42-1b777f94d500 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:26.544397 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cd106-a1ad-4b20-8d42-1b777f94d500 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:26.544756 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cd106-a1ad-4b20-8d42-1b777f94d500 None admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:26.545448 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cd106-a1ad-4b20-8d42-1b777f94d500 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:26.545756 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cd106-a1ad-4b20-8d42-1b777f94d500 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:26.547141 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cd106-a1ad-4b20-8d42-1b777f94d500 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:26.557841 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 110/233] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Nov 2 20:17:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:26.563430 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f709c17-4f6f-4c71-8e8b-571aeb657594 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:26.663249 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cd106-a1ad-4b20-8d42-1b777f94d500 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:26.673433 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f709c17-4f6f-4c71-8e8b-571aeb657594 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:26.702156 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:26.708806 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd13ad3-f37a-47de-85c7-40dd15111006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:26.709439 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd13ad3-f37a-47de-85c7-40dd15111006 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:26.709717 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd13ad3-f37a-47de-85c7-40dd15111006 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:26.709995 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd13ad3-f37a-47de-85c7-40dd15111006 None admin] PATH_INFO: `/v3/users/af164902d0074b84b8f898560279b5b7` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:26.724004 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd13ad3-f37a-47de-85c7-40dd15111006 None admin] RBAC: Authorizing `identity:get_user(user_id=af164902d0074b84b8f898560279b5b7)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:26.725498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd13ad3-f37a-47de-85c7-40dd15111006 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:26.727128 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 124/234] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:17:26 2022] GET /identity/v3/users/af164902d0074b84b8f898560279b5b7 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:26.732972 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd13ad3-f37a-47de-85c7-40dd15111006 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:26.785908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cd106-a1ad-4b20-8d42-1b777f94d500 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:26.787226 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:26.823276 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ce5a0-2f70-48c4-9563-9fc8edb0d8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:26.823902 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ce5a0-2f70-48c4-9563-9fc8edb0d8b1 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:26.824182 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ce5a0-2f70-48c4-9563-9fc8edb0d8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:26.824455 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ce5a0-2f70-48c4-9563-9fc8edb0d8b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:26.834609 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ce5a0-2f70-48c4-9563-9fc8edb0d8b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:26.838213 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd13ad3-f37a-47de-85c7-40dd15111006 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:26.839613 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-3f6ce5a0-2f70-48c4-9563-9fc8edb0d8b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 20:17:26.839613 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:26.839613 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:26.839613 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:26.839613 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:26.839613 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:26.839613 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:26.839613 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:26.839613 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:26.839613 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:26.839613 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:26.839613 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:26.839613 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:26.839613 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:26.839613 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:26.839613 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:26.840716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:26.840716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:26.840716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:26.840716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:26.840716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:26.840716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:26.840716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:26.840716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:26.840716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:26.840716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:26.840716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:26.840716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:26.840716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:26.840716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:26.840716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:26.840716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:26.841850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:26.841850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:26.841850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:26.841850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:26.841850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:26.841850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:26.841850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:26.841850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:26.841850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:26.841850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:26.841850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 20:17:26.841850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:26.841850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 111/235] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:17:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 20:17:26.846298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ce5a0-2f70-48c4-9563-9fc8edb0d8b1 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:26.877353 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7fdd5-4544-4e90-9a1a-c36a5f14410a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:26.877952 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7fdd5-4544-4e90-9a1a-c36a5f14410a None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:26.878231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7fdd5-4544-4e90-9a1a-c36a5f14410a None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:26.878506 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7fdd5-4544-4e90-9a1a-c36a5f14410a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:26.879223 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7fdd5-4544-4e90-9a1a-c36a5f14410a None admin] RBAC: Adding query filter params (role.id=62bfa3f89b8f4618a7a6b1f8d628fd0f, user.id=af164902d0074b84b8f898560279b5b7, scope.system=all) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:26.879519 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7fdd5-4544-4e90-9a1a-c36a5f14410a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:26.881054 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7fdd5-4544-4e90-9a1a-c36a5f14410a None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:26.886748 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 125/236] 10.222.0.23 () {56 vars in 1308 bytes} [Wed Nov 2 20:17:26 2022] GET /identity/v3/role_assignments?user.id=af164902d0074b84b8f898560279b5b7&scope.system=all&role.id=62bfa3f89b8f4618a7a6b1f8d628fd0f => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:17:26.948241 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:26.958472 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ce5a0-2f70-48c4-9563-9fc8edb0d8b1 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:26.995474 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f433308-0248-4699-8937-13347d538d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:26.996095 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f433308-0248-4699-8937-13347d538d8d None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:26.996373 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f433308-0248-4699-8937-13347d538d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:26.996674 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f433308-0248-4699-8937-13347d538d8d None admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:26.997358 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f433308-0248-4699-8937-13347d538d8d None admin] RBAC: Adding query filter params (name=member) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:26.997663 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f433308-0248-4699-8937-13347d538d8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:26.999046 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f433308-0248-4699-8937-13347d538d8d None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:27.008233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 112/237] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Nov 2 20:17:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:17:27.013818 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7fdd5-4544-4e90-9a1a-c36a5f14410a None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:27.119992 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7fdd5-4544-4e90-9a1a-c36a5f14410a None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:27.137705 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:27.160564 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d8f36-c812-430d-ab56-8b7870960bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:27.161250 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d8f36-c812-430d-ab56-8b7870960bae None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:27.161530 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d8f36-c812-430d-ab56-8b7870960bae None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:27.161802 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d8f36-c812-430d-ab56-8b7870960bae None admin] PATH_INFO: `/v3/users/fd20177ccd554b7e9988e859156517e7` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:27.162969 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d8f36-c812-430d-ab56-8b7870960bae None admin] RBAC: Authorizing `identity:get_user(user_id=fd20177ccd554b7e9988e859156517e7)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:27.164423 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d8f36-c812-430d-ab56-8b7870960bae None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:27.167235 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 126/238] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:17:27 2022] GET /identity/v3/users/fd20177ccd554b7e9988e859156517e7 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:27.171819 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f433308-0248-4699-8937-13347d538d8d None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:27.272619 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f433308-0248-4699-8937-13347d538d8d None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:27.305356 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397886a8-c162-4b3a-989d-f937c6ab9546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:27.306525 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397886a8-c162-4b3a-989d-f937c6ab9546 None admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:27.306806 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397886a8-c162-4b3a-989d-f937c6ab9546 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:27.307080 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397886a8-c162-4b3a-989d-f937c6ab9546 None admin] PATH_INFO: `/v3/system/users/fd20177ccd554b7e9988e859156517e7/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:27.308753 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397886a8-c162-4b3a-989d-f937c6ab9546 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fd20177ccd554b7e9988e859156517e7, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:27.310121 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397886a8-c162-4b3a-989d-f937c6ab9546 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:27.319908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 113/239] 10.222.0.23 () {58 vars in 1334 bytes} [Wed Nov 2 20:17:27 2022] PUT /identity/v3/system/users/fd20177ccd554b7e9988e859156517e7/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:17:28.642089 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba64b74-a6de-44f0-bca4-d4a68b642123 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:28.642594 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba64b74-a6de-44f0-bca4-d4a68b642123 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:28.642697 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba64b74-a6de-44f0-bca4-d4a68b642123 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:28.644062 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 127/240] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:28.649340 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22778501-7342-4a59-a69b-6248cc7ffdf7 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:28.649771 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22778501-7342-4a59-a69b-6248cc7ffdf7 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:28.649959 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22778501-7342-4a59-a69b-6248cc7ffdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:28.668106 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-22778501-7342-4a59-a69b-6248cc7ffdf7 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:28.669335 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-22778501-7342-4a59-a69b-6248cc7ffdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:28.685051 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:28.739677 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 114/241] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:29.003985 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba64b74-a6de-44f0-bca4-d4a68b642123 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:29.031986 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c79722-3ab4-4371-95b4-7fd2064b3f99 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:29.032332 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c79722-3ab4-4371-95b4-7fd2064b3f99 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:29.032570 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c79722-3ab4-4371-95b4-7fd2064b3f99 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:29.034065 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 115/242] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:29.038768 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0834d03-df42-479e-acba-71974938ec7d None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:29.039058 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0834d03-df42-479e-acba-71974938ec7d None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:29.039339 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0834d03-df42-479e-acba-71974938ec7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:29.058908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-b0834d03-df42-479e-acba-71974938ec7d None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:29.060080 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-b0834d03-df42-479e-acba-71974938ec7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:29.112933 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba64b74-a6de-44f0-bca4-d4a68b642123 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:29.128628 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 116/243] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 20:17:29.147674 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e6b7d-60a8-40c8-aa3a-bcb64d98b0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:29.148333 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e6b7d-60a8-40c8-aa3a-bcb64d98b0cd None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:29.148642 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e6b7d-60a8-40c8-aa3a-bcb64d98b0cd None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:29.148920 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e6b7d-60a8-40c8-aa3a-bcb64d98b0cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:29.150038 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e6b7d-60a8-40c8-aa3a-bcb64d98b0cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:29.151495 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e6b7d-60a8-40c8-aa3a-bcb64d98b0cd None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:29.153273 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 128/244] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:17:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:29.158557 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0834d03-df42-479e-acba-71974938ec7d None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:29.239755 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:29.260410 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0834d03-df42-479e-acba-71974938ec7d None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:29.293658 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5afdb-0d83-4e97-8272-3f01ed26369d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:29.294270 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5afdb-0d83-4e97-8272-3f01ed26369d None admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:29.294553 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5afdb-0d83-4e97-8272-3f01ed26369d None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:29.294832 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5afdb-0d83-4e97-8272-3f01ed26369d None admin] PATH_INFO: `/v3/groups` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:29.295466 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5afdb-0d83-4e97-8272-3f01ed26369d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:29.296925 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5afdb-0d83-4e97-8272-3f01ed26369d None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:29.312704 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 117/245] 10.222.0.23 () {60 vars in 1134 bytes} [Wed Nov 2 20:17:29 2022] POST /identity/v3/groups => generated 226 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:17:29.398847 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e6b7d-60a8-40c8-aa3a-bcb64d98b0cd None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:29.444118 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78697240-97d7-469c-ab46-3ca63227d734 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:29.444450 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78697240-97d7-469c-ab46-3ca63227d734 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:29.444838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78697240-97d7-469c-ab46-3ca63227d734 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:29.446243 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 118/246] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 20:17:29.452017 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c073e9c-70dc-4b82-ba31-7286ce00cd6b None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:29.452602 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c073e9c-70dc-4b82-ba31-7286ce00cd6b None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:29.453051 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c073e9c-70dc-4b82-ba31-7286ce00cd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:29.461489 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:29.472506 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-1c073e9c-70dc-4b82-ba31-7286ce00cd6b None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:29.473770 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-1c073e9c-70dc-4b82-ba31-7286ce00cd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:29.519648 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e6b7d-60a8-40c8-aa3a-bcb64d98b0cd None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:29.551180 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 119/247] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 20:17:29.558860 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db6c83-d959-4319-9322-49247c2ce877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:29.559753 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db6c83-d959-4319-9322-49247c2ce877 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:29.560036 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db6c83-d959-4319-9322-49247c2ce877 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:29.560312 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db6c83-d959-4319-9322-49247c2ce877 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:29.570519 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db6c83-d959-4319-9322-49247c2ce877 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:29.575484 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-c7db6c83-d959-4319-9322-49247c2ce877 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 20:17:29.575484 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:29.575484 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:29.575484 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:29.575484 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:29.575484 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:29.575484 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:29.575484 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:29.575484 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:29.575484 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:29.575484 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:29.575484 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:29.575484 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:29.575484 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:29.575484 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:29.575484 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:29.576343 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:29.576343 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:29.576343 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:29.576343 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:29.576343 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:29.576343 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:29.576343 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:29.576343 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:29.576343 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:29.576343 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:29.576343 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:29.576343 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:29.576343 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:29.576343 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:29.576343 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:29.576343 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:29.577169 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:29.577169 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:29.577169 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:29.577169 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:29.577169 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:29.577169 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:29.577169 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:29.577169 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:29.577169 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:29.577169 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:29.577169 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 20:17:29.577169 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:29.577169 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 129/248] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:17:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:29.584209 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c073e9c-70dc-4b82-ba31-7286ce00cd6b None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:29.657567 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:29.690813 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c073e9c-70dc-4b82-ba31-7286ce00cd6b None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:29.725324 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d7697-a292-4de5-9f0c-b6926f6694c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:29.725939 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d7697-a292-4de5-9f0c-b6926f6694c9 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:29.726228 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d7697-a292-4de5-9f0c-b6926f6694c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:29.726502 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d7697-a292-4de5-9f0c-b6926f6694c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:29.727175 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d7697-a292-4de5-9f0c-b6926f6694c9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:29.727480 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d7697-a292-4de5-9f0c-b6926f6694c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:29.728956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d7697-a292-4de5-9f0c-b6926f6694c9 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:29.739413 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 120/249] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Nov 2 20:17:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:29.745446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db6c83-d959-4319-9322-49247c2ce877 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:29.823153 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d7697-a292-4de5-9f0c-b6926f6694c9 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:29.855527 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db6c83-d959-4319-9322-49247c2ce877 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:29.872472 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:29.896422 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da8675-9d15-4f57-94bf-fbd7bea3ef87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:29.897093 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da8675-9d15-4f57-94bf-fbd7bea3ef87 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:29.897376 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da8675-9d15-4f57-94bf-fbd7bea3ef87 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:29.897655 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da8675-9d15-4f57-94bf-fbd7bea3ef87 None admin] PATH_INFO: `/v3/users/af164902d0074b84b8f898560279b5b7` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:29.899273 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da8675-9d15-4f57-94bf-fbd7bea3ef87 None admin] RBAC: Authorizing `identity:get_user(user_id=af164902d0074b84b8f898560279b5b7)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:29.901131 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da8675-9d15-4f57-94bf-fbd7bea3ef87 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:29.903762 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 130/250] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:17:29 2022] GET /identity/v3/users/af164902d0074b84b8f898560279b5b7 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:29.909704 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da8675-9d15-4f57-94bf-fbd7bea3ef87 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:29.955386 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d7697-a292-4de5-9f0c-b6926f6694c9 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:29.992097 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:29.999190 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f88aad-1778-4d2f-aef2-1f0e72d24d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:30.000130 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f88aad-1778-4d2f-aef2-1f0e72d24d3d None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:30.000639 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f88aad-1778-4d2f-aef2-1f0e72d24d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:30.001106 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f88aad-1778-4d2f-aef2-1f0e72d24d3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:30.013005 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f88aad-1778-4d2f-aef2-1f0e72d24d3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:30.018733 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-64f88aad-1778-4d2f-aef2-1f0e72d24d3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 20:17:30.018733 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:30.018733 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:30.018733 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:30.018733 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:30.018733 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:30.018733 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:30.018733 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:30.018733 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:30.018733 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:30.018733 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:30.018733 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:30.018733 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:30.018733 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:30.018733 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:30.018733 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:30.019563 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:30.019563 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:30.019563 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:30.019563 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:30.019563 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:30.019563 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:30.019563 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:30.019563 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:30.019563 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:30.019563 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:30.019563 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:30.019563 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:30.019563 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:30.019563 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:30.019563 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:30.019563 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:30.020333 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:30.020333 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:30.020333 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:30.020333 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:30.020333 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:30.020333 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:30.020333 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:30.020333 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:30.020333 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:30.020333 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:30.020333 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 20:17:30.020333 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:30.022887 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 121/251] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:17:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:30.028948 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f88aad-1778-4d2f-aef2-1f0e72d24d3d None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:30.041329 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da8675-9d15-4f57-94bf-fbd7bea3ef87 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:30.095492 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8569d2d-47c5-4653-88d6-96911c63daaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:30.096081 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8569d2d-47c5-4653-88d6-96911c63daaf None admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:30.096359 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8569d2d-47c5-4653-88d6-96911c63daaf None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:30.096660 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8569d2d-47c5-4653-88d6-96911c63daaf None admin] PATH_INFO: `/v3/system/users/af164902d0074b84b8f898560279b5b7/roles/62bfa3f89b8f4618a7a6b1f8d628fd0f` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:30.098147 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8569d2d-47c5-4653-88d6-96911c63daaf None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=af164902d0074b84b8f898560279b5b7, role_id=62bfa3f89b8f4618a7a6b1f8d628fd0f)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:30.099550 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8569d2d-47c5-4653-88d6-96911c63daaf None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:30.115539 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 131/252] 10.222.0.23 () {58 vars in 1334 bytes} [Wed Nov 2 20:17:29 2022] PUT /identity/v3/system/users/af164902d0074b84b8f898560279b5b7/roles/62bfa3f89b8f4618a7a6b1f8d628fd0f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:17:30.154487 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f88aad-1778-4d2f-aef2-1f0e72d24d3d None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:30.194236 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ebd32-2c01-41c7-b01e-4e16fe08f10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:30.195268 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ebd32-2c01-41c7-b01e-4e16fe08f10a None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:30.195743 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ebd32-2c01-41c7-b01e-4e16fe08f10a None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:30.196205 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ebd32-2c01-41c7-b01e-4e16fe08f10a None admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:30.197201 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ebd32-2c01-41c7-b01e-4e16fe08f10a None admin] RBAC: Adding query filter params (name=member) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:30.197733 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ebd32-2c01-41c7-b01e-4e16fe08f10a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:30.199376 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ebd32-2c01-41c7-b01e-4e16fe08f10a None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:30.209864 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 122/253] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Nov 2 20:17:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:30.216634 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8569d2d-47c5-4653-88d6-96911c63daaf None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:30.284032 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:30.363455 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8569d2d-47c5-4653-88d6-96911c63daaf None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:30.405504 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96de69a-65ac-47af-bf5e-245dc0414056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:30.406145 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96de69a-65ac-47af-bf5e-245dc0414056 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:30.406430 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96de69a-65ac-47af-bf5e-245dc0414056 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:30.406710 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96de69a-65ac-47af-bf5e-245dc0414056 None admin] PATH_INFO: `/v3/users/fd20177ccd554b7e9988e859156517e7` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:30.407926 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96de69a-65ac-47af-bf5e-245dc0414056 None admin] RBAC: Authorizing `identity:get_user(user_id=fd20177ccd554b7e9988e859156517e7)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:30.409477 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96de69a-65ac-47af-bf5e-245dc0414056 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:30.411401 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 132/254] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:17:30 2022] GET /identity/v3/users/fd20177ccd554b7e9988e859156517e7 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:30.417093 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ebd32-2c01-41c7-b01e-4e16fe08f10a None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:30.498245 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:30.553165 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ebd32-2c01-41c7-b01e-4e16fe08f10a None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:30.589623 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76f447-ef3a-451d-946a-1f5ec0c6a160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:30.590237 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76f447-ef3a-451d-946a-1f5ec0c6a160 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:30.590560 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76f447-ef3a-451d-946a-1f5ec0c6a160 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:30.590838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76f447-ef3a-451d-946a-1f5ec0c6a160 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:30.591569 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76f447-ef3a-451d-946a-1f5ec0c6a160 None admin] RBAC: Adding query filter params (role.id=a1e0072f698b484b8cde5a22e350c67d, user.id=fd20177ccd554b7e9988e859156517e7, scope.system=all) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:30.591880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76f447-ef3a-451d-946a-1f5ec0c6a160 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:30.593334 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76f447-ef3a-451d-946a-1f5ec0c6a160 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:30.608453 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 123/255] 10.222.0.23 () {56 vars in 1308 bytes} [Wed Nov 2 20:17:30 2022] GET /identity/v3/role_assignments?user.id=fd20177ccd554b7e9988e859156517e7&scope.system=all&role.id=a1e0072f698b484b8cde5a22e350c67d => generated 510 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:31.795668 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f48ff5-fb4f-41e9-9bb6-76e84eaaf31f None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:31.796157 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f48ff5-fb4f-41e9-9bb6-76e84eaaf31f None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:31.796157 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f48ff5-fb4f-41e9-9bb6-76e84eaaf31f None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:31.797748 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 133/256] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:31.803939 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8239ce0-d3cf-496c-acc2-fcc8c43ffbff None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:31.804809 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8239ce0-d3cf-496c-acc2-fcc8c43ffbff None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:31.805279 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8239ce0-d3cf-496c-acc2-fcc8c43ffbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:31.829074 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-d8239ce0-d3cf-496c-acc2-fcc8c43ffbff None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:31.830591 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-d8239ce0-d3cf-496c-acc2-fcc8c43ffbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:31.909585 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 124/257] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 20:17:32.337672 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825c36a-3d5d-4da1-933e-089dc541807b None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:32.338073 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825c36a-3d5d-4da1-933e-089dc541807b None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:32.338273 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825c36a-3d5d-4da1-933e-089dc541807b None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:32.339884 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 134/258] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:32.344765 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1082469-4996-4042-bc25-0bb3cacd5185 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:32.345058 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1082469-4996-4042-bc25-0bb3cacd5185 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:32.345341 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1082469-4996-4042-bc25-0bb3cacd5185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:32.369015 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-a1082469-4996-4042-bc25-0bb3cacd5185 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:32.370199 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-a1082469-4996-4042-bc25-0bb3cacd5185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:32.379758 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 125/259] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 20:17:32.417094 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825c36a-3d5d-4da1-933e-089dc541807b None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:32.435392 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825c36a-3d5d-4da1-933e-089dc541807b None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:32.441098 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc3f98-4151-41cb-a165-d19198111dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:32.441727 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc3f98-4151-41cb-a165-d19198111dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:32.442007 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc3f98-4151-41cb-a165-d19198111dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:32.442279 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc3f98-4151-41cb-a165-d19198111dd8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:32.465480 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc3f98-4151-41cb-a165-d19198111dd8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:32.470661 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-eacc3f98-4151-41cb-a165-d19198111dd8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 20:17:32.470661 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:32.470661 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:32.470661 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:32.470661 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:32.470661 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:32.470661 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:32.470661 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:32.470661 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:32.470661 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:32.470661 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:32.470661 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:32.470661 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:32.470661 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:32.470661 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:32.470661 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:32.471516 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:32.471516 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:32.471516 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:32.471516 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:32.471516 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:32.471516 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:32.471516 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:32.471516 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:32.471516 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:32.471516 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:32.471516 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:32.471516 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:32.471516 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:32.471516 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:32.471516 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:32.471516 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:32.472305 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:32.472305 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:32.472305 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:32.472305 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:32.472305 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:32.472305 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:32.472305 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:32.472305 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:32.472305 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:32.472305 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:32.472305 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 20:17:32.472305 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:32.472305 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 135/260] 10.222.0.23 () {56 vars in 1120 bytes} [Wed Nov 2 20:17:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:32.477533 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1082469-4996-4042-bc25-0bb3cacd5185 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:32.487993 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1082469-4996-4042-bc25-0bb3cacd5185 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:32.492864 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967253f-c7b3-4826-a159-9b16e19224a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:32.493996 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967253f-c7b3-4826-a159-9b16e19224a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:32.494275 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967253f-c7b3-4826-a159-9b16e19224a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:32.494546 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967253f-c7b3-4826-a159-9b16e19224a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:32.495223 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967253f-c7b3-4826-a159-9b16e19224a4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:32.495526 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967253f-c7b3-4826-a159-9b16e19224a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:32.497303 dv-cinder-862365-5-smb devstack@keystone.service[81403]: WARNING py.warnings [None req-3967253f-c7b3-4826-a159-9b16e19224a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 20:17:32.497303 dv-cinder-862365-5-smb devstack@keystone.service[81403]: warnings.warn(msg) Nov 02 20:17:32.497303 dv-cinder-862365-5-smb devstack@keystone.service[81403]: Nov 02 20:17:32.498202 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967253f-c7b3-4826-a159-9b16e19224a4 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:32.510613 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 126/261] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Nov 2 20:17:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:32.520989 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc3f98-4151-41cb-a165-d19198111dd8 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:32.534984 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc3f98-4151-41cb-a165-d19198111dd8 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:32.543441 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58508f76-320e-4b78-a217-4957176c0180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:32.544075 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58508f76-320e-4b78-a217-4957176c0180 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:32.544353 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58508f76-320e-4b78-a217-4957176c0180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:32.544662 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58508f76-320e-4b78-a217-4957176c0180 admin admin] PATH_INFO: `/v3/groups/60df22a9303e4cd2a41b59c517fb9ef0` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:32.554825 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58508f76-320e-4b78-a217-4957176c0180 admin admin] RBAC: Authorizing `identity:get_group(group_id=60df22a9303e4cd2a41b59c517fb9ef0)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:32.557205 dv-cinder-862365-5-smb devstack@keystone.service[81402]: WARNING py.warnings [None req-58508f76-320e-4b78-a217-4957176c0180 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 20:17:32.557205 dv-cinder-862365-5-smb devstack@keystone.service[81402]: warnings.warn(msg) Nov 02 20:17:32.557205 dv-cinder-862365-5-smb devstack@keystone.service[81402]: Nov 02 20:17:32.558678 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58508f76-320e-4b78-a217-4957176c0180 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:32.560323 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 136/262] 10.222.0.23 () {56 vars in 1201 bytes} [Wed Nov 2 20:17:32 2022] GET /identity/v3/groups/60df22a9303e4cd2a41b59c517fb9ef0 => generated 226 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:32.565733 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967253f-c7b3-4826-a159-9b16e19224a4 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:32.581641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967253f-c7b3-4826-a159-9b16e19224a4 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:32.586182 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5b214-02dd-4bd5-8567-c739141fc8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:32.586816 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5b214-02dd-4bd5-8567-c739141fc8ed admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:32.587615 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5b214-02dd-4bd5-8567-c739141fc8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:32.587948 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5b214-02dd-4bd5-8567-c739141fc8ed admin admin] PATH_INFO: `/v3/projects/54309652841a4da99a2089119546ac6d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:32.593231 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5b214-02dd-4bd5-8567-c739141fc8ed admin admin] RBAC: Authorizing `identity:get_project(project_id=54309652841a4da99a2089119546ac6d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:32.595302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5b214-02dd-4bd5-8567-c739141fc8ed admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:32.596989 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 127/263] 10.222.0.23 () {56 vars in 1207 bytes} [Wed Nov 2 20:17:32 2022] GET /identity/v3/projects/54309652841a4da99a2089119546ac6d => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:32.602571 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58508f76-320e-4b78-a217-4957176c0180 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:32.617594 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58508f76-320e-4b78-a217-4957176c0180 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:32.625112 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7462f9-a9aa-448a-8d4c-1ec746706973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:32.625770 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7462f9-a9aa-448a-8d4c-1ec746706973 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:32.626050 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7462f9-a9aa-448a-8d4c-1ec746706973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:32.626326 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7462f9-a9aa-448a-8d4c-1ec746706973 admin admin] PATH_INFO: `/v3/projects/54309652841a4da99a2089119546ac6d/groups/60df22a9303e4cd2a41b59c517fb9ef0/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:32.628228 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7462f9-a9aa-448a-8d4c-1ec746706973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54309652841a4da99a2089119546ac6d, group_id=60df22a9303e4cd2a41b59c517fb9ef0, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:32.629288 dv-cinder-862365-5-smb devstack@keystone.service[81402]: WARNING py.warnings [None req-7a7462f9-a9aa-448a-8d4c-1ec746706973 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 20:17:32.629288 dv-cinder-862365-5-smb devstack@keystone.service[81402]: warnings.warn(msg) Nov 02 20:17:32.629288 dv-cinder-862365-5-smb devstack@keystone.service[81402]: Nov 02 20:17:32.631237 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7462f9-a9aa-448a-8d4c-1ec746706973 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:32.654291 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 137/264] 10.222.0.23 () {58 vars in 1463 bytes} [Wed Nov 2 20:17:32 2022] PUT /identity/v3/projects/54309652841a4da99a2089119546ac6d/groups/60df22a9303e4cd2a41b59c517fb9ef0/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:17:32.797061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5b214-02dd-4bd5-8567-c739141fc8ed admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:32.810462 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5b214-02dd-4bd5-8567-c739141fc8ed admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:32.867498 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:32.893259 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64358e5b-210c-4e4c-a060-c5079df95d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:32.893909 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64358e5b-210c-4e4c-a060-c5079df95d72 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:32.894190 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64358e5b-210c-4e4c-a060-c5079df95d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:32.894464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64358e5b-210c-4e4c-a060-c5079df95d72 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:32.905250 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64358e5b-210c-4e4c-a060-c5079df95d72 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:32.910514 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-64358e5b-210c-4e4c-a060-c5079df95d72 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 20:17:32.910514 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:32.910514 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:32.910514 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:32.910514 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:32.910514 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:32.910514 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:32.910514 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:32.910514 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:32.910514 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:32.910514 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:32.910514 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:32.910514 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:32.910514 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:32.910514 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:32.910514 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:32.911379 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:32.911379 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:32.911379 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:32.911379 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:32.911379 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:32.911379 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:32.911379 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:32.911379 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:32.911379 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:32.911379 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:32.911379 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:32.911379 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:32.911379 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:32.911379 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:32.911379 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:32.911379 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:32.912185 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:32.912185 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:32.912185 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:32.912185 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:32.912185 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:32.912185 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:32.912185 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:32.912185 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:32.912185 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:32.912185 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:32.912185 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 20:17:32.912185 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:32.912185 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 128/265] 10.222.0.23 () {56 vars in 1135 bytes} [Wed Nov 2 20:17:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:32.919365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7462f9-a9aa-448a-8d4c-1ec746706973 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:32.929618 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7462f9-a9aa-448a-8d4c-1ec746706973 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:32.936196 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68149022-6532-42d3-bfde-62700420c13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:32.936833 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68149022-6532-42d3-bfde-62700420c13d admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:32.937114 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68149022-6532-42d3-bfde-62700420c13d admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:32.937389 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68149022-6532-42d3-bfde-62700420c13d admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:32.938059 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68149022-6532-42d3-bfde-62700420c13d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:32.938360 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68149022-6532-42d3-bfde-62700420c13d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:32.939367 dv-cinder-862365-5-smb devstack@keystone.service[81402]: WARNING py.warnings [None req-68149022-6532-42d3-bfde-62700420c13d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 20:17:32.939367 dv-cinder-862365-5-smb devstack@keystone.service[81402]: warnings.warn(msg) Nov 02 20:17:32.939367 dv-cinder-862365-5-smb devstack@keystone.service[81402]: Nov 02 20:17:32.940259 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68149022-6532-42d3-bfde-62700420c13d admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:32.951148 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 138/266] 10.222.0.23 () {56 vars in 1132 bytes} [Wed Nov 2 20:17:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:32.956724 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64358e5b-210c-4e4c-a060-c5079df95d72 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:32.969662 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64358e5b-210c-4e4c-a060-c5079df95d72 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:32.977191 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62458f8b-f72f-4fd7-992e-8259992cfd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:32.978364 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62458f8b-f72f-4fd7-992e-8259992cfd8f admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:32.978645 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62458f8b-f72f-4fd7-992e-8259992cfd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:32.978920 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62458f8b-f72f-4fd7-992e-8259992cfd8f admin admin] PATH_INFO: `/v3/groups/60df22a9303e4cd2a41b59c517fb9ef0` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:32.980081 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62458f8b-f72f-4fd7-992e-8259992cfd8f admin admin] RBAC: Authorizing `identity:get_group(group_id=60df22a9303e4cd2a41b59c517fb9ef0)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:32.981126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: WARNING py.warnings [None req-62458f8b-f72f-4fd7-992e-8259992cfd8f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 20:17:32.981126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: warnings.warn(msg) Nov 02 20:17:32.981126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: Nov 02 20:17:32.982346 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62458f8b-f72f-4fd7-992e-8259992cfd8f admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:32.984250 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 129/267] 10.222.0.23 () {56 vars in 1201 bytes} [Wed Nov 2 20:17:32 2022] GET /identity/v3/groups/60df22a9303e4cd2a41b59c517fb9ef0 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:32.989804 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68149022-6532-42d3-bfde-62700420c13d admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:32.999828 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68149022-6532-42d3-bfde-62700420c13d admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:33.005253 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100efe93-fd5f-4781-9c02-a284f36a632a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:33.005882 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100efe93-fd5f-4781-9c02-a284f36a632a admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:33.006159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100efe93-fd5f-4781-9c02-a284f36a632a admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:33.006432 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100efe93-fd5f-4781-9c02-a284f36a632a admin admin] PATH_INFO: `/v3/projects/54309652841a4da99a2089119546ac6d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:33.007549 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100efe93-fd5f-4781-9c02-a284f36a632a admin admin] RBAC: Authorizing `identity:get_project(project_id=54309652841a4da99a2089119546ac6d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:33.010207 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100efe93-fd5f-4781-9c02-a284f36a632a admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:33.016497 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 139/268] 10.222.0.23 () {56 vars in 1207 bytes} [Wed Nov 2 20:17:32 2022] GET /identity/v3/projects/54309652841a4da99a2089119546ac6d => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:33.017930 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62458f8b-f72f-4fd7-992e-8259992cfd8f admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:33.027839 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62458f8b-f72f-4fd7-992e-8259992cfd8f admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:33.032351 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ba06c-7741-4181-8b5a-73c200b32e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:33.033087 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ba06c-7741-4181-8b5a-73c200b32e7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:33.033367 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ba06c-7741-4181-8b5a-73c200b32e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:33.033645 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ba06c-7741-4181-8b5a-73c200b32e7e admin admin] PATH_INFO: `/v3/projects/54309652841a4da99a2089119546ac6d/groups/60df22a9303e4cd2a41b59c517fb9ef0/roles/c415cff16e364aa9a9d40b79936ab4a9` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:33.035843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ba06c-7741-4181-8b5a-73c200b32e7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=54309652841a4da99a2089119546ac6d, group_id=60df22a9303e4cd2a41b59c517fb9ef0, role_id=c415cff16e364aa9a9d40b79936ab4a9)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:33.036976 dv-cinder-862365-5-smb devstack@keystone.service[81403]: WARNING py.warnings [None req-c40ba06c-7741-4181-8b5a-73c200b32e7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 20:17:33.036976 dv-cinder-862365-5-smb devstack@keystone.service[81403]: warnings.warn(msg) Nov 02 20:17:33.036976 dv-cinder-862365-5-smb devstack@keystone.service[81403]: Nov 02 20:17:33.038989 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ba06c-7741-4181-8b5a-73c200b32e7e admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:33.056799 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 130/269] 10.222.0.23 () {58 vars in 1463 bytes} [Wed Nov 2 20:17:33 2022] PUT /identity/v3/projects/54309652841a4da99a2089119546ac6d/groups/60df22a9303e4cd2a41b59c517fb9ef0/roles/c415cff16e364aa9a9d40b79936ab4a9 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:17:33.401385 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6fb18-2d14-436e-83fa-9859f246f7ce None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:33.402099 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6fb18-2d14-436e-83fa-9859f246f7ce None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:33.402593 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6fb18-2d14-436e-83fa-9859f246f7ce None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:33.404418 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 140/270] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:33.409622 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266387a-e980-4f93-b5c2-0f9f978b7b30 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:33.410174 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266387a-e980-4f93-b5c2-0f9f978b7b30 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:33.410673 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266387a-e980-4f93-b5c2-0f9f978b7b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:33.436987 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-d266387a-e980-4f93-b5c2-0f9f978b7b30 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:33.438493 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-d266387a-e980-4f93-b5c2-0f9f978b7b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:33.531126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 131/271] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:33.538239 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5f8d3-bd08-4dcb-a9d7-8defd5dcaddd None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:33.538804 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5f8d3-bd08-4dcb-a9d7-8defd5dcaddd None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:33.539297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5f8d3-bd08-4dcb-a9d7-8defd5dcaddd None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:33.541413 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 141/272] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:33.547904 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37022e6-e15e-4f53-bdc4-8d53a0f7d309 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:33.548444 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37022e6-e15e-4f53-bdc4-8d53a0f7d309 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:33.548989 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37022e6-e15e-4f53-bdc4-8d53a0f7d309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:33.569778 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-c37022e6-e15e-4f53-bdc4-8d53a0f7d309 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:33.571299 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-c37022e6-e15e-4f53-bdc4-8d53a0f7d309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:33.641450 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 132/273] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 20:17:33.950218 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5f8d3-bd08-4dcb-a9d7-8defd5dcaddd None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:33.965793 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5f8d3-bd08-4dcb-a9d7-8defd5dcaddd None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:33.970695 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a5a6c-e63a-4b0c-9d0c-6f42d0b58027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:33.971654 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a5a6c-e63a-4b0c-9d0c-6f42d0b58027 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:33.972147 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a5a6c-e63a-4b0c-9d0c-6f42d0b58027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:33.972687 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a5a6c-e63a-4b0c-9d0c-6f42d0b58027 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:33.985676 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a5a6c-e63a-4b0c-9d0c-6f42d0b58027 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:33.991340 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-ea9a5a6c-e63a-4b0c-9d0c-6f42d0b58027 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 20:17:33.991340 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:33.991340 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:33.991340 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:33.991340 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:33.991340 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:33.991340 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:33.991340 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:33.991340 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:33.991340 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:33.991340 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:33.991340 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:33.991340 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:33.991340 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:33.991340 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:33.991340 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:33.992221 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:33.992221 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:33.992221 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:33.992221 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:33.992221 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:33.992221 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:33.992221 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:33.992221 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:33.992221 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:33.992221 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:33.992221 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:33.992221 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:33.992221 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:33.992221 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:33.992221 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:33.992221 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:33.993036 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:33.993036 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:33.993036 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:33.993036 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:33.993036 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:33.993036 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:33.993036 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:33.993036 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:33.993036 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:33.993036 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:33.993036 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 20:17:33.993036 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:33.996238 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 142/274] 10.222.0.23 () {56 vars in 1120 bytes} [Wed Nov 2 20:17:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:34.002433 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37022e6-e15e-4f53-bdc4-8d53a0f7d309 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:34.003119 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a5a6c-e63a-4b0c-9d0c-6f42d0b58027 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:34.018702 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37022e6-e15e-4f53-bdc4-8d53a0f7d309 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:34.034916 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab40ab-11d8-4de0-b8c8-cbaa3e931691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:34.035546 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab40ab-11d8-4de0-b8c8-cbaa3e931691 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:34.036863 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab40ab-11d8-4de0-b8c8-cbaa3e931691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:34.037149 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab40ab-11d8-4de0-b8c8-cbaa3e931691 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:34.037865 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab40ab-11d8-4de0-b8c8-cbaa3e931691 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:34.038181 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab40ab-11d8-4de0-b8c8-cbaa3e931691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:34.045401 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab40ab-11d8-4de0-b8c8-cbaa3e931691 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:34.069272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 133/275] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Nov 2 20:17:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:34.083229 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab40ab-11d8-4de0-b8c8-cbaa3e931691 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:34.103944 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab40ab-11d8-4de0-b8c8-cbaa3e931691 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:34.115388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6a319-942c-43fa-b900-629da7da8afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:34.116041 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6a319-942c-43fa-b900-629da7da8afe admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:34.116323 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6a319-942c-43fa-b900-629da7da8afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:34.119360 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6a319-942c-43fa-b900-629da7da8afe admin admin] PATH_INFO: `/v3/groups/60df22a9303e4cd2a41b59c517fb9ef0` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:34.122075 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6a319-942c-43fa-b900-629da7da8afe admin admin] RBAC: Authorizing `identity:get_group(group_id=60df22a9303e4cd2a41b59c517fb9ef0)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:34.124024 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6a319-942c-43fa-b900-629da7da8afe admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:34.134100 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 134/276] 10.222.0.23 () {56 vars in 1201 bytes} [Wed Nov 2 20:17:34 2022] GET /identity/v3/groups/60df22a9303e4cd2a41b59c517fb9ef0 => generated 226 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:34.140434 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:34.147400 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6a319-942c-43fa-b900-629da7da8afe admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:34.163376 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6a319-942c-43fa-b900-629da7da8afe admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:34.175736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6944e-ec72-4cd3-b37d-433a20262755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:34.177376 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6944e-ec72-4cd3-b37d-433a20262755 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:34.177869 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6944e-ec72-4cd3-b37d-433a20262755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:34.178366 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6944e-ec72-4cd3-b37d-433a20262755 admin admin] PATH_INFO: `/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:34.181220 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6944e-ec72-4cd3-b37d-433a20262755 admin admin] RBAC: Authorizing `identity:get_project(project_id=99ca9e0a0fa1499f9f61aa0f83fd5d23)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:34.186258 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6944e-ec72-4cd3-b37d-433a20262755 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:34.190782 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 135/277] 10.222.0.23 () {56 vars in 1207 bytes} [Wed Nov 2 20:17:34 2022] GET /identity/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:17:34.192276 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e308788-d35f-4b85-ba22-45743e887eeb None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:34.197900 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e308788-d35f-4b85-ba22-45743e887eeb None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:34.199265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e308788-d35f-4b85-ba22-45743e887eeb None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:34.201163 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 136/278] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:34 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:34.206661 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c49b4-a0f8-4ea0-a97d-333777aa2cb7 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:34.207196 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c49b4-a0f8-4ea0-a97d-333777aa2cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:34.207736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c49b4-a0f8-4ea0-a97d-333777aa2cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:34.238532 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a5a6c-e63a-4b0c-9d0c-6f42d0b58027 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:34.253515 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-2c0c49b4-a0f8-4ea0-a97d-333777aa2cb7 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:34.255197 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-2c0c49b4-a0f8-4ea0-a97d-333777aa2cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:34.277463 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 137/279] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 20:17:34.278677 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c49b4-a0f8-4ea0-a97d-333777aa2cb7 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:34.303883 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c49b4-a0f8-4ea0-a97d-333777aa2cb7 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:34.314808 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47884f-9008-4d8f-b3bc-ffd82b926638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:34.316338 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47884f-9008-4d8f-b3bc-ffd82b926638 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:34.321327 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47884f-9008-4d8f-b3bc-ffd82b926638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:34.323139 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47884f-9008-4d8f-b3bc-ffd82b926638 admin admin] PATH_INFO: `/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23/groups/60df22a9303e4cd2a41b59c517fb9ef0/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:34.324965 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128f1fd-3772-4205-8e04-22c68e52d3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:34.325828 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128f1fd-3772-4205-8e04-22c68e52d3cc None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:34.326873 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128f1fd-3772-4205-8e04-22c68e52d3cc None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:34.327903 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128f1fd-3772-4205-8e04-22c68e52d3cc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:34.328428 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47884f-9008-4d8f-b3bc-ffd82b926638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99ca9e0a0fa1499f9f61aa0f83fd5d23, group_id=60df22a9303e4cd2a41b59c517fb9ef0, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:34.334435 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47884f-9008-4d8f-b3bc-ffd82b926638 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:34.362083 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 138/280] 10.222.0.23 () {58 vars in 1463 bytes} [Wed Nov 2 20:17:34 2022] PUT /identity/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23/groups/60df22a9303e4cd2a41b59c517fb9ef0/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:17:34.363052 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128f1fd-3772-4205-8e04-22c68e52d3cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:34.369041 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-5128f1fd-3772-4205-8e04-22c68e52d3cc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 20:17:34.369041 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:34.369041 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:34.369041 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:34.369041 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:34.369041 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:34.369041 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:34.369041 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:34.369041 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:34.369041 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:34.369041 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:34.369041 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:34.369041 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:34.369041 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:34.369041 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:34.369041 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:34.370034 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:34.370034 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:34.370034 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:34.370034 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:34.370034 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:34.370034 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:34.370034 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:34.370034 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:34.370034 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:34.370034 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:34.370034 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:34.370034 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:34.370034 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:34.370034 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:34.370034 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:34.370034 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:34.370831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:34.370831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:34.370831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:34.370831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:34.370831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:34.370831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:34.370831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:34.370831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:34.370831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:34.370831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:34.370831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 20:17:34.370831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:34.377831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 143/281] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:17:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 20:17:34.383479 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47884f-9008-4d8f-b3bc-ffd82b926638 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:34.387297 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:34.536294 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47884f-9008-4d8f-b3bc-ffd82b926638 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:34.574773 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ee384-c5f4-4dcb-8f67-251b424c38bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:34.575791 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ee384-c5f4-4dcb-8f67-251b424c38bf None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:34.576287 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ee384-c5f4-4dcb-8f67-251b424c38bf None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:34.576791 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ee384-c5f4-4dcb-8f67-251b424c38bf None admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:34.577751 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ee384-c5f4-4dcb-8f67-251b424c38bf None admin] RBAC: Adding query filter params (name=reader) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:34.578261 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ee384-c5f4-4dcb-8f67-251b424c38bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:34.579850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ee384-c5f4-4dcb-8f67-251b424c38bf None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:34.589441 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 139/282] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Nov 2 20:17:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:34.597856 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128f1fd-3772-4205-8e04-22c68e52d3cc None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:34.736029 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128f1fd-3772-4205-8e04-22c68e52d3cc None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:34.750993 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:34.774620 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c092b26-4d5c-417c-9827-7101e4fdad18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:34.775185 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c092b26-4d5c-417c-9827-7101e4fdad18 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:34.775462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c092b26-4d5c-417c-9827-7101e4fdad18 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:34.775735 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c092b26-4d5c-417c-9827-7101e4fdad18 None admin] PATH_INFO: `/v3/users/af164902d0074b84b8f898560279b5b7` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:34.776917 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c092b26-4d5c-417c-9827-7101e4fdad18 None admin] RBAC: Authorizing `identity:get_user(user_id=af164902d0074b84b8f898560279b5b7)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:34.778378 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c092b26-4d5c-417c-9827-7101e4fdad18 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:34.782329 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 144/283] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:17:34 2022] GET /identity/v3/users/af164902d0074b84b8f898560279b5b7 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:34.787262 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ee384-c5f4-4dcb-8f67-251b424c38bf None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:34.838066 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c092b26-4d5c-417c-9827-7101e4fdad18 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:34.928240 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:34.979200 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c092b26-4d5c-417c-9827-7101e4fdad18 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:34.987818 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e04e5-2a2a-4579-b9bc-aba0b39fdef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:34.988469 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e04e5-2a2a-4579-b9bc-aba0b39fdef8 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:34.988797 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e04e5-2a2a-4579-b9bc-aba0b39fdef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:34.989075 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e04e5-2a2a-4579-b9bc-aba0b39fdef8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:35.015054 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ee384-c5f4-4dcb-8f67-251b424c38bf None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:35.019910 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e04e5-2a2a-4579-b9bc-aba0b39fdef8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:35.025422 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-296e04e5-2a2a-4579-b9bc-aba0b39fdef8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 20:17:35.025422 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:35.025422 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:35.025422 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:35.025422 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:35.025422 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:35.025422 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:35.025422 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:35.025422 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:35.025422 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:35.025422 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:35.025422 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:35.025422 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:35.025422 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:35.025422 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:35.025422 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:35.026279 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:35.026279 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:35.026279 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:35.026279 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:35.026279 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:35.026279 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:35.026279 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:35.026279 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:35.026279 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:35.026279 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:35.026279 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:35.026279 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:35.026279 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:35.026279 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:35.026279 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:35.026279 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:35.027426 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:35.027426 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:35.027426 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:35.027426 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:35.027426 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:35.027426 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:35.027426 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:35.027426 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:35.027426 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:35.027426 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:35.027426 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 20:17:35.027426 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:35.027426 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 145/284] 10.222.0.23 () {56 vars in 1135 bytes} [Wed Nov 2 20:17:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 20:17:35.033368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c945089-a042-4e0a-ba44-c359df6163fb None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:35.033672 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c945089-a042-4e0a-ba44-c359df6163fb None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:35.036878 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c945089-a042-4e0a-ba44-c359df6163fb None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:35.039354 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 146/285] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:35 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:35.040660 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c945089-a042-4e0a-ba44-c359df6163fb None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:35.074047 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c945089-a042-4e0a-ba44-c359df6163fb None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:35.081229 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1151083-21e7-4680-a7a4-120871bd6ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:35.082306 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1151083-21e7-4680-a7a4-120871bd6ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:35.082729 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1151083-21e7-4680-a7a4-120871bd6ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:35.083013 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1151083-21e7-4680-a7a4-120871bd6ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:35.083750 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1151083-21e7-4680-a7a4-120871bd6ad3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:35.084062 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1151083-21e7-4680-a7a4-120871bd6ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:35.085844 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1151083-21e7-4680-a7a4-120871bd6ad3 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:35.103869 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 147/286] 10.222.0.23 () {56 vars in 1132 bytes} [Wed Nov 2 20:17:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:35.105056 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccae84-f266-4d01-9ba9-e06d7bab9fdd None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:35.105498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccae84-f266-4d01-9ba9-e06d7bab9fdd None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:35.105877 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccae84-f266-4d01-9ba9-e06d7bab9fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:35.113262 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5c0af-4175-4dfd-9b1e-797c693d4680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:35.113886 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5c0af-4175-4dfd-9b1e-797c693d4680 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:35.114165 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5c0af-4175-4dfd-9b1e-797c693d4680 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:35.114446 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5c0af-4175-4dfd-9b1e-797c693d4680 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:35.115176 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5c0af-4175-4dfd-9b1e-797c693d4680 None admin] RBAC: Adding query filter params (role.id=62bfa3f89b8f4618a7a6b1f8d628fd0f, user.id=af164902d0074b84b8f898560279b5b7, scope.system=all) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:35.115493 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5c0af-4175-4dfd-9b1e-797c693d4680 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:35.117006 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5c0af-4175-4dfd-9b1e-797c693d4680 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:35.131804 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-beccae84-f266-4d01-9ba9-e06d7bab9fdd None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:35.133341 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-beccae84-f266-4d01-9ba9-e06d7bab9fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:35.134647 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 140/287] 10.222.0.23 () {56 vars in 1308 bytes} [Wed Nov 2 20:17:34 2022] GET /identity/v3/role_assignments?user.id=af164902d0074b84b8f898560279b5b7&scope.system=all&role.id=62bfa3f89b8f4618a7a6b1f8d628fd0f => generated 510 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:35.135495 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5c0af-4175-4dfd-9b1e-797c693d4680 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:35.142135 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 148/288] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 20:17:35.157502 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5c0af-4175-4dfd-9b1e-797c693d4680 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:35.173427 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083f229-17b3-4e9e-b280-aa798402e543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:35.174103 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083f229-17b3-4e9e-b280-aa798402e543 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:35.174393 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083f229-17b3-4e9e-b280-aa798402e543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:35.174669 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083f229-17b3-4e9e-b280-aa798402e543 admin admin] PATH_INFO: `/v3/groups/60df22a9303e4cd2a41b59c517fb9ef0` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:35.175913 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083f229-17b3-4e9e-b280-aa798402e543 admin admin] RBAC: Authorizing `identity:get_group(group_id=60df22a9303e4cd2a41b59c517fb9ef0)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:35.177843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083f229-17b3-4e9e-b280-aa798402e543 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:35.179416 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 141/289] 10.222.0.23 () {56 vars in 1201 bytes} [Wed Nov 2 20:17:35 2022] GET /identity/v3/groups/60df22a9303e4cd2a41b59c517fb9ef0 => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:35.185808 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beccae84-f266-4d01-9ba9-e06d7bab9fdd None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:35.200829 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beccae84-f266-4d01-9ba9-e06d7bab9fdd None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:35.210590 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c2bb8-aa9c-48e5-927f-8e5bed5305c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:35.211257 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c2bb8-aa9c-48e5-927f-8e5bed5305c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:35.211539 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c2bb8-aa9c-48e5-927f-8e5bed5305c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:35.211818 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c2bb8-aa9c-48e5-927f-8e5bed5305c4 admin admin] PATH_INFO: `/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:35.217458 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c2bb8-aa9c-48e5-927f-8e5bed5305c4 admin admin] RBAC: Authorizing `identity:get_project(project_id=99ca9e0a0fa1499f9f61aa0f83fd5d23)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:35.219786 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c2bb8-aa9c-48e5-927f-8e5bed5305c4 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:35.221641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 149/290] 10.222.0.23 () {56 vars in 1207 bytes} [Wed Nov 2 20:17:35 2022] GET /identity/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23 => generated 302 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:35.227283 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083f229-17b3-4e9e-b280-aa798402e543 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:35.242295 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083f229-17b3-4e9e-b280-aa798402e543 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:35.252969 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa578e-e4f6-46e9-a359-faea7be77edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:35.253658 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa578e-e4f6-46e9-a359-faea7be77edf admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:35.253929 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa578e-e4f6-46e9-a359-faea7be77edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:35.254203 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa578e-e4f6-46e9-a359-faea7be77edf admin admin] PATH_INFO: `/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23/groups/60df22a9303e4cd2a41b59c517fb9ef0/roles/c415cff16e364aa9a9d40b79936ab4a9` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:35.262339 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa578e-e4f6-46e9-a359-faea7be77edf admin admin] RBAC: Authorizing `identity:create_grant(project_id=99ca9e0a0fa1499f9f61aa0f83fd5d23, group_id=60df22a9303e4cd2a41b59c517fb9ef0, role_id=c415cff16e364aa9a9d40b79936ab4a9)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:35.265015 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa578e-e4f6-46e9-a359-faea7be77edf admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:35.282288 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 142/291] 10.222.0.23 () {58 vars in 1463 bytes} [Wed Nov 2 20:17:35 2022] PUT /identity/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23/groups/60df22a9303e4cd2a41b59c517fb9ef0/roles/c415cff16e364aa9a9d40b79936ab4a9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:17:35.694261 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c2bb8-aa9c-48e5-927f-8e5bed5305c4 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:35.705406 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c2bb8-aa9c-48e5-927f-8e5bed5305c4 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:35.783340 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3893cd-c770-45d2-afc9-21f403e706a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:35.784322 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3893cd-c770-45d2-afc9-21f403e706a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:35.784833 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3893cd-c770-45d2-afc9-21f403e706a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:35.785315 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3893cd-c770-45d2-afc9-21f403e706a9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:35.798676 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3893cd-c770-45d2-afc9-21f403e706a9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:35.804269 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-6b3893cd-c770-45d2-afc9-21f403e706a9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:17:35.804269 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:35.804269 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:35.804269 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:35.804269 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:35.804269 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:35.804269 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:35.804269 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:35.804269 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:35.804269 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:35.804269 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:35.804269 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:35.804269 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:35.804269 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:35.804269 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:35.804269 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:35.805178 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:35.805178 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:35.805178 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:35.805178 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:35.805178 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:35.805178 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:35.805178 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:35.805178 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:35.805178 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:35.805178 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:35.805178 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:35.805178 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:35.805178 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:35.805178 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:35.805178 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:35.805178 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:35.806062 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:35.806062 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:35.806062 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:35.806062 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:35.806062 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:35.806062 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:35.806062 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:35.806062 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:35.806062 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:35.806062 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:35.806062 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:17:35.806062 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:35.808639 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 150/292] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Nov 2 20:17:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:35.814776 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa578e-e4f6-46e9-a359-faea7be77edf admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:35.829505 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa578e-e4f6-46e9-a359-faea7be77edf admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:35.846556 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae82539-bfac-4f56-8df0-a31cc9f82332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:35.847222 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae82539-bfac-4f56-8df0-a31cc9f82332 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:35.847507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae82539-bfac-4f56-8df0-a31cc9f82332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:35.847789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae82539-bfac-4f56-8df0-a31cc9f82332 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:35.848604 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae82539-bfac-4f56-8df0-a31cc9f82332 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:35.848922 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae82539-bfac-4f56-8df0-a31cc9f82332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:35.850601 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae82539-bfac-4f56-8df0-a31cc9f82332 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:35.869797 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 143/293] 10.222.0.23 () {56 vars in 1120 bytes} [Wed Nov 2 20:17:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:35.875652 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3893cd-c770-45d2-afc9-21f403e706a9 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:35.889547 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3893cd-c770-45d2-afc9-21f403e706a9 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:35.902066 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2621e2-d980-4e6e-9fcf-d10859caea24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:35.903067 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2621e2-d980-4e6e-9fcf-d10859caea24 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:35.903553 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2621e2-d980-4e6e-9fcf-d10859caea24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:35.904076 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2621e2-d980-4e6e-9fcf-d10859caea24 admin admin] PATH_INFO: `/v3/groups/71aac5b69b6745b8acbee7ddfa9cce3b` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:35.912098 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2621e2-d980-4e6e-9fcf-d10859caea24 admin admin] RBAC: Authorizing `identity:get_group(group_id=71aac5b69b6745b8acbee7ddfa9cce3b)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:35.914539 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2621e2-d980-4e6e-9fcf-d10859caea24 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:35.918453 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 151/294] 10.222.0.23 () {56 vars in 1201 bytes} [Wed Nov 2 20:17:35 2022] GET /identity/v3/groups/71aac5b69b6745b8acbee7ddfa9cce3b => generated 229 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:35.923406 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae82539-bfac-4f56-8df0-a31cc9f82332 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:35.934757 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae82539-bfac-4f56-8df0-a31cc9f82332 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:35.946138 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3a1ef-8463-4da8-94e6-4e9db4c4923b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:35.947258 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3a1ef-8463-4da8-94e6-4e9db4c4923b admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:35.947540 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3a1ef-8463-4da8-94e6-4e9db4c4923b admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:35.947816 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3a1ef-8463-4da8-94e6-4e9db4c4923b admin admin] PATH_INFO: `/v3/projects/14a9d6ea225146efb4d5d6e0861824b6` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:35.948984 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d3a1ef-8463-4da8-94e6-4e9db4c4923b admin admin] RBAC: Authorizing `identity:get_project(project_id=14a9d6ea225146efb4d5d6e0861824b6)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:35.950780 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d3a1ef-8463-4da8-94e6-4e9db4c4923b admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:35.952739 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 144/295] 10.222.0.23 () {56 vars in 1207 bytes} [Wed Nov 2 20:17:35 2022] GET /identity/v3/projects/14a9d6ea225146efb4d5d6e0861824b6 => generated 344 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:35.960283 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2621e2-d980-4e6e-9fcf-d10859caea24 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:35.972744 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed4fb0-961b-4f83-ae78-ecae14d31057 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:35.973076 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed4fb0-961b-4f83-ae78-ecae14d31057 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:35.973303 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed4fb0-961b-4f83-ae78-ecae14d31057 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:35.975063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 145/296] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:35.975905 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2621e2-d980-4e6e-9fcf-d10859caea24 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:35.981375 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6875dd-c582-4888-80a9-09a358db34b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:35.982980 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6875dd-c582-4888-80a9-09a358db34b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:35.983857 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6875dd-c582-4888-80a9-09a358db34b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:35.984785 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6875dd-c582-4888-80a9-09a358db34b3 admin admin] PATH_INFO: `/v3/projects/14a9d6ea225146efb4d5d6e0861824b6/groups/71aac5b69b6745b8acbee7ddfa9cce3b/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:35.987569 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6875dd-c582-4888-80a9-09a358db34b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14a9d6ea225146efb4d5d6e0861824b6, group_id=71aac5b69b6745b8acbee7ddfa9cce3b, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:35.990583 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721795c0-84d1-4535-aba9-e11b26476f43 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:35.990583 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721795c0-84d1-4535-aba9-e11b26476f43 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:35.990784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721795c0-84d1-4535-aba9-e11b26476f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:35.994034 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6875dd-c582-4888-80a9-09a358db34b3 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:36.013366 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 152/297] 10.222.0.23 () {58 vars in 1463 bytes} [Wed Nov 2 20:17:35 2022] PUT /identity/v3/projects/14a9d6ea225146efb4d5d6e0861824b6/groups/71aac5b69b6745b8acbee7ddfa9cce3b/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:17:36.023575 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-721795c0-84d1-4535-aba9-e11b26476f43 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:36.024789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-721795c0-84d1-4535-aba9-e11b26476f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:36.132284 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 146/298] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:36.478823 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35737b-7bda-459d-886b-09ae70cb37da None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:36.479203 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35737b-7bda-459d-886b-09ae70cb37da None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:36.479381 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35737b-7bda-459d-886b-09ae70cb37da None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:36.481914 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 153/299] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:36.486419 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3eba86-962e-4e03-a895-16f7eedbcc95 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:36.486714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3eba86-962e-4e03-a895-16f7eedbcc95 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:36.486996 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3eba86-962e-4e03-a895-16f7eedbcc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:36.510315 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-eb3eba86-962e-4e03-a895-16f7eedbcc95 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:36.511509 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-eb3eba86-962e-4e03-a895-16f7eedbcc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:36.538682 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:36.567988 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35737b-7bda-459d-886b-09ae70cb37da None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:36.600930 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:36.609158 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 147/300] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:36.710577 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35737b-7bda-459d-886b-09ae70cb37da None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:36.750485 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51097e4-b03c-467b-9420-049849782fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:36.751038 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51097e4-b03c-467b-9420-049849782fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:36.751369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51097e4-b03c-467b-9420-049849782fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:36.751644 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51097e4-b03c-467b-9420-049849782fa5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:36.766946 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51097e4-b03c-467b-9420-049849782fa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:36.772053 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-e51097e4-b03c-467b-9420-049849782fa5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 20:17:36.772053 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:36.772053 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:36.772053 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:36.772053 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:36.772053 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:36.772053 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:36.772053 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:36.772053 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:36.772053 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:36.772053 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:36.772053 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:36.772053 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:36.772053 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:36.772053 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:36.772053 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:36.773154 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:36.773154 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:36.773154 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:36.773154 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:36.773154 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:36.773154 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:36.773154 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:36.773154 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:36.773154 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:36.773154 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:36.773154 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:36.773154 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:36.773154 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:36.773154 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:36.773154 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:36.773154 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:36.774139 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:36.774139 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:36.774139 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:36.774139 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:36.774139 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:36.774139 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:36.774139 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:36.774139 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:36.774139 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:36.774139 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:36.774139 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 20:17:36.774139 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:36.774139 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 154/301] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:17:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:36.780998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3eba86-962e-4e03-a895-16f7eedbcc95 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:36.892295 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3eba86-962e-4e03-a895-16f7eedbcc95 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:36.918954 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51097e4-b03c-467b-9420-049849782fa5 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:36.933696 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe59e2-82e1-4801-ad42-a73e5bb3e2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:36.934072 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe59e2-82e1-4801-ad42-a73e5bb3e2ce None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:36.934353 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe59e2-82e1-4801-ad42-a73e5bb3e2ce None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:36.934628 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe59e2-82e1-4801-ad42-a73e5bb3e2ce None admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:36.935307 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe59e2-82e1-4801-ad42-a73e5bb3e2ce None admin] RBAC: Adding query filter params (name=member) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:36.935611 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe59e2-82e1-4801-ad42-a73e5bb3e2ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:36.937033 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe59e2-82e1-4801-ad42-a73e5bb3e2ce None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:36.952601 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 148/302] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Nov 2 20:17:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:36.965384 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe59e2-82e1-4801-ad42-a73e5bb3e2ce None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:36.994843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:37.060983 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:37.105066 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51097e4-b03c-467b-9420-049849782fa5 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:37.146025 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe59e2-82e1-4801-ad42-a73e5bb3e2ce None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:37.186108 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d496467-8081-4776-8d6f-ce730c49ea6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:37.186736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d496467-8081-4776-8d6f-ce730c49ea6d None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:37.187040 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d496467-8081-4776-8d6f-ce730c49ea6d None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:37.188918 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d496467-8081-4776-8d6f-ce730c49ea6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:37.197839 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d07ac-fecf-453f-8f60-1e8047a27291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:37.198822 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d07ac-fecf-453f-8f60-1e8047a27291 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:37.199298 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d07ac-fecf-453f-8f60-1e8047a27291 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:37.199805 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d07ac-fecf-453f-8f60-1e8047a27291 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:37.233542 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d07ac-fecf-453f-8f60-1e8047a27291 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:37.238798 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-bf5d07ac-fecf-453f-8f60-1e8047a27291 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 20:17:37.238798 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:37.238798 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:37.238798 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:37.238798 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:37.238798 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:37.238798 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:37.238798 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:37.238798 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:37.238798 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:37.238798 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:37.238798 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:37.238798 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:37.238798 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:37.238798 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:37.238798 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:37.239685 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:37.239685 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:37.239685 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:37.239685 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:37.239685 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:37.239685 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:37.239685 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:37.239685 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:37.239685 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:37.239685 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:37.239685 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:37.239685 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:37.239685 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:37.239685 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:37.239685 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:37.239685 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:37.240466 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:37.240466 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:37.240466 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:37.240466 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:37.240466 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:37.240466 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:37.240466 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:37.240466 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:37.240466 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:37.240466 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:37.240466 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 20:17:37.240466 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:37.242730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 155/303] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Nov 2 20:17:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 20:17:37.249532 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d07ac-fecf-453f-8f60-1e8047a27291 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:37.264812 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d496467-8081-4776-8d6f-ce730c49ea6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:37.266267 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d496467-8081-4776-8d6f-ce730c49ea6d None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:37.282404 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:37.371252 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 149/304] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Nov 2 20:17:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 20:17:37.377000 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d496467-8081-4776-8d6f-ce730c49ea6d None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:37.479786 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d496467-8081-4776-8d6f-ce730c49ea6d None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:37.497170 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:37.507652 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d07ac-fecf-453f-8f60-1e8047a27291 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:37.518809 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33421b6-3575-40bd-9a96-e9a95657f862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:37.519454 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33421b6-3575-40bd-9a96-e9a95657f862 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:37.524568 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33421b6-3575-40bd-9a96-e9a95657f862 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:37.524568 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33421b6-3575-40bd-9a96-e9a95657f862 None admin] PATH_INFO: `/v3/projects/54309652841a4da99a2089119546ac6d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:37.524568 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33421b6-3575-40bd-9a96-e9a95657f862 None admin] RBAC: Authorizing `identity:get_project(project_id=54309652841a4da99a2089119546ac6d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:37.525422 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33421b6-3575-40bd-9a96-e9a95657f862 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:37.527181 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 150/305] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Nov 2 20:17:37 2022] GET /identity/v3/projects/54309652841a4da99a2089119546ac6d => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:37.535171 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33421b6-3575-40bd-9a96-e9a95657f862 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:37.629893 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230dc2fb-7f7d-4af5-95a3-9be7f23618d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:37.630866 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dc2fb-7f7d-4af5-95a3-9be7f23618d8 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:37.631345 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dc2fb-7f7d-4af5-95a3-9be7f23618d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:37.631824 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dc2fb-7f7d-4af5-95a3-9be7f23618d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:37.632732 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230dc2fb-7f7d-4af5-95a3-9be7f23618d8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:37.633234 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230dc2fb-7f7d-4af5-95a3-9be7f23618d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:37.635356 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230dc2fb-7f7d-4af5-95a3-9be7f23618d8 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:37.643481 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33421b6-3575-40bd-9a96-e9a95657f862 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:37.656340 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 156/306] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:17:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:37.657911 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d79dba-e9d6-4ed7-8e50-a350281b788f None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:37.658394 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d79dba-e9d6-4ed7-8e50-a350281b788f None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:37.658866 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d79dba-e9d6-4ed7-8e50-a350281b788f None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:37.660653 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 157/307] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:37.661577 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d79dba-e9d6-4ed7-8e50-a350281b788f None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:37.668142 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:37.682457 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5416d7-6015-4d37-bcd3-5681f6b2335e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:37.683630 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5416d7-6015-4d37-bcd3-5681f6b2335e None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:37.684047 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5416d7-6015-4d37-bcd3-5681f6b2335e None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:37.684450 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5416d7-6015-4d37-bcd3-5681f6b2335e None admin] PATH_INFO: `/v3/groups/60df22a9303e4cd2a41b59c517fb9ef0` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:37.685769 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5416d7-6015-4d37-bcd3-5681f6b2335e None admin] RBAC: Authorizing `identity:get_group(group_id=60df22a9303e4cd2a41b59c517fb9ef0)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:37.687444 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5416d7-6015-4d37-bcd3-5681f6b2335e None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:37.689216 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 151/308] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Nov 2 20:17:37 2022] GET /identity/v3/groups/60df22a9303e4cd2a41b59c517fb9ef0 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:17:37.690563 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88f180-825d-45c9-853c-f159195e1ef0 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:37.690994 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88f180-825d-45c9-853c-f159195e1ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:37.691433 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88f180-825d-45c9-853c-f159195e1ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:37.714688 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-0e88f180-825d-45c9-853c-f159195e1ef0 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:37.716156 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-0e88f180-825d-45c9-853c-f159195e1ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:37.771219 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:37.801763 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 152/309] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:37.803013 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88f180-825d-45c9-853c-f159195e1ef0 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:37.827032 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d79dba-e9d6-4ed7-8e50-a350281b788f None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:37.888529 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee9840-899b-4d05-a0d4-d64eb8f79747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:37.889517 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee9840-899b-4d05-a0d4-d64eb8f79747 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:37.890238 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee9840-899b-4d05-a0d4-d64eb8f79747 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:37.890811 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee9840-899b-4d05-a0d4-d64eb8f79747 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:37.950089 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88f180-825d-45c9-853c-f159195e1ef0 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:37.990641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c60dd-33a6-4ad8-abb8-fc6a151b30ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:37.991607 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c60dd-33a6-4ad8-abb8-fc6a151b30ff None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:37.992085 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c60dd-33a6-4ad8-abb8-fc6a151b30ff None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:37.992603 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c60dd-33a6-4ad8-abb8-fc6a151b30ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:37.994142 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c60dd-33a6-4ad8-abb8-fc6a151b30ff None admin] RBAC: Adding query filter params (group.id=60df22a9303e4cd2a41b59c517fb9ef0, role.id=a1e0072f698b484b8cde5a22e350c67d, scope.project.id=54309652841a4da99a2089119546ac6d) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:37.994688 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c60dd-33a6-4ad8-abb8-fc6a151b30ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:37.996489 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c60dd-33a6-4ad8-abb8-fc6a151b30ff None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:38.003215 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 153/310] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Nov 2 20:17:37 2022] GET /identity/v3/role_assignments?group.id=60df22a9303e4cd2a41b59c517fb9ef0&scope.project.id=54309652841a4da99a2089119546ac6d&role.id=a1e0072f698b484b8cde5a22e350c67d => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:38.039521 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee9840-899b-4d05-a0d4-d64eb8f79747 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:38.045798 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee9840-899b-4d05-a0d4-d64eb8f79747 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:38.049475 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:38.170980 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 158/311] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Nov 2 20:17:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 20:17:38.176234 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c60dd-33a6-4ad8-abb8-fc6a151b30ff None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:38.222645 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee9840-899b-4d05-a0d4-d64eb8f79747 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:38.239692 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:38.309919 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c60dd-33a6-4ad8-abb8-fc6a151b30ff None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:38.359176 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc725c25-3f03-432b-b5e1-dacabb5cbae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:38.360453 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc725c25-3f03-432b-b5e1-dacabb5cbae3 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:38.361443 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc725c25-3f03-432b-b5e1-dacabb5cbae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:38.362196 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc725c25-3f03-432b-b5e1-dacabb5cbae3 None admin] PATH_INFO: `/v3/projects/54309652841a4da99a2089119546ac6d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:38.363819 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc725c25-3f03-432b-b5e1-dacabb5cbae3 None admin] RBAC: Authorizing `identity:get_project(project_id=54309652841a4da99a2089119546ac6d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:38.366183 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc725c25-3f03-432b-b5e1-dacabb5cbae3 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:38.369592 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 154/312] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Nov 2 20:17:38 2022] GET /identity/v3/projects/54309652841a4da99a2089119546ac6d => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:38.370993 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c9939-c570-4ec6-a10a-8ec8b328a83f None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:38.371209 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee9840-899b-4d05-a0d4-d64eb8f79747 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:38.371600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c9939-c570-4ec6-a10a-8ec8b328a83f None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:38.372015 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c9939-c570-4ec6-a10a-8ec8b328a83f None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:38.374798 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:38.375544 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 155/313] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:38.376449 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c9939-c570-4ec6-a10a-8ec8b328a83f None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:38.422105 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142115c0-cf57-4cfa-89f4-80cc26251d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:38.422999 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142115c0-cf57-4cfa-89f4-80cc26251d8d None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:38.423424 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142115c0-cf57-4cfa-89f4-80cc26251d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:38.423705 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142115c0-cf57-4cfa-89f4-80cc26251d8d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:38.439302 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142115c0-cf57-4cfa-89f4-80cc26251d8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:38.444388 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-142115c0-cf57-4cfa-89f4-80cc26251d8d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 20:17:38.444388 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:38.444388 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:38.444388 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:38.444388 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:38.444388 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:38.444388 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:38.444388 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:38.444388 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:38.444388 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:38.444388 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:38.444388 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:38.444388 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:38.444388 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:38.444388 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:38.444388 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:38.445361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:38.445361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:38.445361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:38.445361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:38.445361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:38.445361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:38.445361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:38.445361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:38.445361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:38.445361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:38.445361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:38.445361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:38.445361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:38.445361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:38.445361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:38.445361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:38.446567 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:38.446567 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:38.446567 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:38.446567 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:38.446567 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:38.446567 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:38.446567 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:38.446567 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:38.446567 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:38.446567 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:38.446567 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 20:17:38.446567 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:38.446567 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 159/314] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:17:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:38.447399 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af52322-d604-4142-bfe3-a25d8cb41aa0 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:38.447399 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af52322-d604-4142-bfe3-a25d8cb41aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:38.447399 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af52322-d604-4142-bfe3-a25d8cb41aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:38.466882 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-6af52322-d604-4142-bfe3-a25d8cb41aa0 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:38.468099 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-6af52322-d604-4142-bfe3-a25d8cb41aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:38.517931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c9939-c570-4ec6-a10a-8ec8b328a83f None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:38.540058 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:38.559308 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 160/315] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:38.560248 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af52322-d604-4142-bfe3-a25d8cb41aa0 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:38.567582 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd379b34-dc38-4206-9b6b-627aab3b1b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:38.568226 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd379b34-dc38-4206-9b6b-627aab3b1b4f None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:38.568514 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd379b34-dc38-4206-9b6b-627aab3b1b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:38.568830 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd379b34-dc38-4206-9b6b-627aab3b1b4f None admin] PATH_INFO: `/v3/groups/60df22a9303e4cd2a41b59c517fb9ef0` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:38.569963 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd379b34-dc38-4206-9b6b-627aab3b1b4f None admin] RBAC: Authorizing `identity:get_group(group_id=60df22a9303e4cd2a41b59c517fb9ef0)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:38.571540 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd379b34-dc38-4206-9b6b-627aab3b1b4f None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:38.573335 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 156/316] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Nov 2 20:17:38 2022] GET /identity/v3/groups/60df22a9303e4cd2a41b59c517fb9ef0 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:38.579425 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd379b34-dc38-4206-9b6b-627aab3b1b4f None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:38.667839 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:38.675014 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af52322-d604-4142-bfe3-a25d8cb41aa0 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:38.699799 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd379b34-dc38-4206-9b6b-627aab3b1b4f None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:38.715732 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c079da-2ce5-44f4-9637-5d5033e85d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:38.716496 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c079da-2ce5-44f4-9637-5d5033e85d25 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:38.716922 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c079da-2ce5-44f4-9637-5d5033e85d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:38.717568 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c079da-2ce5-44f4-9637-5d5033e85d25 None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:38.718076 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c079da-2ce5-44f4-9637-5d5033e85d25 None admin] RBAC: Adding query filter params (name=member) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:38.718483 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c079da-2ce5-44f4-9637-5d5033e85d25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:38.719984 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c079da-2ce5-44f4-9637-5d5033e85d25 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:38.729548 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 161/317] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Nov 2 20:17:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:38.735462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c079da-2ce5-44f4-9637-5d5033e85d25 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:38.746824 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5915696-c54c-45cc-8035-ff3ea08c6a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:38.747453 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5915696-c54c-45cc-8035-ff3ea08c6a84 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:38.747789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5915696-c54c-45cc-8035-ff3ea08c6a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:38.748079 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5915696-c54c-45cc-8035-ff3ea08c6a84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:38.748891 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5915696-c54c-45cc-8035-ff3ea08c6a84 None admin] RBAC: Adding query filter params (group.id=60df22a9303e4cd2a41b59c517fb9ef0, role.id=c415cff16e364aa9a9d40b79936ab4a9, scope.project.id=54309652841a4da99a2089119546ac6d) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:38.749206 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5915696-c54c-45cc-8035-ff3ea08c6a84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:38.751028 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5915696-c54c-45cc-8035-ff3ea08c6a84 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:38.757601 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 157/318] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Nov 2 20:17:38 2022] GET /identity/v3/role_assignments?group.id=60df22a9303e4cd2a41b59c517fb9ef0&scope.project.id=54309652841a4da99a2089119546ac6d&role.id=c415cff16e364aa9a9d40b79936ab4a9 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:17:38.858891 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c079da-2ce5-44f4-9637-5d5033e85d25 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:38.875984 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5915696-c54c-45cc-8035-ff3ea08c6a84 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:38.903711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db042670-7b2f-4122-a769-2d19f3025ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:38.904993 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db042670-7b2f-4122-a769-2d19f3025ced None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:38.904993 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db042670-7b2f-4122-a769-2d19f3025ced None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:38.904993 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db042670-7b2f-4122-a769-2d19f3025ced None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:38.938251 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:38.944943 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:39.006395 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db042670-7b2f-4122-a769-2d19f3025ced None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:39.008153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db042670-7b2f-4122-a769-2d19f3025ced None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:39.025738 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5915696-c54c-45cc-8035-ff3ea08c6a84 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:39.070065 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b1aae-4168-46a5-8cb8-7425b5ea7243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:39.071096 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b1aae-4168-46a5-8cb8-7425b5ea7243 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:39.071597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b1aae-4168-46a5-8cb8-7425b5ea7243 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:39.071878 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b1aae-4168-46a5-8cb8-7425b5ea7243 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:39.088220 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b1aae-4168-46a5-8cb8-7425b5ea7243 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:39.093883 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-468b1aae-4168-46a5-8cb8-7425b5ea7243 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 20:17:39.093883 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:39.093883 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:39.093883 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:39.093883 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:39.093883 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:39.093883 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:39.093883 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:39.093883 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:39.093883 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:39.093883 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:39.093883 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:39.093883 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:39.093883 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:39.093883 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:39.093883 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:39.094956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:39.094956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:39.094956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:39.094956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:39.094956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:39.094956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:39.094956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:39.094956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:39.094956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:39.094956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:39.094956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:39.094956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:39.094956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:39.094956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:39.094956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:39.094956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:39.095934 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:39.095934 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:39.095934 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:39.095934 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:39.095934 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:39.095934 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:39.095934 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:39.095934 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:39.095934 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:39.095934 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:39.095934 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 20:17:39.095934 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:39.098249 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 158/319] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Nov 2 20:17:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:39.104694 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b1aae-4168-46a5-8cb8-7425b5ea7243 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:39.161101 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 162/320] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Nov 2 20:17:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Nov 02 20:17:39.162379 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd38e8-912e-4bef-a69d-00fcabd8c3e8 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:39.162666 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd38e8-912e-4bef-a69d-00fcabd8c3e8 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:39.162941 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd38e8-912e-4bef-a69d-00fcabd8c3e8 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:39.164188 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 163/321] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:39.168761 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd38e8-912e-4bef-a69d-00fcabd8c3e8 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:39.220074 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b1aae-4168-46a5-8cb8-7425b5ea7243 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:39.223053 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:39.236369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:39.264184 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df71cf6-6814-4ac0-95fc-687457a58300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:39.264858 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df71cf6-6814-4ac0-95fc-687457a58300 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:39.265141 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df71cf6-6814-4ac0-95fc-687457a58300 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:39.265419 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df71cf6-6814-4ac0-95fc-687457a58300 None admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:39.268370 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df71cf6-6814-4ac0-95fc-687457a58300 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:39.268370 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df71cf6-6814-4ac0-95fc-687457a58300 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:39.268370 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df71cf6-6814-4ac0-95fc-687457a58300 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:39.277432 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 159/322] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:17:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:17:39.278479 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06cbe4-465e-4351-87d4-e2df1cda2298 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:39.278767 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06cbe4-465e-4351-87d4-e2df1cda2298 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:39.279042 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06cbe4-465e-4351-87d4-e2df1cda2298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:39.295280 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd38e8-912e-4bef-a69d-00fcabd8c3e8 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:39.298715 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-ac06cbe4-465e-4351-87d4-e2df1cda2298 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:39.299906 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-ac06cbe4-465e-4351-87d4-e2df1cda2298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:39.339526 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb41d9f-6c64-4821-8f71-24308c314532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:39.339526 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb41d9f-6c64-4821-8f71-24308c314532 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:39.339890 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb41d9f-6c64-4821-8f71-24308c314532 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:39.339890 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb41d9f-6c64-4821-8f71-24308c314532 None admin] PATH_INFO: `/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:39.342501 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb41d9f-6c64-4821-8f71-24308c314532 None admin] RBAC: Authorizing `identity:get_project(project_id=99ca9e0a0fa1499f9f61aa0f83fd5d23)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:39.343966 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb41d9f-6c64-4821-8f71-24308c314532 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:39.345844 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 164/323] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Nov 2 20:17:39 2022] GET /identity/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:17:39.346902 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb41d9f-6c64-4821-8f71-24308c314532 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:39.382081 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 160/324] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:39.382929 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06cbe4-465e-4351-87d4-e2df1cda2298 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:39.467137 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb41d9f-6c64-4821-8f71-24308c314532 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:39.498267 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:39.506465 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:39.514643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06cbe4-465e-4351-87d4-e2df1cda2298 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:39.515244 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c573a-4e85-4284-bbd1-3d20deb7ca0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:39.515861 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c573a-4e85-4284-bbd1-3d20deb7ca0e None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:39.516138 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c573a-4e85-4284-bbd1-3d20deb7ca0e None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:39.516411 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c573a-4e85-4284-bbd1-3d20deb7ca0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:39.562428 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d862b-6e9b-4beb-a676-21b07d3b6270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:39.563065 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d862b-6e9b-4beb-a676-21b07d3b6270 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:39.563344 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d862b-6e9b-4beb-a676-21b07d3b6270 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:39.563617 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d862b-6e9b-4beb-a676-21b07d3b6270 None admin] PATH_INFO: `/v3/groups/60df22a9303e4cd2a41b59c517fb9ef0` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:39.566441 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d862b-6e9b-4beb-a676-21b07d3b6270 None admin] RBAC: Authorizing `identity:get_group(group_id=60df22a9303e4cd2a41b59c517fb9ef0)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:39.567347 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d862b-6e9b-4beb-a676-21b07d3b6270 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:39.568784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 161/325] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Nov 2 20:17:39 2022] GET /identity/v3/groups/60df22a9303e4cd2a41b59c517fb9ef0 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:39.578257 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d862b-6e9b-4beb-a676-21b07d3b6270 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:39.614125 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c573a-4e85-4284-bbd1-3d20deb7ca0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:39.618551 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c573a-4e85-4284-bbd1-3d20deb7ca0e None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:39.703397 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d862b-6e9b-4beb-a676-21b07d3b6270 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:39.728012 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 165/326] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Nov 2 20:17:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 20:17:39.728807 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c573a-4e85-4284-bbd1-3d20deb7ca0e None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:39.745912 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d33574-ab81-4d82-8a82-aa8b9b4e52c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:39.746526 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d33574-ab81-4d82-8a82-aa8b9b4e52c1 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:39.746811 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d33574-ab81-4d82-8a82-aa8b9b4e52c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:39.747085 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d33574-ab81-4d82-8a82-aa8b9b4e52c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:39.747809 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d33574-ab81-4d82-8a82-aa8b9b4e52c1 None admin] RBAC: Adding query filter params (group.id=60df22a9303e4cd2a41b59c517fb9ef0, role.id=a1e0072f698b484b8cde5a22e350c67d, scope.project.id=99ca9e0a0fa1499f9f61aa0f83fd5d23) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:39.748121 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d33574-ab81-4d82-8a82-aa8b9b4e52c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:39.749952 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d33574-ab81-4d82-8a82-aa8b9b4e52c1 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:39.756923 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 162/327] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Nov 2 20:17:39 2022] GET /identity/v3/role_assignments?group.id=60df22a9303e4cd2a41b59c517fb9ef0&scope.project.id=99ca9e0a0fa1499f9f61aa0f83fd5d23&role.id=a1e0072f698b484b8cde5a22e350c67d => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:39.757733 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d33574-ab81-4d82-8a82-aa8b9b4e52c1 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:39.761901 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:39.804276 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:39.860367 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c573a-4e85-4284-bbd1-3d20deb7ca0e None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:39.913417 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e84f4-1226-471a-968b-1816d3d3fb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:39.914082 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e84f4-1226-471a-968b-1816d3d3fb70 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:39.916967 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e84f4-1226-471a-968b-1816d3d3fb70 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:39.916967 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e84f4-1226-471a-968b-1816d3d3fb70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:39.919533 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d33574-ab81-4d82-8a82-aa8b9b4e52c1 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:39.934242 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e84f4-1226-471a-968b-1816d3d3fb70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:39.941199 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-1d6e84f4-1226-471a-968b-1816d3d3fb70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:17:39.941199 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:39.941199 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:39.941199 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:39.941199 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:39.941199 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:39.941199 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:39.941199 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:39.941199 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:39.941199 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:39.941199 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:39.941199 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:39.941199 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:39.941199 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:39.941199 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:39.941199 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:39.942125 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:39.942125 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:39.942125 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:39.942125 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:39.942125 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:39.942125 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:39.942125 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:39.942125 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:39.942125 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:39.942125 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:39.942125 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:39.942125 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:39.942125 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:39.942125 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:39.942125 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:39.942125 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:39.942910 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:39.942910 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:39.942910 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:39.942910 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:39.942910 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:39.942910 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:39.942910 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:39.942910 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:39.942910 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:39.942910 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:39.942910 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:17:39.942910 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:39.942910 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 166/328] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Nov 2 20:17:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:39.948182 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e84f4-1226-471a-968b-1816d3d3fb70 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:39.963656 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58ad06-1095-4a8b-aa9c-8f9e8fe65de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:39.964442 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58ad06-1095-4a8b-aa9c-8f9e8fe65de4 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:39.964819 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58ad06-1095-4a8b-aa9c-8f9e8fe65de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:39.966146 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58ad06-1095-4a8b-aa9c-8f9e8fe65de4 None admin] PATH_INFO: `/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:39.967472 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58ad06-1095-4a8b-aa9c-8f9e8fe65de4 None admin] RBAC: Authorizing `identity:get_project(project_id=99ca9e0a0fa1499f9f61aa0f83fd5d23)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:39.969590 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58ad06-1095-4a8b-aa9c-8f9e8fe65de4 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:39.972306 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 163/329] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Nov 2 20:17:39 2022] GET /identity/v3/projects/99ca9e0a0fa1499f9f61aa0f83fd5d23 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:39.977189 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58ad06-1095-4a8b-aa9c-8f9e8fe65de4 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:40.044369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:40.064056 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e84f4-1226-471a-968b-1816d3d3fb70 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:40.094210 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:40.101721 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58ad06-1095-4a8b-aa9c-8f9e8fe65de4 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:40.104833 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a1726-f42b-4bf2-abfd-35e0a12328b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:40.105407 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a1726-f42b-4bf2-abfd-35e0a12328b4 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:40.105694 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a1726-f42b-4bf2-abfd-35e0a12328b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:40.106005 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a1726-f42b-4bf2-abfd-35e0a12328b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:40.106685 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a1726-f42b-4bf2-abfd-35e0a12328b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:40.106995 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a1726-f42b-4bf2-abfd-35e0a12328b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:40.108379 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a1726-f42b-4bf2-abfd-35e0a12328b4 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:40.116859 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 167/330] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:17:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:17:40.123839 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a1726-f42b-4bf2-abfd-35e0a12328b4 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:40.144349 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972893a8-2c11-4344-8c3a-fb8009b42fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:40.145402 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972893a8-2c11-4344-8c3a-fb8009b42fab None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:40.145848 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972893a8-2c11-4344-8c3a-fb8009b42fab None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:40.146297 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972893a8-2c11-4344-8c3a-fb8009b42fab None admin] PATH_INFO: `/v3/groups/60df22a9303e4cd2a41b59c517fb9ef0` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:40.148633 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972893a8-2c11-4344-8c3a-fb8009b42fab None admin] RBAC: Authorizing `identity:get_group(group_id=60df22a9303e4cd2a41b59c517fb9ef0)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:40.150566 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972893a8-2c11-4344-8c3a-fb8009b42fab None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:40.152430 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 164/331] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Nov 2 20:17:39 2022] GET /identity/v3/groups/60df22a9303e4cd2a41b59c517fb9ef0 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:40.158298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972893a8-2c11-4344-8c3a-fb8009b42fab None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:40.232182 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a1726-f42b-4bf2-abfd-35e0a12328b4 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:40.260247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972893a8-2c11-4344-8c3a-fb8009b42fab None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:40.264791 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19789df6-8f38-4e40-84ea-48293ef9a5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:40.265399 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19789df6-8f38-4e40-84ea-48293ef9a5e8 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:40.265681 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19789df6-8f38-4e40-84ea-48293ef9a5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:40.265958 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19789df6-8f38-4e40-84ea-48293ef9a5e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:40.281426 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:40.293087 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c639ef-33ef-4ed0-a35d-21fa62668425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:40.293694 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c639ef-33ef-4ed0-a35d-21fa62668425 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:40.293979 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c639ef-33ef-4ed0-a35d-21fa62668425 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:40.294255 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c639ef-33ef-4ed0-a35d-21fa62668425 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:40.295038 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c639ef-33ef-4ed0-a35d-21fa62668425 None admin] RBAC: Adding query filter params (group.id=60df22a9303e4cd2a41b59c517fb9ef0, role.id=c415cff16e364aa9a9d40b79936ab4a9, scope.project.id=99ca9e0a0fa1499f9f61aa0f83fd5d23) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:40.295294 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c639ef-33ef-4ed0-a35d-21fa62668425 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:40.296763 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c639ef-33ef-4ed0-a35d-21fa62668425 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:40.302472 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 165/332] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Nov 2 20:17:40 2022] GET /identity/v3/role_assignments?group.id=60df22a9303e4cd2a41b59c517fb9ef0&scope.project.id=99ca9e0a0fa1499f9f61aa0f83fd5d23&role.id=c415cff16e364aa9a9d40b79936ab4a9 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:17:40.337616 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19789df6-8f38-4e40-84ea-48293ef9a5e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:40.339136 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19789df6-8f38-4e40-84ea-48293ef9a5e8 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:40.443267 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 168/333] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Nov 2 20:17:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 20:17:40.449592 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c639ef-33ef-4ed0-a35d-21fa62668425 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:40.479660 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:40.557098 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c639ef-33ef-4ed0-a35d-21fa62668425 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:40.590953 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a615c364-08d4-4b6a-972f-9482ad7bffa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:40.591587 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615c364-08d4-4b6a-972f-9482ad7bffa7 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:40.591873 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615c364-08d4-4b6a-972f-9482ad7bffa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:40.592153 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615c364-08d4-4b6a-972f-9482ad7bffa7 None admin] PATH_INFO: `/v3/projects/14a9d6ea225146efb4d5d6e0861824b6` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:40.593330 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a615c364-08d4-4b6a-972f-9482ad7bffa7 None admin] RBAC: Authorizing `identity:get_project(project_id=14a9d6ea225146efb4d5d6e0861824b6)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:40.594756 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a615c364-08d4-4b6a-972f-9482ad7bffa7 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:40.596379 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 166/334] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Nov 2 20:17:40 2022] GET /identity/v3/projects/14a9d6ea225146efb4d5d6e0861824b6 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:40.601932 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19789df6-8f38-4e40-84ea-48293ef9a5e8 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:40.651066 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:40.704057 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19789df6-8f38-4e40-84ea-48293ef9a5e8 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:40.736206 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5eca2d-b728-4689-9563-80e8ef5c167b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:40.736860 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5eca2d-b728-4689-9563-80e8ef5c167b None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:40.737141 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5eca2d-b728-4689-9563-80e8ef5c167b None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:40.737415 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5eca2d-b728-4689-9563-80e8ef5c167b None admin] PATH_INFO: `/v3/groups/71aac5b69b6745b8acbee7ddfa9cce3b` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:40.738500 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5eca2d-b728-4689-9563-80e8ef5c167b None admin] RBAC: Authorizing `identity:get_group(group_id=71aac5b69b6745b8acbee7ddfa9cce3b)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:40.739925 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5eca2d-b728-4689-9563-80e8ef5c167b None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:40.741516 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 169/335] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Nov 2 20:17:40 2022] GET /identity/v3/groups/71aac5b69b6745b8acbee7ddfa9cce3b => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:40.747779 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a615c364-08d4-4b6a-972f-9482ad7bffa7 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:40.836876 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:40.843054 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a615c364-08d4-4b6a-972f-9482ad7bffa7 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:40.874747 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9a89b-0116-42a0-ab68-a104fd744b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:40.875338 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9a89b-0116-42a0-ab68-a104fd744b87 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:40.875620 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9a89b-0116-42a0-ab68-a104fd744b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:40.875894 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9a89b-0116-42a0-ab68-a104fd744b87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:40.876636 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9a89b-0116-42a0-ab68-a104fd744b87 None admin] RBAC: Adding query filter params (group.id=71aac5b69b6745b8acbee7ddfa9cce3b, role.id=bca2e686aa5e4fdc844fc679a4c41939, scope.project.id=14a9d6ea225146efb4d5d6e0861824b6) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:40.876947 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9a89b-0116-42a0-ab68-a104fd744b87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:40.878370 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9a89b-0116-42a0-ab68-a104fd744b87 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:40.884391 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 167/336] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Nov 2 20:17:40 2022] GET /identity/v3/role_assignments?group.id=71aac5b69b6745b8acbee7ddfa9cce3b&scope.project.id=14a9d6ea225146efb4d5d6e0861824b6&role.id=bca2e686aa5e4fdc844fc679a4c41939 => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:43.494930 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cf89d-a0c2-438a-8796-19ddd5cf4236 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:43.495446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cf89d-a0c2-438a-8796-19ddd5cf4236 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:43.495521 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cf89d-a0c2-438a-8796-19ddd5cf4236 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:43.496865 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 170/337] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:43.510961 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783930f3-f5f3-41d6-9c61-8c2751ff8769 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:43.511371 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783930f3-f5f3-41d6-9c61-8c2751ff8769 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:43.511580 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783930f3-f5f3-41d6-9c61-8c2751ff8769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:43.541918 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-783930f3-f5f3-41d6-9c61-8c2751ff8769 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:43.543187 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-783930f3-f5f3-41d6-9c61-8c2751ff8769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:43.643572 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 168/338] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:43.738970 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69374cec-336b-4926-ba24-cb9e822b931d None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:43.739607 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69374cec-336b-4926-ba24-cb9e822b931d None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:43.740088 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69374cec-336b-4926-ba24-cb9e822b931d None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:43.741685 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 171/339] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:43.747424 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be415fb-6c26-4f52-9de2-6f2af76c5ef7 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:43.747927 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be415fb-6c26-4f52-9de2-6f2af76c5ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:43.748405 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be415fb-6c26-4f52-9de2-6f2af76c5ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:43.750248 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2e359-82eb-41ab-ab2e-d7c327355187 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:43.750730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2e359-82eb-41ab-ab2e-d7c327355187 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:43.751218 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2e359-82eb-41ab-ab2e-d7c327355187 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:43.752900 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 172/340] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 20:17:43.757342 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba125e-ba3c-4e57-8f8e-1b52524bd62d None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:43.757855 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba125e-ba3c-4e57-8f8e-1b52524bd62d None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:43.758329 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba125e-ba3c-4e57-8f8e-1b52524bd62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:43.771872 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-3be415fb-6c26-4f52-9de2-6f2af76c5ef7 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:43.773378 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-3be415fb-6c26-4f52-9de2-6f2af76c5ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:43.785624 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-b6ba125e-ba3c-4e57-8f8e-1b52524bd62d None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:43.786826 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-b6ba125e-ba3c-4e57-8f8e-1b52524bd62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:43.843727 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 169/341] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:43.902935 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 173/342] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 20:17:43.988108 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be415fb-6c26-4f52-9de2-6f2af76c5ef7 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:44.013814 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:44.109924 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be415fb-6c26-4f52-9de2-6f2af76c5ef7 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:44.154080 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4837c93-06e9-4e64-aaa9-3a315c7ccafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:44.154780 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4837c93-06e9-4e64-aaa9-3a315c7ccafc None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:44.155064 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4837c93-06e9-4e64-aaa9-3a315c7ccafc None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:44.155339 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4837c93-06e9-4e64-aaa9-3a315c7ccafc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:44.165810 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4837c93-06e9-4e64-aaa9-3a315c7ccafc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:44.167239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4837c93-06e9-4e64-aaa9-3a315c7ccafc None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:44.181118 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba125e-ba3c-4e57-8f8e-1b52524bd62d None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:44.184145 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-e4837c93-06e9-4e64-aaa9-3a315c7ccafc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:44.184145 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:44.184145 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:44.184145 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:44.184145 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:44.184145 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:44.184145 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:44.184145 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:44.184145 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:44.184145 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:44.184145 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:44.184145 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:44.184145 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:17:44.184145 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:17:44.184145 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:17:44.184145 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:17:44.185537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:44.185537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:44.185537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:44.185537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:44.185537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:44.185537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:44.185537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:44.185537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:44.185537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:44.185537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:44.185537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:44.185537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:44.185537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:44.185537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:44.185537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:44.185537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:44.185537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:17:44.186691 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:17:44.186691 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:44.186691 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:44.186691 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 170/343] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:17:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:44.190436 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4837c93-06e9-4e64-aaa9-3a315c7ccafc None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:44.277014 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:44.299383 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4837c93-06e9-4e64-aaa9-3a315c7ccafc None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:44.310665 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:44.337464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1291e-3175-41f6-ad4e-a0cb9c328562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:44.338095 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1291e-3175-41f6-ad4e-a0cb9c328562 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:44.338381 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1291e-3175-41f6-ad4e-a0cb9c328562 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:44.338665 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1291e-3175-41f6-ad4e-a0cb9c328562 None admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:44.339318 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1291e-3175-41f6-ad4e-a0cb9c328562 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:44.339627 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1291e-3175-41f6-ad4e-a0cb9c328562 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:44.341046 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1291e-3175-41f6-ad4e-a0cb9c328562 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:44.354155 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 171/344] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:17:44.359718 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1291e-3175-41f6-ad4e-a0cb9c328562 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:44.411974 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba125e-ba3c-4e57-8f8e-1b52524bd62d None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:44.460099 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798cfa3-49e8-4b70-88d7-a0193790de1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:44.460807 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798cfa3-49e8-4b70-88d7-a0193790de1d None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:44.461094 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798cfa3-49e8-4b70-88d7-a0193790de1d None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:44.461424 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798cfa3-49e8-4b70-88d7-a0193790de1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:44.475298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1291e-3175-41f6-ad4e-a0cb9c328562 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:44.477270 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798cfa3-49e8-4b70-88d7-a0193790de1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:44.479888 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798cfa3-49e8-4b70-88d7-a0193790de1d None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:44.498839 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-b798cfa3-49e8-4b70-88d7-a0193790de1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:44.498839 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:44.498839 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:44.498839 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:44.498839 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:44.498839 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:44.498839 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:44.498839 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:44.498839 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:44.498839 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:44.498839 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:44.498839 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:44.498839 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:17:44.498839 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:17:44.498839 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:17:44.498839 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:17:44.505018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:44.505018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:44.505018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:44.505018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:44.505018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:44.505018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:44.505018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:44.505018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:44.505018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:44.505018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:44.505018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:44.505018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:44.505018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:44.505018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:44.505018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:44.505018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:44.505018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:17:44.506051 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:17:44.506051 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:44.506051 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:44.506051 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 174/345] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:17:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:44.506051 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798cfa3-49e8-4b70-88d7-a0193790de1d None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:44.512866 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:44.518822 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a9f72-e01b-4451-b95d-2c48df55bf2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:44.519446 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a9f72-e01b-4451-b95d-2c48df55bf2d None admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:44.519733 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a9f72-e01b-4451-b95d-2c48df55bf2d None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:44.520068 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a9f72-e01b-4451-b95d-2c48df55bf2d None admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:44.520816 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a9f72-e01b-4451-b95d-2c48df55bf2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:44.522485 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a9f72-e01b-4451-b95d-2c48df55bf2d None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:44.547695 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 172/346] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Nov 2 20:17:44 2022] POST /identity/v3/users => generated 246 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:17:44.549537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf5e6c-2ab0-47ea-a5a8-b89f8d829394 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:44.549945 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf5e6c-2ab0-47ea-a5a8-b89f8d829394 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:44.550379 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf5e6c-2ab0-47ea-a5a8-b89f8d829394 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:44.552579 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 173/347] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:44.553874 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf5e6c-2ab0-47ea-a5a8-b89f8d829394 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:44.619745 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:44.628090 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798cfa3-49e8-4b70-88d7-a0193790de1d None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:44.668006 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f683380-a6e9-49da-9378-a1f6ba6b32fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:44.668936 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f683380-a6e9-49da-9378-a1f6ba6b32fd None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:44.669415 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f683380-a6e9-49da-9378-a1f6ba6b32fd None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:44.669792 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f683380-a6e9-49da-9378-a1f6ba6b32fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:44.673079 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf5e6c-2ab0-47ea-a5a8-b89f8d829394 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:44.683671 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f683380-a6e9-49da-9378-a1f6ba6b32fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:44.685534 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f683380-a6e9-49da-9378-a1f6ba6b32fd None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:44.702787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-1f683380-a6e9-49da-9378-a1f6ba6b32fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:44.702787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:44.702787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:44.702787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:44.702787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:44.702787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:44.702787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:44.702787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:44.702787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:44.702787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:44.702787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:44.702787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:44.702787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:17:44.702787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:17:44.702787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:17:44.702787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:17:44.703941 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:44.703941 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:44.703941 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:44.703941 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:44.703941 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:44.703941 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:44.703941 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:44.703941 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:44.703941 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:44.703941 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:44.703941 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:44.703941 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:44.703941 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:44.703941 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:44.703941 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:44.703941 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:44.703941 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:17:44.704857 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:17:44.704857 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:44.704857 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:44.705980 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 175/348] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:17:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:44.707187 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff8aa9-46a4-4332-940a-7cf28e5832d4 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:44.708212 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff8aa9-46a4-4332-940a-7cf28e5832d4 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:44.708212 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff8aa9-46a4-4332-940a-7cf28e5832d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:44.710054 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ac989-11da-4afd-ad16-e0bf7e18dd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:44.710814 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ac989-11da-4afd-ad16-e0bf7e18dd0f None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:44.711104 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ac989-11da-4afd-ad16-e0bf7e18dd0f None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:44.711381 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ac989-11da-4afd-ad16-e0bf7e18dd0f None admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:44.712601 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ac989-11da-4afd-ad16-e0bf7e18dd0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:44.712999 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ac989-11da-4afd-ad16-e0bf7e18dd0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:44.714258 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ac989-11da-4afd-ad16-e0bf7e18dd0f None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:44.727638 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 174/349] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:44.728232 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-14ff8aa9-46a4-4332-940a-7cf28e5832d4 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:44.728466 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ac989-11da-4afd-ad16-e0bf7e18dd0f None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:44.729654 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-14ff8aa9-46a4-4332-940a-7cf28e5832d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:44.779535 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:44.810774 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 176/350] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:44.812272 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff8aa9-46a4-4332-940a-7cf28e5832d4 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:44.841228 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ac989-11da-4afd-ad16-e0bf7e18dd0f None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:44.903358 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651edd0d-f23a-492e-9f28-46773b92ca58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:44.903980 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651edd0d-f23a-492e-9f28-46773b92ca58 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:44.904259 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651edd0d-f23a-492e-9f28-46773b92ca58 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:44.904617 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651edd0d-f23a-492e-9f28-46773b92ca58 None admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:44.905271 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651edd0d-f23a-492e-9f28-46773b92ca58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:44.907744 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651edd0d-f23a-492e-9f28-46773b92ca58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:44.910428 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651edd0d-f23a-492e-9f28-46773b92ca58 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:44.942421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 175/351] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:44.948384 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651edd0d-f23a-492e-9f28-46773b92ca58 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:44.963040 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:45.006536 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff8aa9-46a4-4332-940a-7cf28e5832d4 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:45.067371 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e8fdf-be78-4604-9250-c884dcd6d0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:45.068055 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e8fdf-be78-4604-9250-c884dcd6d0b9 None admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:45.068434 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e8fdf-be78-4604-9250-c884dcd6d0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:45.068835 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e8fdf-be78-4604-9250-c884dcd6d0b9 None admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:45.069386 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651edd0d-f23a-492e-9f28-46773b92ca58 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:45.069675 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e8fdf-be78-4604-9250-c884dcd6d0b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:45.071888 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e8fdf-be78-4604-9250-c884dcd6d0b9 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:45.079794 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:45.095401 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 177/352] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Nov 2 20:17:44 2022] POST /identity/v3/users => generated 248 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:17:45.096879 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e159f4d-3d98-416f-9bcc-15238cbb2c99 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:45.097236 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e159f4d-3d98-416f-9bcc-15238cbb2c99 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:45.097586 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e159f4d-3d98-416f-9bcc-15238cbb2c99 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:45.099101 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 178/353] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:45.099731 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e159f4d-3d98-416f-9bcc-15238cbb2c99 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:45.115118 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241155e-7645-47af-8eaa-4276402193e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:45.116289 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241155e-7645-47af-8eaa-4276402193e3 None admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:45.116948 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241155e-7645-47af-8eaa-4276402193e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:45.117302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241155e-7645-47af-8eaa-4276402193e3 None admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:45.118165 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241155e-7645-47af-8eaa-4276402193e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:45.119800 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241155e-7645-47af-8eaa-4276402193e3 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:45.148365 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 176/354] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Nov 2 20:17:44 2022] POST /identity/v3/users => generated 248 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:17:45.149952 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c9b50-27ef-4417-93f3-519140b079cb None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:45.150373 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c9b50-27ef-4417-93f3-519140b079cb None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:45.150736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c9b50-27ef-4417-93f3-519140b079cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:45.174607 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-f63c9b50-27ef-4417-93f3-519140b079cb None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:45.176968 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-f63c9b50-27ef-4417-93f3-519140b079cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:45.253301 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e159f4d-3d98-416f-9bcc-15238cbb2c99 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:45.314101 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 177/355] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:45.332744 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f442b8-9ff4-43f2-a92e-f8c0fb710f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:45.333467 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f442b8-9ff4-43f2-a92e-f8c0fb710f81 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:45.333750 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f442b8-9ff4-43f2-a92e-f8c0fb710f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:45.334027 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f442b8-9ff4-43f2-a92e-f8c0fb710f81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:45.337492 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:45.348671 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f442b8-9ff4-43f2-a92e-f8c0fb710f81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:45.350238 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f442b8-9ff4-43f2-a92e-f8c0fb710f81 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:45.372493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-46f442b8-9ff4-43f2-a92e-f8c0fb710f81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:45.372493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:45.372493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:45.372493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:45.372493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:45.372493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:45.372493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:45.372493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:45.372493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:45.372493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:45.372493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:45.372493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:45.372493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:17:45.372493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:17:45.372493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:17:45.372493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:17:45.373481 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:45.373481 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:45.373481 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:45.373481 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:45.373481 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:45.373481 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:45.373481 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:45.373481 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:45.373481 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:45.373481 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:45.373481 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:45.373481 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:45.373481 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:45.373481 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:45.373481 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:45.373481 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:45.373481 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:17:45.374342 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:17:45.374342 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:45.374342 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:45.374342 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 179/356] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:17:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:45.380585 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c9b50-27ef-4417-93f3-519140b079cb None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:45.485403 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:45.491810 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c9b50-27ef-4417-93f3-519140b079cb None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:45.527570 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9e6a0-6c3f-4907-ada0-00b798909dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:45.528258 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9e6a0-6c3f-4907-ada0-00b798909dca None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:45.528435 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9e6a0-6c3f-4907-ada0-00b798909dca None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:45.531653 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9e6a0-6c3f-4907-ada0-00b798909dca None admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:45.531653 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9e6a0-6c3f-4907-ada0-00b798909dca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:45.531653 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9e6a0-6c3f-4907-ada0-00b798909dca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:45.531653 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9e6a0-6c3f-4907-ada0-00b798909dca None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:45.543438 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 178/357] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:45.548700 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f442b8-9ff4-43f2-a92e-f8c0fb710f81 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:45.672900 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9e6a0-6c3f-4907-ada0-00b798909dca None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:45.685272 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f442b8-9ff4-43f2-a92e-f8c0fb710f81 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:45.723998 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ff0c0-56e9-424c-a2cc-073ae43d6931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:45.725086 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ff0c0-56e9-424c-a2cc-073ae43d6931 None admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:45.725380 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ff0c0-56e9-424c-a2cc-073ae43d6931 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:45.725785 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ff0c0-56e9-424c-a2cc-073ae43d6931 None admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:45.726453 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ff0c0-56e9-424c-a2cc-073ae43d6931 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:45.728628 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ff0c0-56e9-424c-a2cc-073ae43d6931 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:45.754614 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 180/358] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Nov 2 20:17:45 2022] POST /identity/v3/users => generated 249 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:17:45.826919 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9e6a0-6c3f-4907-ada0-00b798909dca None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:45.865663 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20459f91-4d7b-4f7d-b5dc-3f8f31dd4809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:45.866293 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20459f91-4d7b-4f7d-b5dc-3f8f31dd4809 None admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:45.866575 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20459f91-4d7b-4f7d-b5dc-3f8f31dd4809 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:45.866855 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20459f91-4d7b-4f7d-b5dc-3f8f31dd4809 None admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:45.867652 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20459f91-4d7b-4f7d-b5dc-3f8f31dd4809 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:45.869265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20459f91-4d7b-4f7d-b5dc-3f8f31dd4809 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:45.883390 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.sql.core [None req-20459f91-4d7b-4f7d-b5dc-3f8f31dd4809 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 02 20:17:45.883390 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Nov 02 20:17:45.883390 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [parameters: {'id': 'a70842b4bfa243e78ae9425f975411db', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Nov 02 20:17:45.883390 dv-cinder-862365-5-smb devstack@keystone.service[81403]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81403) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 20:17:45.905490 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-20459f91-4d7b-4f7d-b5dc-3f8f31dd4809 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Nov 02 20:17:45.905490 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:45.905490 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 20:17:45.905490 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 20:17:45.905490 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 20:17:45.905490 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 20:17:45.905490 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 20:17:45.905490 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 20:17:45.905490 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 20:17:45.905490 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application conn.query(q) Nov 02 20:17:45.905490 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 20:17:45.905490 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 20:17:45.905490 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 20:17:45.905490 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application result.read() Nov 02 20:17:45.905490 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 20:17:45.906439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 20:17:45.906439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 20:17:45.906439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 20:17:45.906439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 20:17:45.906439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 20:17:45.906439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 20:17:45.906439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 20:17:45.906439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 02 20:17:45.906439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:45.906439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 20:17:45.906439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:45.906439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:45.906439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 20:17:45.906439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 20:17:45.906439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Nov 02 20:17:45.906439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return ref.to_dict() Nov 02 20:17:45.906439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 20:17:45.906439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application next(self.gen) Nov 02 20:17:45.908075 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 20:17:45.908075 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application yield resource Nov 02 20:17:45.908075 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 20:17:45.908075 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application next(self.gen) Nov 02 20:17:45.908075 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 20:17:45.908075 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 20:17:45.908075 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 20:17:45.908075 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 20:17:45.908075 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 20:17:45.908075 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise self.value Nov 02 20:17:45.908075 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 20:17:45.908075 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 20:17:45.908075 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 20:17:45.908075 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application session.commit() Nov 02 20:17:45.908075 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 20:17:45.908075 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 20:17:45.908075 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 20:17:45.910173 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 20:17:45.910173 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 20:17:45.910173 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self.session.flush() Nov 02 20:17:45.910173 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 20:17:45.910173 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 20:17:45.910173 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 20:17:45.910173 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 20:17:45.910173 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 20:17:45.910173 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application compat.raise_( Nov 02 20:17:45.910173 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 20:17:45.910173 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception Nov 02 20:17:45.910173 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 20:17:45.910173 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 20:17:45.910173 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 20:17:45.910173 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 20:17:45.910173 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 20:17:45.910173 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 20:17:45.912260 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 20:17:45.912260 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 20:17:45.912260 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Nov 02 20:17:45.912260 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application c = connection._execute_20( Nov 02 20:17:45.912260 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 20:17:45.912260 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 20:17:45.912260 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 20:17:45.912260 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 20:17:45.912260 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 20:17:45.912260 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 20:17:45.912260 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 20:17:45.912260 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 20:17:45.912260 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 20:17:45.912260 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 20:17:45.912260 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 20:17:45.912260 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception Nov 02 20:17:45.914204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 20:17:45.914204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 20:17:45.914204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 20:17:45.914204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 20:17:45.914204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 20:17:45.914204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 20:17:45.914204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 20:17:45.914204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application conn.query(q) Nov 02 20:17:45.914204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 20:17:45.914204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 20:17:45.914204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 20:17:45.914204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application result.read() Nov 02 20:17:45.914204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 20:17:45.914204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 20:17:45.914204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 20:17:45.914204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 20:17:45.916198 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 20:17:45.916198 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 20:17:45.916198 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 20:17:45.916198 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 20:17:45.916198 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 02 20:17:45.916198 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Nov 02 20:17:45.916198 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [parameters: {'id': 'a70842b4bfa243e78ae9425f975411db', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Nov 02 20:17:45.916198 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 20:17:45.916198 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:45.916198 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 20:17:45.916198 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:45.916198 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:45.916198 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:45.916198 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:45.916198 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:45.916198 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:45.925784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:45.925784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:45.925784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:45.925784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:45.925784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:45.925784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:45.925784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Nov 02 20:17:45.925784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Nov 02 20:17:45.925784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:45.925784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:45.925784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Nov 02 20:17:45.925784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Nov 02 20:17:45.925784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 20:17:45.925784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 20:17:45.925784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Nov 02 20:17:45.925784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:45.927805 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 179/359] 10.222.0.23 () {60 vars in 1131 bytes} [Wed Nov 2 20:17:45 2022] POST /identity/v3/roles => generated 144 bytes in 235 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:45.927952 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ff0c0-56e9-424c-a2cc-073ae43d6931 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:45.981977 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:46.052644 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ff0c0-56e9-424c-a2cc-073ae43d6931 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:46.089254 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd863999-7ab8-4448-b955-1019b89846b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:46.089892 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd863999-7ab8-4448-b955-1019b89846b4 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:46.090171 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd863999-7ab8-4448-b955-1019b89846b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:46.090495 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd863999-7ab8-4448-b955-1019b89846b4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:46.102542 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd863999-7ab8-4448-b955-1019b89846b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:46.108037 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-dd863999-7ab8-4448-b955-1019b89846b4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 20:17:46.108037 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:46.108037 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:46.108037 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:46.108037 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:46.108037 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:46.108037 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:46.108037 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:46.108037 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:46.108037 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:46.108037 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:46.108037 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:46.108037 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:46.108037 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:46.108037 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:46.108037 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:46.108983 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:46.108983 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:46.108983 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:46.108983 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:46.108983 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:46.108983 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:46.108983 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:46.108983 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:46.108983 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:46.108983 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:46.108983 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:46.108983 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:46.108983 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:46.108983 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:46.108983 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:46.108983 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:46.109871 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:46.109871 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:46.109871 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:46.109871 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:46.109871 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:46.109871 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:46.109871 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:46.109871 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:46.109871 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:46.109871 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:46.109871 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 20:17:46.109871 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:46.109871 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 181/360] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Nov 2 20:17:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:46.115325 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20459f91-4d7b-4f7d-b5dc-3f8f31dd4809 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:46.137392 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:46.225249 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20459f91-4d7b-4f7d-b5dc-3f8f31dd4809 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:46.260323 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ba9f5-5067-45c5-8345-7aed95ee945c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:46.260979 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ba9f5-5067-45c5-8345-7aed95ee945c None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:46.261260 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ba9f5-5067-45c5-8345-7aed95ee945c None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:46.261534 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ba9f5-5067-45c5-8345-7aed95ee945c None admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:46.262259 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ba9f5-5067-45c5-8345-7aed95ee945c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:46.262569 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ba9f5-5067-45c5-8345-7aed95ee945c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:46.263929 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ba9f5-5067-45c5-8345-7aed95ee945c None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:46.272519 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 180/361] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:17:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:47.214640 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333f446-addf-4a98-bf83-594a0f616041 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:47.215360 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333f446-addf-4a98-bf83-594a0f616041 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:47.215360 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333f446-addf-4a98-bf83-594a0f616041 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:47.216812 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 182/362] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:47.221662 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fba7a-8493-47e9-9a2d-790198d56943 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:47.222155 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fba7a-8493-47e9-9a2d-790198d56943 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:47.222311 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fba7a-8493-47e9-9a2d-790198d56943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:47.243708 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-070fba7a-8493-47e9-9a2d-790198d56943 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:47.245029 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-070fba7a-8493-47e9-9a2d-790198d56943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:47.314468 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 181/363] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:47.680228 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333f446-addf-4a98-bf83-594a0f616041 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:47.794852 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333f446-addf-4a98-bf83-594a0f616041 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:47.796366 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:47.837105 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c315d27-294b-4430-8f6f-37c1a067cd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:47.837836 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c315d27-294b-4430-8f6f-37c1a067cd5d None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:47.838048 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c315d27-294b-4430-8f6f-37c1a067cd5d None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:47.838310 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c315d27-294b-4430-8f6f-37c1a067cd5d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:47.850804 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c315d27-294b-4430-8f6f-37c1a067cd5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:47.856637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-4c315d27-294b-4430-8f6f-37c1a067cd5d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 20:17:47.856637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:47.856637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:47.856637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:47.856637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:47.856637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:47.856637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:47.856637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:47.856637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:47.856637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:47.856637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:47.856637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:47.856637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:47.856637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:47.856637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:47.856637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:47.857639 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:47.857639 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:47.857639 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:47.857639 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:47.857639 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:47.857639 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:47.857639 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:47.857639 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:47.857639 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:47.857639 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:47.857639 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:47.857639 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:47.857639 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:47.857639 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:47.857639 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:47.857639 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:47.858463 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:47.858463 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:47.858463 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:47.858463 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:47.858463 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:47.858463 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:47.858463 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:47.858463 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:47.858463 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:47.858463 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:47.858463 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 20:17:47.858463 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:47.858463 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 183/364] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Nov 2 20:17:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:47.864002 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070fba7a-8493-47e9-9a2d-790198d56943 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:47.876934 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afbed8-d131-4175-8c52-bb3719463853 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:47.877264 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afbed8-d131-4175-8c52-bb3719463853 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:47.877492 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afbed8-d131-4175-8c52-bb3719463853 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:47.882786 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 184/365] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:47.885255 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f05a27-ee0f-4abc-be67-93780437d095 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:47.885545 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f05a27-ee0f-4abc-be67-93780437d095 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:47.885827 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f05a27-ee0f-4abc-be67-93780437d095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:47.900340 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:47.924736 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-00f05a27-ee0f-4abc-be67-93780437d095 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:47.928380 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-00f05a27-ee0f-4abc-be67-93780437d095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:48.001555 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070fba7a-8493-47e9-9a2d-790198d56943 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:48.019357 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 185/366] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:48.021095 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2337a-35bb-4d33-8442-e5e7b6f68177 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:48.021707 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2337a-35bb-4d33-8442-e5e7b6f68177 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:48.022190 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2337a-35bb-4d33-8442-e5e7b6f68177 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:48.023899 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 186/367] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:48.032587 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4a1bc-07f3-4629-bdd4-96f70e892287 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:48.032587 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4a1bc-07f3-4629-bdd4-96f70e892287 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:48.032587 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4a1bc-07f3-4629-bdd4-96f70e892287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:48.039552 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4b7eb-4708-4a2a-bc0d-a27d3cd5a54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:48.040783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4b7eb-4708-4a2a-bc0d-a27d3cd5a54c None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:48.041071 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4b7eb-4708-4a2a-bc0d-a27d3cd5a54c None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:48.041351 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4b7eb-4708-4a2a-bc0d-a27d3cd5a54c None admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:48.042021 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4b7eb-4708-4a2a-bc0d-a27d3cd5a54c None admin] RBAC: Adding query filter params (name=service) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:48.042329 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4b7eb-4708-4a2a-bc0d-a27d3cd5a54c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:48.043762 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4b7eb-4708-4a2a-bc0d-a27d3cd5a54c None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:48.052246 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 182/368] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Nov 2 20:17:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:17:48.064881 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4b7eb-4708-4a2a-bc0d-a27d3cd5a54c None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:48.067754 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-b9a4a1bc-07f3-4629-bdd4-96f70e892287 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:48.068952 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-b9a4a1bc-07f3-4629-bdd4-96f70e892287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:48.175298 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 187/369] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:48.209764 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:48.214429 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4b7eb-4708-4a2a-bc0d-a27d3cd5a54c None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:48.260844 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e6c70-a371-4283-8318-aed8c051402e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:48.261494 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e6c70-a371-4283-8318-aed8c051402e None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:48.261729 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e6c70-a371-4283-8318-aed8c051402e None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:48.262002 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e6c70-a371-4283-8318-aed8c051402e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:48.277869 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e6c70-a371-4283-8318-aed8c051402e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:48.279369 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e6c70-a371-4283-8318-aed8c051402e None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:48.294086 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-862e6c70-a371-4283-8318-aed8c051402e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:48.294086 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:48.294086 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:48.294086 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:48.294086 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:48.294086 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:48.294086 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:48.294086 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:48.294086 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:48.294086 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:48.294086 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:48.294086 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:48.294086 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:17:48.294086 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:17:48.294086 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:17:48.294086 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:17:48.294977 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:48.294977 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:48.294977 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:48.294977 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:48.294977 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:48.294977 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:48.294977 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:48.294977 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:48.294977 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:48.294977 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:48.294977 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:48.294977 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:48.294977 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:48.294977 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:48.294977 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:48.294977 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:48.294977 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:17:48.295830 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:17:48.295830 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:48.295830 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:48.295830 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 183/370] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:17:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 20:17:48.301028 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4a1bc-07f3-4629-bdd4-96f70e892287 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:48.331875 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:48.431709 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4a1bc-07f3-4629-bdd4-96f70e892287 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:48.460187 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e6c70-a371-4283-8318-aed8c051402e None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:48.490996 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53732bc-daf0-422e-b4a3-4ad45f85ee40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:48.491613 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53732bc-daf0-422e-b4a3-4ad45f85ee40 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:48.491892 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53732bc-daf0-422e-b4a3-4ad45f85ee40 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:48.492162 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53732bc-daf0-422e-b4a3-4ad45f85ee40 None admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:48.492829 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53732bc-daf0-422e-b4a3-4ad45f85ee40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:48.493685 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53732bc-daf0-422e-b4a3-4ad45f85ee40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:48.495069 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53732bc-daf0-422e-b4a3-4ad45f85ee40 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:48.518890 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 188/371] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:48.519908 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53732bc-daf0-422e-b4a3-4ad45f85ee40 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:48.596915 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e6c70-a371-4283-8318-aed8c051402e None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:48.618694 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:48.628312 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:48.645957 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e47798-4c46-4ba2-8f14-7b4ac369b47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:48.646604 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e47798-4c46-4ba2-8f14-7b4ac369b47d None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:48.646886 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e47798-4c46-4ba2-8f14-7b4ac369b47d None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:48.647161 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e47798-4c46-4ba2-8f14-7b4ac369b47d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:48.648445 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53732bc-daf0-422e-b4a3-4ad45f85ee40 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:48.659991 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e47798-4c46-4ba2-8f14-7b4ac369b47d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:48.666480 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-09e47798-4c46-4ba2-8f14-7b4ac369b47d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 20:17:48.666480 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:48.666480 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:48.666480 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:48.666480 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:48.666480 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:48.666480 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:48.666480 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:48.666480 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:48.666480 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:48.666480 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:48.666480 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:48.666480 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:48.666480 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:48.666480 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:48.666480 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:48.667551 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:48.667551 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:48.667551 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:48.667551 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:48.667551 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:48.667551 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:48.667551 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:48.667551 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:48.667551 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:48.667551 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:48.667551 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:48.667551 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:48.667551 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:48.667551 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:48.667551 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:48.667551 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:48.668589 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:48.668589 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:48.668589 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:48.668589 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:48.668589 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:48.668589 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:48.668589 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:48.668589 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:48.668589 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:48.668589 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:48.668589 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 20:17:48.668589 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:48.668589 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 184/372] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Nov 2 20:17:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 20:17:48.669331 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e47798-4c46-4ba2-8f14-7b4ac369b47d None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:48.691228 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c06d0-a310-4d4b-92a5-50477a568850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:48.692097 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c06d0-a310-4d4b-92a5-50477a568850 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:48.692519 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c06d0-a310-4d4b-92a5-50477a568850 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:48.693010 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c06d0-a310-4d4b-92a5-50477a568850 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:48.705052 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c06d0-a310-4d4b-92a5-50477a568850 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:48.710637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-d13c06d0-a310-4d4b-92a5-50477a568850 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 20:17:48.710637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:48.710637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:48.710637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:48.710637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:48.710637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:48.710637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:48.710637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:48.710637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:48.710637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:48.710637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:48.710637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:48.710637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:48.710637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:48.710637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:48.710637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:48.711539 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:48.711539 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:48.711539 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:48.711539 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:48.711539 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:48.711539 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:48.711539 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:48.711539 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:48.711539 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:48.711539 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:48.711539 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:48.711539 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:48.711539 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:48.711539 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:48.711539 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:48.711539 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:48.712422 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:48.712422 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:48.712422 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:48.712422 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:48.712422 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:48.712422 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:48.712422 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:48.712422 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:48.712422 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:48.712422 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:48.712422 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 20:17:48.712422 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:48.713084 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 189/373] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Nov 2 20:17:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:48.713623 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c06d0-a310-4d4b-92a5-50477a568850 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:48.787876 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e47798-4c46-4ba2-8f14-7b4ac369b47d None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:48.820146 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c06d0-a310-4d4b-92a5-50477a568850 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:48.824757 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17036c31-00bc-4e02-ba1b-cd7f9e2d6873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:48.825390 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17036c31-00bc-4e02-ba1b-cd7f9e2d6873 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:48.825667 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17036c31-00bc-4e02-ba1b-cd7f9e2d6873 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:48.825938 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17036c31-00bc-4e02-ba1b-cd7f9e2d6873 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:48.833840 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17036c31-00bc-4e02-ba1b-cd7f9e2d6873 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:48.835461 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17036c31-00bc-4e02-ba1b-cd7f9e2d6873 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:48.849117 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-17036c31-00bc-4e02-ba1b-cd7f9e2d6873 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 20:17:48.849117 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:48.849117 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:48.849117 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:48.849117 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:48.849117 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:48.849117 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:48.849117 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:48.849117 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:48.849117 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:48.849117 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:48.849117 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:48.849117 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 20:17:48.849117 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 20:17:48.849117 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 20:17:48.849117 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 20:17:48.849987 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:48.849987 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:48.849987 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 20:17:48.849987 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:17:48.849987 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 20:17:48.849987 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:17:48.849987 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:48.849987 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:48.849987 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:48.849987 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:48.849987 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:48.849987 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:48.849987 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:48.849987 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:48.849987 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:48.849987 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:48.849987 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:48.849987 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:48.856302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:48.856302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:48.856302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 20:17:48.856302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 20:17:48.856302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 20:17:48.856302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 20:17:48.856302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 20:17:48.856302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 20:17:48.856302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 20:17:48.856302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:48.856302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 185/374] 10.222.0.23 () {56 vars in 1093 bytes} [Wed Nov 2 20:17:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:48.856302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd77b70-8b39-456f-8ee1-4b10b9cd6d2b None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:48.856302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd77b70-8b39-456f-8ee1-4b10b9cd6d2b None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:48.857275 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd77b70-8b39-456f-8ee1-4b10b9cd6d2b None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:48.857275 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 186/375] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:48.857275 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd77b70-8b39-456f-8ee1-4b10b9cd6d2b None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:48.863159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2ec14-2ab9-448d-b74f-0af46dff8b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:48.863769 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2ec14-2ab9-448d-b74f-0af46dff8b60 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:48.864050 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2ec14-2ab9-448d-b74f-0af46dff8b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:48.864326 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2ec14-2ab9-448d-b74f-0af46dff8b60 None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:48.865027 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2ec14-2ab9-448d-b74f-0af46dff8b60 None admin] RBAC: Adding query filter params (name=service) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:48.865338 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2ec14-2ab9-448d-b74f-0af46dff8b60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:48.866712 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2ec14-2ab9-448d-b74f-0af46dff8b60 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:48.879689 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 190/376] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Nov 2 20:17:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:48.879689 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2ec14-2ab9-448d-b74f-0af46dff8b60 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:48.882748 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:48.909720 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:48.970454 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd77b70-8b39-456f-8ee1-4b10b9cd6d2b None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:48.980813 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2ec14-2ab9-448d-b74f-0af46dff8b60 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:49.007157 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dacf5-9279-46ee-87e7-48d2e2c7e3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:49.007996 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dacf5-9279-46ee-87e7-48d2e2c7e3f4 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:49.008421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dacf5-9279-46ee-87e7-48d2e2c7e3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:49.008907 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dacf5-9279-46ee-87e7-48d2e2c7e3f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:49.009898 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58dacf5-9279-46ee-87e7-48d2e2c7e3f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:49.010205 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58dacf5-9279-46ee-87e7-48d2e2c7e3f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:49.011698 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58dacf5-9279-46ee-87e7-48d2e2c7e3f4 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:49.015191 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ecf30-d33f-4c12-b535-3a5d550324cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:49.015796 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ecf30-d33f-4c12-b535-3a5d550324cc None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:49.016077 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ecf30-d33f-4c12-b535-3a5d550324cc None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:49.016353 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ecf30-d33f-4c12-b535-3a5d550324cc None admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:49.017535 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2ecf30-d33f-4c12-b535-3a5d550324cc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:49.017999 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2ecf30-d33f-4c12-b535-3a5d550324cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:49.019412 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2ecf30-d33f-4c12-b535-3a5d550324cc None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:49.019655 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 187/377] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Nov 2 20:17:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:49.021873 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873b28e-17ce-40d9-9b7f-16b1fa6523a9 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:49.022160 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873b28e-17ce-40d9-9b7f-16b1fa6523a9 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:49.022437 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873b28e-17ce-40d9-9b7f-16b1fa6523a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:49.041745 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-f873b28e-17ce-40d9-9b7f-16b1fa6523a9 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:49.042992 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-f873b28e-17ce-40d9-9b7f-16b1fa6523a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:49.063563 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 191/378] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Nov 2 20:17:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:49.064771 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ecf30-d33f-4c12-b535-3a5d550324cc None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:49.121244 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 188/379] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:49.122485 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873b28e-17ce-40d9-9b7f-16b1fa6523a9 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:49.136399 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:49.167789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:49.178791 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ecf30-d33f-4c12-b535-3a5d550324cc None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:49.215148 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250035ff-7160-45a1-b123-b81cd3e9962f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:49.215768 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250035ff-7160-45a1-b123-b81cd3e9962f None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:49.216045 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250035ff-7160-45a1-b123-b81cd3e9962f None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:49.216317 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250035ff-7160-45a1-b123-b81cd3e9962f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:49.226679 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250035ff-7160-45a1-b123-b81cd3e9962f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:49.228180 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250035ff-7160-45a1-b123-b81cd3e9962f None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:49.243525 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-250035ff-7160-45a1-b123-b81cd3e9962f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:49.243525 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:49.243525 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:49.243525 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:49.243525 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:49.243525 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:49.243525 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:49.243525 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:49.243525 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:49.243525 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:49.243525 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:49.243525 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:49.243525 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:17:49.243525 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:17:49.243525 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:17:49.243525 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:17:49.244439 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:49.244439 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:49.244439 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:49.244439 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:49.244439 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:49.244439 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:49.244439 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:49.244439 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:49.244439 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:49.244439 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:49.244439 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:49.244439 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:49.244439 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:49.244439 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:49.244439 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:49.244439 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:49.244439 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:17:49.245318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:17:49.245318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:49.245318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:49.245318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 192/380] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:17:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:49.245549 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250035ff-7160-45a1-b123-b81cd3e9962f None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:49.251387 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873b28e-17ce-40d9-9b7f-16b1fa6523a9 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:49.287408 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd9381-ff16-42c2-b57e-5d8aea299cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:49.288035 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd9381-ff16-42c2-b57e-5d8aea299cda None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:49.288327 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd9381-ff16-42c2-b57e-5d8aea299cda None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:49.288590 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd9381-ff16-42c2-b57e-5d8aea299cda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:49.300288 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd9381-ff16-42c2-b57e-5d8aea299cda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:49.301938 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd9381-ff16-42c2-b57e-5d8aea299cda None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:49.317758 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-54cd9381-ff16-42c2-b57e-5d8aea299cda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:49.317758 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:49.317758 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:49.317758 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:49.317758 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:49.317758 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:49.317758 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:49.317758 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:49.317758 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:49.317758 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:49.317758 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:49.317758 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:49.317758 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:17:49.317758 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:17:49.317758 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:17:49.317758 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:17:49.318787 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:49.318787 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:49.318787 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:49.318787 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:49.318787 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:49.318787 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:49.318787 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:49.318787 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:49.318787 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:49.318787 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:49.318787 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:49.318787 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:49.318787 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:49.318787 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:49.318787 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:49.318787 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:49.318787 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:17:49.320272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:17:49.320272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:49.320272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:49.320272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 189/381] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:17:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:49.324904 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfad184-4f48-4647-93c1-8d636a1d8afb None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:49.325190 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfad184-4f48-4647-93c1-8d636a1d8afb None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:49.325469 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfad184-4f48-4647-93c1-8d636a1d8afb None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:49.326739 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 190/382] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:49.327946 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfad184-4f48-4647-93c1-8d636a1d8afb None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:49.350340 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250035ff-7160-45a1-b123-b81cd3e9962f None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:49.364436 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:49.386948 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eea75a-b0bc-49d3-974e-424d359041e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:49.387502 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eea75a-b0bc-49d3-974e-424d359041e2 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:49.387788 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eea75a-b0bc-49d3-974e-424d359041e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:49.388178 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eea75a-b0bc-49d3-974e-424d359041e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:49.398859 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eea75a-b0bc-49d3-974e-424d359041e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:49.400322 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eea75a-b0bc-49d3-974e-424d359041e2 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:49.414365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-04eea75a-b0bc-49d3-974e-424d359041e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:49.414365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:49.414365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:49.414365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:49.414365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:49.414365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:49.414365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:49.414365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:49.414365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:49.414365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:49.414365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:49.414365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:49.414365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:17:49.414365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:17:49.414365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:17:49.414365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:17:49.415799 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:49.415799 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:49.415799 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:49.415799 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:49.415799 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:49.415799 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:49.415799 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:49.415799 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:49.415799 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:49.415799 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:49.415799 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:49.415799 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:49.415799 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:49.415799 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:49.415799 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:49.415799 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:49.415799 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:17:49.417208 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:17:49.417208 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:49.417208 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:49.417208 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 193/383] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:17:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:49.417470 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eea75a-b0bc-49d3-974e-424d359041e2 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:49.424103 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:49.439343 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfad184-4f48-4647-93c1-8d636a1d8afb None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:49.472776 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a601e-b2e8-483a-a0b2-b668cfa5048a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:49.473709 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a601e-b2e8-483a-a0b2-b668cfa5048a None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:49.473986 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a601e-b2e8-483a-a0b2-b668cfa5048a None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:49.474259 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a601e-b2e8-483a-a0b2-b668cfa5048a None admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:49.474895 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a601e-b2e8-483a-a0b2-b668cfa5048a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:49.475200 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a601e-b2e8-483a-a0b2-b668cfa5048a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:49.476569 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a601e-b2e8-483a-a0b2-b668cfa5048a None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:49.492346 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 191/384] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:49.492346 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912276a-6622-4c10-98fc-e50742a3c8c1 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:49.492346 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912276a-6622-4c10-98fc-e50742a3c8c1 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:49.492346 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912276a-6622-4c10-98fc-e50742a3c8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:49.507511 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-9912276a-6622-4c10-98fc-e50742a3c8c1 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:49.508751 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-9912276a-6622-4c10-98fc-e50742a3c8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:49.516924 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eea75a-b0bc-49d3-974e-424d359041e2 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:49.551457 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69102120-0cbd-412c-bfa2-7aff906299e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:49.552060 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69102120-0cbd-412c-bfa2-7aff906299e5 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:49.552340 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69102120-0cbd-412c-bfa2-7aff906299e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:49.552648 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69102120-0cbd-412c-bfa2-7aff906299e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:49.553285 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69102120-0cbd-412c-bfa2-7aff906299e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:49.553593 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69102120-0cbd-412c-bfa2-7aff906299e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:49.554987 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69102120-0cbd-412c-bfa2-7aff906299e5 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:49.566764 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 194/385] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:49.567376 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69102120-0cbd-412c-bfa2-7aff906299e5 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:49.579542 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 192/386] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:49.580442 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912276a-6622-4c10-98fc-e50742a3c8c1 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:49.599040 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:49.661065 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:49.677996 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69102120-0cbd-412c-bfa2-7aff906299e5 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:49.684976 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912276a-6622-4c10-98fc-e50742a3c8c1 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:49.712244 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a886ee-b027-4a0b-b4c1-8f5287b30590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:49.712905 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a886ee-b027-4a0b-b4c1-8f5287b30590 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:49.713191 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a886ee-b027-4a0b-b4c1-8f5287b30590 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:49.713476 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a886ee-b027-4a0b-b4c1-8f5287b30590 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:49.721302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0d1e6-c11e-42f8-a2ab-9e2763f3b6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:49.722118 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0d1e6-c11e-42f8-a2ab-9e2763f3b6c5 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:49.722567 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0d1e6-c11e-42f8-a2ab-9e2763f3b6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:49.723009 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0d1e6-c11e-42f8-a2ab-9e2763f3b6c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:49.723583 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a886ee-b027-4a0b-b4c1-8f5287b30590 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:49.723961 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0d1e6-c11e-42f8-a2ab-9e2763f3b6c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:49.724413 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0d1e6-c11e-42f8-a2ab-9e2763f3b6c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:49.725932 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0d1e6-c11e-42f8-a2ab-9e2763f3b6c5 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:49.728451 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-f4a886ee-b027-4a0b-b4c1-8f5287b30590 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 20:17:49.728451 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:49.728451 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:49.728451 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:49.728451 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:49.728451 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:49.728451 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:49.728451 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:49.728451 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:49.728451 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:49.728451 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:49.728451 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:49.728451 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:49.728451 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:49.728451 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:49.728451 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:49.729550 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:49.729550 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:49.729550 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:49.729550 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:49.729550 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:49.729550 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:49.729550 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:49.729550 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:49.729550 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:49.729550 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:49.729550 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:49.729550 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:49.729550 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:49.729550 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:49.729550 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:49.729550 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:49.730641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:49.730641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:49.730641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:49.730641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:49.730641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:49.730641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:49.730641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:49.730641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:49.730641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:49.730641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:49.730641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 20:17:49.730641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:49.730641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 195/387] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Nov 2 20:17:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:49.730641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a886ee-b027-4a0b-b4c1-8f5287b30590 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:49.741262 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 193/388] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:49.742421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0d1e6-c11e-42f8-a2ab-9e2763f3b6c5 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:49.822536 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:49.838767 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a886ee-b027-4a0b-b4c1-8f5287b30590 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:49.847214 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0d1e6-c11e-42f8-a2ab-9e2763f3b6c5 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:49.872754 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2726aa-6fa0-4d44-bdea-d8ff2f99632e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:49.873387 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2726aa-6fa0-4d44-bdea-d8ff2f99632e None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:49.873669 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2726aa-6fa0-4d44-bdea-d8ff2f99632e None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:49.873949 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2726aa-6fa0-4d44-bdea-d8ff2f99632e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:49.880844 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ffd2c-36c6-47b6-94b0-bd3e7318152c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:49.880971 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2726aa-6fa0-4d44-bdea-d8ff2f99632e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:49.881473 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ffd2c-36c6-47b6-94b0-bd3e7318152c None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:49.881755 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ffd2c-36c6-47b6-94b0-bd3e7318152c None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:49.882030 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ffd2c-36c6-47b6-94b0-bd3e7318152c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:49.882371 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2726aa-6fa0-4d44-bdea-d8ff2f99632e None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:49.889860 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ffd2c-36c6-47b6-94b0-bd3e7318152c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:49.891276 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ffd2c-36c6-47b6-94b0-bd3e7318152c None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:49.892984 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:49.895688 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-5b2726aa-6fa0-4d44-bdea-d8ff2f99632e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 20:17:49.895688 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:49.895688 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:49.895688 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:49.895688 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:49.895688 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:49.895688 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:49.895688 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:49.895688 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:49.895688 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:49.895688 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:49.895688 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:49.895688 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 20:17:49.895688 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 20:17:49.895688 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 20:17:49.895688 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 20:17:49.896632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:49.896632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:49.896632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 20:17:49.896632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:17:49.896632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 20:17:49.896632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:17:49.896632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:49.896632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:49.896632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:49.896632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:49.896632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:49.896632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:49.896632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:49.896632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:49.896632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:49.896632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:49.896632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:49.896632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:49.897543 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:49.897543 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:49.897543 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 20:17:49.897543 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 20:17:49.897543 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 20:17:49.897543 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 20:17:49.897543 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 20:17:49.897543 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 20:17:49.897543 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 20:17:49.897543 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:49.897543 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 196/389] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:17:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:49.898097 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2726aa-6fa0-4d44-bdea-d8ff2f99632e None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:49.907859 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-af9ffd2c-36c6-47b6-94b0-bd3e7318152c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 02 20:17:49.907859 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:49.907859 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:49.907859 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:49.907859 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:49.907859 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:49.907859 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:49.907859 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:49.907859 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:49.907859 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:49.907859 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:49.907859 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:49.907859 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 20:17:49.907859 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 20:17:49.907859 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 20:17:49.907859 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 20:17:49.908783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:49.908783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:49.908783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 20:17:49.908783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:17:49.908783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 20:17:49.908783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:17:49.908783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:49.908783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:49.908783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:49.908783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:49.908783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:49.908783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:49.908783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:49.908783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:49.908783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:49.908783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:49.908783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:49.908783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:49.909923 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:49.909923 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:49.909923 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 20:17:49.909923 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 20:17:49.909923 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 20:17:49.909923 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 20:17:49.909923 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 20:17:49.909923 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 20:17:49.909923 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Nov 02 20:17:49.909923 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:49.909923 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 194/390] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:17:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:49.910759 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ffd2c-36c6-47b6-94b0-bd3e7318152c None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:50.000638 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2726aa-6fa0-4d44-bdea-d8ff2f99632e None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:50.009230 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ffd2c-36c6-47b6-94b0-bd3e7318152c None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:50.032872 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ba96c-8e6d-4d06-91ef-c82c2f265d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:50.033467 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ba96c-8e6d-4d06-91ef-c82c2f265d13 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:50.033745 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ba96c-8e6d-4d06-91ef-c82c2f265d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:50.034021 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ba96c-8e6d-4d06-91ef-c82c2f265d13 None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:50.034673 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ba96c-8e6d-4d06-91ef-c82c2f265d13 None admin] RBAC: Adding query filter params (name=service) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:50.034973 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ba96c-8e6d-4d06-91ef-c82c2f265d13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:50.036342 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ba96c-8e6d-4d06-91ef-c82c2f265d13 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:50.042889 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b6feb-1807-489a-9a0b-5c2267ca8701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:50.043505 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b6feb-1807-489a-9a0b-5c2267ca8701 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:50.043785 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b6feb-1807-489a-9a0b-5c2267ca8701 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:50.044058 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b6feb-1807-489a-9a0b-5c2267ca8701 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:50.044493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 197/391] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Nov 2 20:17:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:50.049284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ba96c-8e6d-4d06-91ef-c82c2f265d13 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:50.051689 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b6feb-1807-489a-9a0b-5c2267ca8701 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:50.053167 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b6feb-1807-489a-9a0b-5c2267ca8701 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:50.058363 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:50.066227 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-a59b6feb-1807-489a-9a0b-5c2267ca8701 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:17:50.066227 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:50.066227 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:50.066227 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:50.066227 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:50.066227 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:50.066227 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:50.066227 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:50.066227 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:50.066227 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:50.066227 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:50.066227 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:50.066227 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 20:17:50.066227 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 20:17:50.066227 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 20:17:50.067254 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 20:17:50.067254 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:50.067254 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:50.067254 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:50.067254 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:50.067254 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:50.067254 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:50.067254 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:50.067254 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:50.067254 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:50.067254 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:50.067254 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:50.067254 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:50.067254 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:50.067254 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:50.067254 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:50.067254 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:50.068111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 20:17:50.068111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 20:17:50.068111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 20:17:50.068111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 20:17:50.068111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 20:17:50.068111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 20:17:50.068111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:17:50.068111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:50.068111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 195/392] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:17:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:50.068111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b6feb-1807-489a-9a0b-5c2267ca8701 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:50.124694 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:50.148593 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ba96c-8e6d-4d06-91ef-c82c2f265d13 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:50.165855 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b6feb-1807-489a-9a0b-5c2267ca8701 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:50.182692 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0f3c1-b906-4774-a8ec-4805d76956f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:50.183570 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0f3c1-b906-4774-a8ec-4805d76956f5 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:50.183852 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0f3c1-b906-4774-a8ec-4805d76956f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:50.184125 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0f3c1-b906-4774-a8ec-4805d76956f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:50.194816 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0f3c1-b906-4774-a8ec-4805d76956f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:50.196778 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0f3c1-b906-4774-a8ec-4805d76956f5 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:50.198836 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ee7ec-8039-43c7-8c77-e62ca83faec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:50.199447 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ee7ec-8039-43c7-8c77-e62ca83faec1 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:50.199734 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ee7ec-8039-43c7-8c77-e62ca83faec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:50.200013 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ee7ec-8039-43c7-8c77-e62ca83faec1 None admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:50.200777 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ee7ec-8039-43c7-8c77-e62ca83faec1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:50.201092 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ee7ec-8039-43c7-8c77-e62ca83faec1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:50.202508 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ee7ec-8039-43c7-8c77-e62ca83faec1 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:50.210544 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-b2d0f3c1-b906-4774-a8ec-4805d76956f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:50.210544 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:50.210544 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:50.210544 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:50.210544 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:50.210544 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:50.210544 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:50.210544 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:50.210544 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:50.210544 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:50.210544 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:50.210544 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:50.210544 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:17:50.210544 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:17:50.210544 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:17:50.210544 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:17:50.211447 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:50.211447 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:50.211447 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:50.211447 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:50.211447 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:50.211447 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:50.211447 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:50.211447 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:50.211447 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:50.211447 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:50.211447 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:50.211447 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:50.211447 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:50.211447 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:50.211447 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:50.211447 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:50.211447 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:17:50.212374 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:17:50.212374 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:50.212374 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:50.216704 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 198/393] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:17:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:50.217487 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0f3c1-b906-4774-a8ec-4805d76956f5 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:50.238675 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 196/394] 10.222.0.23 () {56 vars in 1137 bytes} [Wed Nov 2 20:17:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:50.239497 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ee7ec-8039-43c7-8c77-e62ca83faec1 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:50.275331 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:50.315663 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0f3c1-b906-4774-a8ec-4805d76956f5 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:50.336889 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ee7ec-8039-43c7-8c77-e62ca83faec1 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:50.348759 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d76382-9958-436e-8ace-eb999c826435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:50.349362 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d76382-9958-436e-8ace-eb999c826435 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:50.349642 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d76382-9958-436e-8ace-eb999c826435 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:50.349916 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d76382-9958-436e-8ace-eb999c826435 None admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:50.350646 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d76382-9958-436e-8ace-eb999c826435 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:50.351139 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d76382-9958-436e-8ace-eb999c826435 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:50.352922 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d76382-9958-436e-8ace-eb999c826435 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:50.355175 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:50.369994 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 199/395] 10.222.0.23 () {56 vars in 1137 bytes} [Wed Nov 2 20:17:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:50.370960 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d76382-9958-436e-8ace-eb999c826435 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:50.376189 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355945b9-a6ad-4f10-b5a5-897e4e4113af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:50.376864 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355945b9-a6ad-4f10-b5a5-897e4e4113af None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:50.377147 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355945b9-a6ad-4f10-b5a5-897e4e4113af None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:50.377423 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355945b9-a6ad-4f10-b5a5-897e4e4113af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:50.387929 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355945b9-a6ad-4f10-b5a5-897e4e4113af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:50.389422 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355945b9-a6ad-4f10-b5a5-897e4e4113af None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:50.404111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-355945b9-a6ad-4f10-b5a5-897e4e4113af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:50.404111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:50.404111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:50.404111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:50.404111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:50.404111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:50.404111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:50.404111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:50.404111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:50.404111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:50.404111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:50.404111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:50.404111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:17:50.404111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:17:50.404111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:17:50.404111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:17:50.405105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:50.405105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:50.405105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:50.405105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:50.405105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:50.405105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:50.405105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:50.405105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:50.405105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:50.405105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:50.405105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:50.405105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:50.405105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:50.405105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:50.405105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:50.405105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:50.405105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:17:50.405943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:17:50.405943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:50.405943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:50.405943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 197/396] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:17:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:50.406150 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355945b9-a6ad-4f10-b5a5-897e4e4113af None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:50.469326 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d76382-9958-436e-8ace-eb999c826435 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:50.486143 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:50.502224 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355945b9-a6ad-4f10-b5a5-897e4e4113af None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:50.503597 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d47d0-3d0a-42df-bbe1-deaf3073d539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:50.504201 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d47d0-3d0a-42df-bbe1-deaf3073d539 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:50.504489 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d47d0-3d0a-42df-bbe1-deaf3073d539 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:50.504795 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d47d0-3d0a-42df-bbe1-deaf3073d539 None admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:50.505489 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d47d0-3d0a-42df-bbe1-deaf3073d539 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:50.505805 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d47d0-3d0a-42df-bbe1-deaf3073d539 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:50.507239 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d47d0-3d0a-42df-bbe1-deaf3073d539 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:50.525671 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 200/397] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Nov 2 20:17:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:50.526448 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d47d0-3d0a-42df-bbe1-deaf3073d539 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:50.544429 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d046bce-8a15-4253-84ac-173622554165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:50.545076 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d046bce-8a15-4253-84ac-173622554165 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:50.545359 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d046bce-8a15-4253-84ac-173622554165 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:50.545633 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d046bce-8a15-4253-84ac-173622554165 None admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:50.546266 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d046bce-8a15-4253-84ac-173622554165 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:50.546570 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d046bce-8a15-4253-84ac-173622554165 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:50.547924 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d046bce-8a15-4253-84ac-173622554165 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:50.560054 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 198/398] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:50.560883 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d046bce-8a15-4253-84ac-173622554165 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:50.587761 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:50.625752 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d47d0-3d0a-42df-bbe1-deaf3073d539 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:50.656712 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d046bce-8a15-4253-84ac-173622554165 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:50.658200 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b963bf-4a33-4a4c-9ff2-1998bbfd9bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:50.659410 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b963bf-4a33-4a4c-9ff2-1998bbfd9bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:50.659410 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b963bf-4a33-4a4c-9ff2-1998bbfd9bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:50.659410 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b963bf-4a33-4a4c-9ff2-1998bbfd9bd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:50.669709 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b963bf-4a33-4a4c-9ff2-1998bbfd9bd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:50.671165 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b963bf-4a33-4a4c-9ff2-1998bbfd9bd3 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:50.686464 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-68b963bf-4a33-4a4c-9ff2-1998bbfd9bd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:50.686464 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:50.686464 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:50.686464 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:50.686464 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:50.686464 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:50.686464 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:50.686464 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:50.686464 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:50.686464 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:50.686464 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:50.686464 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:50.686464 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:17:50.686464 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:17:50.686464 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:17:50.686464 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:17:50.687509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:50.687509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:50.687509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:50.687509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:50.687509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:50.687509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:50.687509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:50.687509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:50.687509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:50.687509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:50.687509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:50.687509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:50.687509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:50.687509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:50.687509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:50.687509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:50.687509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:17:50.688348 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:17:50.688348 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:50.688348 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:50.688348 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 201/399] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:17:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:50.688348 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b963bf-4a33-4a4c-9ff2-1998bbfd9bd3 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:50.694831 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271f629-dc14-4113-9657-9a807a328fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:50.695459 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271f629-dc14-4113-9657-9a807a328fef None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:50.695740 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271f629-dc14-4113-9657-9a807a328fef None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:50.696007 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271f629-dc14-4113-9657-9a807a328fef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:50.705873 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271f629-dc14-4113-9657-9a807a328fef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:50.707301 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271f629-dc14-4113-9657-9a807a328fef None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:50.721491 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:50.721867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-e271f629-dc14-4113-9657-9a807a328fef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:50.721867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:50.721867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:50.721867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:50.721867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:50.721867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:50.721867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:50.721867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:50.721867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:50.721867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:50.721867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:50.721867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:50.721867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:17:50.721867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:17:50.721867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:17:50.721867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:17:50.722943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:50.722943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:50.722943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:50.722943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:50.722943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:50.722943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:50.722943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:50.722943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:50.722943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:50.722943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:50.722943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:50.722943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:50.722943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:50.722943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:50.722943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:50.722943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:50.722943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:17:50.723935 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:17:50.723935 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:50.723935 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:50.723935 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 199/400] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:17:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:50.723935 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271f629-dc14-4113-9657-9a807a328fef None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:50.794281 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b963bf-4a33-4a4c-9ff2-1998bbfd9bd3 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:50.804663 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:50.824035 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271f629-dc14-4113-9657-9a807a328fef None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:50.827408 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be25d6-4fde-4b76-972a-2fa75afd4ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:50.828000 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be25d6-4fde-4b76-972a-2fa75afd4ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:50.828279 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be25d6-4fde-4b76-972a-2fa75afd4ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:50.828578 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be25d6-4fde-4b76-972a-2fa75afd4ea3 None admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:50.829214 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be25d6-4fde-4b76-972a-2fa75afd4ea3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:50.829513 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be25d6-4fde-4b76-972a-2fa75afd4ea3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:50.830884 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be25d6-4fde-4b76-972a-2fa75afd4ea3 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:50.842723 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 202/401] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:50.843488 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be25d6-4fde-4b76-972a-2fa75afd4ea3 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:50.857651 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf3f45-928f-4d95-9a22-baffd61f4898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:50.858311 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf3f45-928f-4d95-9a22-baffd61f4898 None admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:50.858589 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf3f45-928f-4d95-9a22-baffd61f4898 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:50.858866 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf3f45-928f-4d95-9a22-baffd61f4898 None admin] PATH_INFO: `/v3/projects/a144e65ce44c44dc99c07a7f5be303b7/users/f906fd11db004026a78eb3d69fa5b298/roles/59b45b6df1ee465bbbb8bdba4b4e281d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:50.873063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf3f45-928f-4d95-9a22-baffd61f4898 None admin] RBAC: Authorizing `identity:create_grant(project_id=a144e65ce44c44dc99c07a7f5be303b7, user_id=f906fd11db004026a78eb3d69fa5b298, role_id=59b45b6df1ee465bbbb8bdba4b4e281d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:50.874509 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf3f45-928f-4d95-9a22-baffd61f4898 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:50.887465 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 200/402] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Nov 2 20:17:50 2022] PUT /identity/v3/projects/a144e65ce44c44dc99c07a7f5be303b7/users/f906fd11db004026a78eb3d69fa5b298/roles/59b45b6df1ee465bbbb8bdba4b4e281d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:17:50.888248 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf3f45-928f-4d95-9a22-baffd61f4898 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:50.935949 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:50.949967 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be25d6-4fde-4b76-972a-2fa75afd4ea3 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:50.990034 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c7140-ea87-4d5a-9b92-3a6c69114f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:50.990829 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c7140-ea87-4d5a-9b92-3a6c69114f01 None admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:50.991204 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c7140-ea87-4d5a-9b92-3a6c69114f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:50.991574 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c7140-ea87-4d5a-9b92-3a6c69114f01 None admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:50.992326 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c7140-ea87-4d5a-9b92-3a6c69114f01 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:50.993976 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c7140-ea87-4d5a-9b92-3a6c69114f01 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:51.017133 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 203/403] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Nov 2 20:17:50 2022] POST /identity/v3/users => generated 247 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:17:51.018101 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c7140-ea87-4d5a-9b92-3a6c69114f01 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:51.032898 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf3f45-928f-4d95-9a22-baffd61f4898 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:51.078593 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:51.091219 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3dd7b-44ec-430c-91de-bec96f438233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:51.092001 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3dd7b-44ec-430c-91de-bec96f438233 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:51.092376 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3dd7b-44ec-430c-91de-bec96f438233 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:51.094140 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3dd7b-44ec-430c-91de-bec96f438233 None admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:51.094140 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3dd7b-44ec-430c-91de-bec96f438233 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:51.094140 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3dd7b-44ec-430c-91de-bec96f438233 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:51.095502 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3dd7b-44ec-430c-91de-bec96f438233 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:51.111513 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 201/404] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:51.112499 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3dd7b-44ec-430c-91de-bec96f438233 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:51.160088 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c7140-ea87-4d5a-9b92-3a6c69114f01 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:51.199800 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268f1ad-0802-480e-bb5f-90ad84a38371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:51.200414 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268f1ad-0802-480e-bb5f-90ad84a38371 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:51.200724 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268f1ad-0802-480e-bb5f-90ad84a38371 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:51.200998 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268f1ad-0802-480e-bb5f-90ad84a38371 None admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:51.201645 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0268f1ad-0802-480e-bb5f-90ad84a38371 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:51.201947 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0268f1ad-0802-480e-bb5f-90ad84a38371 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:51.203342 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0268f1ad-0802-480e-bb5f-90ad84a38371 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:51.217511 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 204/405] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:51.218551 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268f1ad-0802-480e-bb5f-90ad84a38371 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:51.228756 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:51.245653 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3dd7b-44ec-430c-91de-bec96f438233 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:51.283109 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9853e8-4e94-4695-bb77-c32c49cc9181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:51.283745 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9853e8-4e94-4695-bb77-c32c49cc9181 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:51.284025 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9853e8-4e94-4695-bb77-c32c49cc9181 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:51.284302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9853e8-4e94-4695-bb77-c32c49cc9181 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:51.293148 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9853e8-4e94-4695-bb77-c32c49cc9181 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:51.294771 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9853e8-4e94-4695-bb77-c32c49cc9181 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:51.308966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-5c9853e8-4e94-4695-bb77-c32c49cc9181 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 20:17:51.308966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:51.308966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:51.308966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:51.308966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:51.308966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:51.308966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:51.308966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:51.308966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:51.308966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:51.308966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:51.308966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:51.308966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 20:17:51.308966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 20:17:51.308966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 20:17:51.308966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 20:17:51.310126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:51.310126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:51.310126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 20:17:51.310126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:17:51.310126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 20:17:51.310126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:17:51.310126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:51.310126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:51.310126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:51.310126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:51.310126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:51.310126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:51.310126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:51.310126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:51.310126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:51.310126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:51.310126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:51.310126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:51.311222 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:51.311222 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:51.311222 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 20:17:51.311222 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 20:17:51.311222 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 20:17:51.311222 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 20:17:51.311222 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 20:17:51.311222 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 20:17:51.311222 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 20:17:51.311222 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:51.311222 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 202/406] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Nov 2 20:17:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:51.311857 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9853e8-4e94-4695-bb77-c32c49cc9181 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:51.347559 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268f1ad-0802-480e-bb5f-90ad84a38371 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:51.372749 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:51.404382 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c1576-12e1-49e4-a50b-8883fb83a39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:51.405078 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c1576-12e1-49e4-a50b-8883fb83a39f None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:51.405331 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c1576-12e1-49e4-a50b-8883fb83a39f None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:51.405610 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c1576-12e1-49e4-a50b-8883fb83a39f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:51.418151 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c1576-12e1-49e4-a50b-8883fb83a39f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:51.420712 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c1576-12e1-49e4-a50b-8883fb83a39f None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:51.435746 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-eb0c1576-12e1-49e4-a50b-8883fb83a39f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:17:51.435746 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:51.435746 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:51.435746 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:51.435746 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:51.435746 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:51.435746 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:51.435746 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:51.435746 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:51.435746 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:51.435746 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:51.435746 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:51.435746 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 20:17:51.435746 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 20:17:51.435746 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 20:17:51.436651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 20:17:51.436651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:51.436651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:51.436651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:51.436651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:51.436651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:51.436651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:51.436651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:51.436651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:51.436651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:51.436651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:51.436651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:51.436651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:51.436651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:51.436651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:51.436651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:51.436651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:51.437497 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 20:17:51.437497 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 20:17:51.437497 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 20:17:51.437497 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 20:17:51.437497 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 20:17:51.437497 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 20:17:51.437497 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:17:51.437497 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:51.437497 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 205/407] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:17:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:51.438250 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c1576-12e1-49e4-a50b-8883fb83a39f None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:51.443811 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9853e8-4e94-4695-bb77-c32c49cc9181 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:51.489504 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c2cfd-b6cf-4c2d-8de6-cfcaba36f7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:51.490374 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c2cfd-b6cf-4c2d-8de6-cfcaba36f7e8 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:51.490817 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c2cfd-b6cf-4c2d-8de6-cfcaba36f7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:51.491490 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c2cfd-b6cf-4c2d-8de6-cfcaba36f7e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:51.500096 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c2cfd-b6cf-4c2d-8de6-cfcaba36f7e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:51.502842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c2cfd-b6cf-4c2d-8de6-cfcaba36f7e8 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:51.508142 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:51.518405 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-415c2cfd-b6cf-4c2d-8de6-cfcaba36f7e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:17:51.518405 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:51.518405 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:51.518405 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:51.518405 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:51.518405 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:51.518405 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:51.518405 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:51.518405 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:51.518405 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:51.518405 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:51.518405 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:51.518405 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 20:17:51.518405 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 20:17:51.518405 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 20:17:51.519272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 20:17:51.519272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:51.519272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:51.519272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:51.519272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:51.519272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:51.519272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:51.519272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:51.519272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:51.519272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:51.519272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:51.519272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:51.519272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:51.519272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:51.519272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:51.519272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:51.519272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:51.520110 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 20:17:51.520110 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 20:17:51.520110 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 20:17:51.520110 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 20:17:51.520110 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 20:17:51.520110 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 20:17:51.520110 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:17:51.520110 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:51.521998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 203/408] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:17:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:51.523109 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c2cfd-b6cf-4c2d-8de6-cfcaba36f7e8 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:51.552595 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c1576-12e1-49e4-a50b-8883fb83a39f None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:51.597349 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00355baa-eea1-45d9-98dc-92b2cb404af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:51.598600 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00355baa-eea1-45d9-98dc-92b2cb404af0 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:51.599667 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00355baa-eea1-45d9-98dc-92b2cb404af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:51.600140 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00355baa-eea1-45d9-98dc-92b2cb404af0 None admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:51.601376 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00355baa-eea1-45d9-98dc-92b2cb404af0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:51.602133 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00355baa-eea1-45d9-98dc-92b2cb404af0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:51.605262 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00355baa-eea1-45d9-98dc-92b2cb404af0 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:51.626426 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 206/409] 10.222.0.23 () {56 vars in 1139 bytes} [Wed Nov 2 20:17:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:51.628000 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00355baa-eea1-45d9-98dc-92b2cb404af0 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:51.641579 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c2cfd-b6cf-4c2d-8de6-cfcaba36f7e8 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:51.654669 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:51.686068 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbd47f-174d-48ce-88cc-f69146cb6825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:51.686887 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbd47f-174d-48ce-88cc-f69146cb6825 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:51.687261 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbd47f-174d-48ce-88cc-f69146cb6825 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:51.687660 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbd47f-174d-48ce-88cc-f69146cb6825 None admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:51.688832 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbd47f-174d-48ce-88cc-f69146cb6825 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:51.689237 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbd47f-174d-48ce-88cc-f69146cb6825 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:51.691402 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbd47f-174d-48ce-88cc-f69146cb6825 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:51.712720 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 204/410] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Nov 2 20:17:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:51.713766 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbd47f-174d-48ce-88cc-f69146cb6825 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:51.760956 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00355baa-eea1-45d9-98dc-92b2cb404af0 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:51.787409 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:51.800700 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274660df-a4cd-46ec-8902-965f473c8068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:51.801740 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274660df-a4cd-46ec-8902-965f473c8068 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:51.802237 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274660df-a4cd-46ec-8902-965f473c8068 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:51.802755 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274660df-a4cd-46ec-8902-965f473c8068 None admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:51.803646 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274660df-a4cd-46ec-8902-965f473c8068 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:51.804153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274660df-a4cd-46ec-8902-965f473c8068 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:51.806105 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274660df-a4cd-46ec-8902-965f473c8068 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:51.819472 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 207/411] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Nov 2 20:17:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:51.820540 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274660df-a4cd-46ec-8902-965f473c8068 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:51.826222 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbd47f-174d-48ce-88cc-f69146cb6825 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:51.868353 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b872e21-0fe6-4bd5-a155-309e5d119874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:51.868961 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b872e21-0fe6-4bd5-a155-309e5d119874 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:51.869242 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b872e21-0fe6-4bd5-a155-309e5d119874 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:51.869519 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b872e21-0fe6-4bd5-a155-309e5d119874 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:51.882697 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b872e21-0fe6-4bd5-a155-309e5d119874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:51.884751 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b872e21-0fe6-4bd5-a155-309e5d119874 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:51.904139 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-1b872e21-0fe6-4bd5-a155-309e5d119874 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:51.904139 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:51.904139 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:51.904139 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:51.904139 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:51.904139 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:51.904139 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:51.904139 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:51.904139 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:51.904139 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:51.904139 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:51.904139 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:51.904139 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:17:51.904139 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:17:51.904139 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:17:51.904139 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:17:51.905264 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:51.905264 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:51.905264 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:51.905264 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:51.905264 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:51.905264 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:51.905264 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:51.905264 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:51.905264 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:51.905264 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:51.905264 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:51.905264 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:51.905264 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:51.905264 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:51.905264 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:51.905264 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:51.905264 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:17:51.906093 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:17:51.906093 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:51.906093 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:51.907741 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 205/412] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:17:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:51.909244 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b872e21-0fe6-4bd5-a155-309e5d119874 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:51.940228 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:51.941591 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274660df-a4cd-46ec-8902-965f473c8068 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:51.985599 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084af616-9ae2-400a-8a46-304da06daa15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:51.986264 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084af616-9ae2-400a-8a46-304da06daa15 None admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:51.986548 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084af616-9ae2-400a-8a46-304da06daa15 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:51.987166 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084af616-9ae2-400a-8a46-304da06daa15 None admin] PATH_INFO: `/v3/projects/a144e65ce44c44dc99c07a7f5be303b7/users/3860ca67d4c446ac9d7617fb4608408f/roles/59b45b6df1ee465bbbb8bdba4b4e281d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:52.008213 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084af616-9ae2-400a-8a46-304da06daa15 None admin] RBAC: Authorizing `identity:create_grant(project_id=a144e65ce44c44dc99c07a7f5be303b7, user_id=3860ca67d4c446ac9d7617fb4608408f, role_id=59b45b6df1ee465bbbb8bdba4b4e281d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:52.010520 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084af616-9ae2-400a-8a46-304da06daa15 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:52.027800 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 208/413] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Nov 2 20:17:51 2022] PUT /identity/v3/projects/a144e65ce44c44dc99c07a7f5be303b7/users/3860ca67d4c446ac9d7617fb4608408f/roles/59b45b6df1ee465bbbb8bdba4b4e281d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:17:52.029061 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084af616-9ae2-400a-8a46-304da06daa15 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:52.051601 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b872e21-0fe6-4bd5-a155-309e5d119874 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:52.110705 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:52.122349 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe525e-e6cc-465e-8a07-b9b6130c698f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:52.123367 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe525e-e6cc-465e-8a07-b9b6130c698f None admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:52.123841 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe525e-e6cc-465e-8a07-b9b6130c698f None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:52.124328 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe525e-e6cc-465e-8a07-b9b6130c698f None admin] PATH_INFO: `/v3/projects/a144e65ce44c44dc99c07a7f5be303b7/users/62ca656e59ff46b08661385d8ec79846/roles/59b45b6df1ee465bbbb8bdba4b4e281d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:52.162011 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe525e-e6cc-465e-8a07-b9b6130c698f None admin] RBAC: Authorizing `identity:create_grant(project_id=a144e65ce44c44dc99c07a7f5be303b7, user_id=62ca656e59ff46b08661385d8ec79846, role_id=59b45b6df1ee465bbbb8bdba4b4e281d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:52.163485 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe525e-e6cc-465e-8a07-b9b6130c698f None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:52.194337 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 206/414] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Nov 2 20:17:51 2022] PUT /identity/v3/projects/a144e65ce44c44dc99c07a7f5be303b7/users/62ca656e59ff46b08661385d8ec79846/roles/59b45b6df1ee465bbbb8bdba4b4e281d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:17:52.213437 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084af616-9ae2-400a-8a46-304da06daa15 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:52.254725 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08df183-e49a-4645-90a2-b9778932e4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:52.255555 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08df183-e49a-4645-90a2-b9778932e4cb None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:52.255843 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08df183-e49a-4645-90a2-b9778932e4cb None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:52.256121 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08df183-e49a-4645-90a2-b9778932e4cb None admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:52.256864 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08df183-e49a-4645-90a2-b9778932e4cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:52.257174 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08df183-e49a-4645-90a2-b9778932e4cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:52.259269 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08df183-e49a-4645-90a2-b9778932e4cb None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:52.273792 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 209/415] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:17:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:52.279615 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe525e-e6cc-465e-8a07-b9b6130c698f None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:52.362922 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:52.397716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe525e-e6cc-465e-8a07-b9b6130c698f None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:52.435948 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0feeb5-d7f0-41fe-871c-60e2dc4f5c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:52.436618 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0feeb5-d7f0-41fe-871c-60e2dc4f5c57 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:52.436907 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0feeb5-d7f0-41fe-871c-60e2dc4f5c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:52.437233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0feeb5-d7f0-41fe-871c-60e2dc4f5c57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:52.444399 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0feeb5-d7f0-41fe-871c-60e2dc4f5c57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:52.445917 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0feeb5-d7f0-41fe-871c-60e2dc4f5c57 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:52.457824 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-0f0feeb5-d7f0-41fe-871c-60e2dc4f5c57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:17:52.457824 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:52.457824 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:52.457824 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:52.457824 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:52.457824 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:52.457824 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:52.457824 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:52.457824 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:52.457824 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:52.457824 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:52.457824 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:52.457824 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 20:17:52.457824 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 20:17:52.457824 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 20:17:52.458673 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 20:17:52.458673 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:52.458673 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:52.458673 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:52.458673 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:52.458673 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:52.458673 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:52.458673 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:52.458673 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:52.458673 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:52.458673 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:52.458673 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:52.458673 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:52.458673 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:52.458673 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:52.458673 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:52.458673 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:52.459499 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 20:17:52.459499 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 20:17:52.459499 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 20:17:52.459499 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 20:17:52.459499 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 20:17:52.459499 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 20:17:52.459499 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:17:52.459499 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:52.459499 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 207/416] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:17:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 20:17:52.465121 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08df183-e49a-4645-90a2-b9778932e4cb None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:52.568919 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:52.577621 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08df183-e49a-4645-90a2-b9778932e4cb None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:52.622202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7887c8bc-9165-4d34-a679-49eaad7e1115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:52.622827 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887c8bc-9165-4d34-a679-49eaad7e1115 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:52.623107 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887c8bc-9165-4d34-a679-49eaad7e1115 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:52.623380 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887c8bc-9165-4d34-a679-49eaad7e1115 None admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:52.624077 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7887c8bc-9165-4d34-a679-49eaad7e1115 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:52.624382 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7887c8bc-9165-4d34-a679-49eaad7e1115 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:52.625881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7887c8bc-9165-4d34-a679-49eaad7e1115 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:52.646326 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 210/417] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Nov 2 20:17:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:52.653669 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0feeb5-d7f0-41fe-871c-60e2dc4f5c57 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:52.761957 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0feeb5-d7f0-41fe-871c-60e2dc4f5c57 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:52.791979 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:52.797272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b91343-d339-417d-b9ec-54682ecb5496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:52.798131 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b91343-d339-417d-b9ec-54682ecb5496 None admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:52.798417 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b91343-d339-417d-b9ec-54682ecb5496 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:52.798693 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b91343-d339-417d-b9ec-54682ecb5496 None admin] PATH_INFO: `/v3/projects/a144e65ce44c44dc99c07a7f5be303b7/users/fdb57cba49ce43ad95096047859dfe1d/roles/59b45b6df1ee465bbbb8bdba4b4e281d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:52.815254 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b91343-d339-417d-b9ec-54682ecb5496 None admin] RBAC: Authorizing `identity:create_grant(project_id=a144e65ce44c44dc99c07a7f5be303b7, user_id=fdb57cba49ce43ad95096047859dfe1d, role_id=59b45b6df1ee465bbbb8bdba4b4e281d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:52.816730 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b91343-d339-417d-b9ec-54682ecb5496 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:52.832838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 208/418] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Nov 2 20:17:52 2022] PUT /identity/v3/projects/a144e65ce44c44dc99c07a7f5be303b7/users/fdb57cba49ce43ad95096047859dfe1d/roles/59b45b6df1ee465bbbb8bdba4b4e281d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:17:53.298210 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71a4ac-e4d5-4503-86c6-b06d8c6b651e None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:53.298607 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71a4ac-e4d5-4503-86c6-b06d8c6b651e None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:53.298773 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71a4ac-e4d5-4503-86c6-b06d8c6b651e None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:53.300312 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 211/419] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:53.306057 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056eb17-b2fd-494e-8d99-63a644d017fa None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:53.306343 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056eb17-b2fd-494e-8d99-63a644d017fa None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:53.306625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056eb17-b2fd-494e-8d99-63a644d017fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:53.333488 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-2056eb17-b2fd-494e-8d99-63a644d017fa None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:53.334675 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-2056eb17-b2fd-494e-8d99-63a644d017fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:53.434470 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 209/420] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 20:17:53.570641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e2f92-5932-4e51-9d10-3c5c6216f256 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:53.571220 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e2f92-5932-4e51-9d10-3c5c6216f256 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:53.571297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e2f92-5932-4e51-9d10-3c5c6216f256 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:53.572718 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 212/421] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:53.578125 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e62002-204f-4f34-827f-5ad59e772c5f None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:53.578419 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e62002-204f-4f34-827f-5ad59e772c5f None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:53.578694 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e62002-204f-4f34-827f-5ad59e772c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:53.601577 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-c3e62002-204f-4f34-827f-5ad59e772c5f None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:53.602811 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-c3e62002-204f-4f34-827f-5ad59e772c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:53.692899 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 210/422] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:53.875339 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e2f92-5932-4e51-9d10-3c5c6216f256 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:54.013209 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e2f92-5932-4e51-9d10-3c5c6216f256 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:54.061777 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4cfa69-50dc-4f45-aeca-434517b59da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:54.062767 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cfa69-50dc-4f45-aeca-434517b59da7 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:54.063244 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cfa69-50dc-4f45-aeca-434517b59da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:54.063739 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cfa69-50dc-4f45-aeca-434517b59da7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:54.078270 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4cfa69-50dc-4f45-aeca-434517b59da7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:54.083324 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-ba4cfa69-50dc-4f45-aeca-434517b59da7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 20:17:54.083324 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:54.083324 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:54.083324 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:54.083324 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:54.083324 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:54.083324 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:54.083324 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:54.083324 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:54.083324 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:54.083324 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:54.083324 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:54.083324 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:54.083324 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:54.083324 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:54.083324 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:54.084202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:54.084202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:54.084202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:54.084202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:54.084202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:54.084202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:54.084202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:54.084202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:54.084202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:54.084202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:54.084202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:54.084202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:54.084202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:54.084202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:54.084202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:54.084202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:54.085044 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:54.085044 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:54.085044 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:54.085044 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:54.085044 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:54.085044 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:54.085044 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:54.085044 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:54.085044 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:54.085044 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:54.085044 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 20:17:54.085044 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:54.087589 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 213/423] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Nov 2 20:17:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:54.093178 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e62002-204f-4f34-827f-5ad59e772c5f None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:54.174179 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:54.187534 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4cfa69-50dc-4f45-aeca-434517b59da7 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:54.205520 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:54.284341 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e62002-204f-4f34-827f-5ad59e772c5f None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:54.297967 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4cfa69-50dc-4f45-aeca-434517b59da7 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:54.334627 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135ecd7-bd61-40f1-8add-4e5f4413215c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:54.335387 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135ecd7-bd61-40f1-8add-4e5f4413215c None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:54.335732 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135ecd7-bd61-40f1-8add-4e5f4413215c None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:54.336181 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135ecd7-bd61-40f1-8add-4e5f4413215c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:54.347185 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb6eb5-1394-429c-866f-4ceb8f9453bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:54.348107 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb6eb5-1394-429c-866f-4ceb8f9453bb None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:54.348610 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb6eb5-1394-429c-866f-4ceb8f9453bb None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:54.349084 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb6eb5-1394-429c-866f-4ceb8f9453bb None admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:54.349948 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb6eb5-1394-429c-866f-4ceb8f9453bb None admin] RBAC: Adding query filter params (name=service) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:54.350446 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb6eb5-1394-429c-866f-4ceb8f9453bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:54.352021 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb6eb5-1394-429c-866f-4ceb8f9453bb None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:54.360573 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135ecd7-bd61-40f1-8add-4e5f4413215c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:54.361069 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 211/424] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Nov 2 20:17:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:54.368611 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-d135ecd7-bd61-40f1-8add-4e5f4413215c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 20:17:54.368611 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:54.368611 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:54.368611 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:54.368611 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:54.368611 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:54.368611 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:54.368611 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:54.368611 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:54.368611 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:54.368611 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:54.368611 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:54.368611 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:54.368611 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:54.368611 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:54.368611 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:54.369498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:54.369498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:54.369498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:54.369498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:54.369498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:54.369498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:54.369498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:54.369498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:54.369498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:54.369498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:54.369498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:54.369498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:54.369498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:54.369498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:54.369498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:54.369498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:54.370282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:54.370282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:54.370282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:54.370282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:54.370282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:54.370282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:54.370282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:54.370282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:54.370282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:54.370282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:54.370282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 20:17:54.370282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:54.370282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 214/425] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Nov 2 20:17:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:54.370944 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb6eb5-1394-429c-866f-4ceb8f9453bb None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:54.376577 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135ecd7-bd61-40f1-8add-4e5f4413215c None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:54.459077 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:54.507296 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135ecd7-bd61-40f1-8add-4e5f4413215c None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:54.554424 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb6eb5-1394-429c-866f-4ceb8f9453bb None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:54.557689 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:54.597045 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750df4e-1f1a-483d-9a19-96b89ae458ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:54.598171 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750df4e-1f1a-483d-9a19-96b89ae458ef None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:54.598593 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750df4e-1f1a-483d-9a19-96b89ae458ef None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:54.599007 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750df4e-1f1a-483d-9a19-96b89ae458ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:54.601937 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a34be3-f702-429d-b421-34be39ef518e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:54.603093 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a34be3-f702-429d-b421-34be39ef518e None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:54.603374 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a34be3-f702-429d-b421-34be39ef518e None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:54.603648 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a34be3-f702-429d-b421-34be39ef518e None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:54.604337 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a34be3-f702-429d-b421-34be39ef518e None admin] RBAC: Adding query filter params (name=service) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:54.604676 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a34be3-f702-429d-b421-34be39ef518e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:54.606100 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a34be3-f702-429d-b421-34be39ef518e None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:54.613691 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a750df4e-1f1a-483d-9a19-96b89ae458ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:54.615479 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a750df4e-1f1a-483d-9a19-96b89ae458ef None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:54.635746 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 215/426] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Nov 2 20:17:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:54.637560 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-a750df4e-1f1a-483d-9a19-96b89ae458ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:54.637560 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:54.637560 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:54.637560 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:54.637560 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:54.637560 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:54.637560 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:54.637560 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:54.637560 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:54.637560 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:54.637560 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:54.637560 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:54.637560 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:17:54.637560 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:17:54.637560 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:17:54.637560 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:17:54.638600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:54.638600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:54.638600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:54.638600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:54.638600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:54.638600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:54.638600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:54.638600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:54.638600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:54.638600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:54.638600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:54.638600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:54.638600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:54.638600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:54.638600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:54.638600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:54.638600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:17:54.639440 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:17:54.639440 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:54.639440 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:54.641538 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 212/427] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:17:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:54.647311 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a34be3-f702-429d-b421-34be39ef518e None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:54.648255 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750df4e-1f1a-483d-9a19-96b89ae458ef None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:54.793789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750df4e-1f1a-483d-9a19-96b89ae458ef None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:54.800328 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a34be3-f702-429d-b421-34be39ef518e None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:54.833311 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3a554-e19b-4798-a65a-12de1ea0dffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:54.833973 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3a554-e19b-4798-a65a-12de1ea0dffc None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:54.834252 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3a554-e19b-4798-a65a-12de1ea0dffc None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:54.834525 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3a554-e19b-4798-a65a-12de1ea0dffc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:54.842105 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd615319-1b98-4579-915d-ef89c21de560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:54.842979 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd615319-1b98-4579-915d-ef89c21de560 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:54.843573 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd615319-1b98-4579-915d-ef89c21de560 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:54.844041 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd615319-1b98-4579-915d-ef89c21de560 None admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:54.844911 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd615319-1b98-4579-915d-ef89c21de560 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:54.845474 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd615319-1b98-4579-915d-ef89c21de560 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:54.847035 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd615319-1b98-4579-915d-ef89c21de560 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:54.847293 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3a554-e19b-4798-a65a-12de1ea0dffc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:54.848991 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3a554-e19b-4798-a65a-12de1ea0dffc None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:54.850093 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:54.861922 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 216/428] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:54.863458 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4895058-3285-4b96-91f6-3fd8144728d9 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:54.863963 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4895058-3285-4b96-91f6-3fd8144728d9 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:54.864442 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4895058-3285-4b96-91f6-3fd8144728d9 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:54.865855 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 217/429] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:54.870833 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4895058-3285-4b96-91f6-3fd8144728d9 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:54.872388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-7be3a554-e19b-4798-a65a-12de1ea0dffc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:54.872388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:54.872388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:54.872388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:54.872388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:54.872388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:54.872388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:54.872388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:54.872388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:54.872388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:54.872388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:54.872388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:54.872388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:17:54.872388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:17:54.872388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:17:54.872388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:17:54.873491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:54.873491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:54.873491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:54.873491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:54.873491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:54.873491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:54.873491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:54.873491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:54.873491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:54.873491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:54.873491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:54.873491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:54.873491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:54.873491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:54.873491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:54.873491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:54.873491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:17:54.874540 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:17:54.874540 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:54.874540 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:54.876619 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 213/430] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:17:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:54.877956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ead05-db20-4d59-8efa-a812c88f0aa3 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:54.878382 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ead05-db20-4d59-8efa-a812c88f0aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:54.879583 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ead05-db20-4d59-8efa-a812c88f0aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:54.901384 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-612ead05-db20-4d59-8efa-a812c88f0aa3 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:54.902983 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-612ead05-db20-4d59-8efa-a812c88f0aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:54.905238 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:54.987237 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 214/431] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:54.988954 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ead05-db20-4d59-8efa-a812c88f0aa3 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:54.995994 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4895058-3285-4b96-91f6-3fd8144728d9 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:55.033439 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58cd1e-622a-4c50-be89-21b115e04655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:55.034063 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58cd1e-622a-4c50-be89-21b115e04655 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:55.034342 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58cd1e-622a-4c50-be89-21b115e04655 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:55.034613 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58cd1e-622a-4c50-be89-21b115e04655 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:55.043598 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58cd1e-622a-4c50-be89-21b115e04655 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:55.045383 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58cd1e-622a-4c50-be89-21b115e04655 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:55.058461 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-fc58cd1e-622a-4c50-be89-21b115e04655 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 20:17:55.058461 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:55.058461 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:55.058461 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:55.058461 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:55.058461 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:55.058461 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:55.058461 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:55.058461 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:55.058461 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:55.058461 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:55.058461 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:55.058461 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 20:17:55.058461 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 20:17:55.058461 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 20:17:55.058461 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 20:17:55.059365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:55.059365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:55.059365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 20:17:55.059365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:17:55.059365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 20:17:55.059365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:17:55.059365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:55.059365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:55.059365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:55.059365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:55.059365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:55.059365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:55.059365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:55.059365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:55.059365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:55.059365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:55.059365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:55.059365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:55.060253 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:55.060253 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:55.060253 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 20:17:55.060253 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 20:17:55.060253 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 20:17:55.060253 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 20:17:55.060253 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 20:17:55.060253 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 20:17:55.060253 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 20:17:55.060253 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:55.060253 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 218/432] 10.222.0.23 () {56 vars in 1093 bytes} [Wed Nov 2 20:17:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:55.065448 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58cd1e-622a-4c50-be89-21b115e04655 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:55.134208 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ead05-db20-4d59-8efa-a812c88f0aa3 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:55.152284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:55.182507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f1490-ee68-4f4c-a048-fc5d9676ec9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:55.183464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f1490-ee68-4f4c-a048-fc5d9676ec9b None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:55.184009 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f1490-ee68-4f4c-a048-fc5d9676ec9b None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:55.184284 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f1490-ee68-4f4c-a048-fc5d9676ec9b None admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:55.184992 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f1490-ee68-4f4c-a048-fc5d9676ec9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:55.185304 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f1490-ee68-4f4c-a048-fc5d9676ec9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:55.187403 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f1490-ee68-4f4c-a048-fc5d9676ec9b None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:55.195701 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:55.204327 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 215/433] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:55.205946 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a507c1-48bb-4bd2-bba5-4c6bc0e45016 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:55.206238 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a507c1-48bb-4bd2-bba5-4c6bc0e45016 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:55.206569 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a507c1-48bb-4bd2-bba5-4c6bc0e45016 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:55.208391 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 216/434] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:55.209949 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58cd1e-622a-4c50-be89-21b115e04655 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:55.214166 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a507c1-48bb-4bd2-bba5-4c6bc0e45016 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:55.254081 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6c663-58c4-4882-9503-bec98295971b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:55.255271 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6c663-58c4-4882-9503-bec98295971b None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:55.255831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6c663-58c4-4882-9503-bec98295971b None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:55.256376 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6c663-58c4-4882-9503-bec98295971b None admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:55.257493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6c663-58c4-4882-9503-bec98295971b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:55.257993 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6c663-58c4-4882-9503-bec98295971b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:55.261165 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6c663-58c4-4882-9503-bec98295971b None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:55.286070 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 219/435] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Nov 2 20:17:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:55.287834 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d988b62-2768-445e-b6bb-1cdd50c50520 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:55.288338 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d988b62-2768-445e-b6bb-1cdd50c50520 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:55.288825 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d988b62-2768-445e-b6bb-1cdd50c50520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:55.308466 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-7d988b62-2768-445e-b6bb-1cdd50c50520 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:55.310008 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-7d988b62-2768-445e-b6bb-1cdd50c50520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:55.347759 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a507c1-48bb-4bd2-bba5-4c6bc0e45016 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:55.388586 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 220/436] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:55.388586 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d988b62-2768-445e-b6bb-1cdd50c50520 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:55.391947 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20a849-e815-4c15-a0ee-895e2c78ccac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:55.393115 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20a849-e815-4c15-a0ee-895e2c78ccac None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:55.393430 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20a849-e815-4c15-a0ee-895e2c78ccac None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:55.393679 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20a849-e815-4c15-a0ee-895e2c78ccac None admin] PATH_INFO: `/v3/users/swift` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:55.402939 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d20a849-e815-4c15-a0ee-895e2c78ccac None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:55.404748 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d20a849-e815-4c15-a0ee-895e2c78ccac None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:55.415882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-0d20a849-e815-4c15-a0ee-895e2c78ccac None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 20:17:55.415882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:55.415882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:55.415882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:55.415882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:55.415882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:55.415882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:55.415882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:55.415882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:55.415882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:55.415882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:55.415882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:55.415882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 20:17:55.415882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 20:17:55.415882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 20:17:55.415882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 20:17:55.416807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:55.416807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:55.416807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 20:17:55.416807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:17:55.416807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 20:17:55.416807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:17:55.416807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:55.416807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:55.416807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:55.416807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:55.416807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:55.416807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:55.416807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:55.416807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:55.416807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:55.416807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:55.416807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:55.416807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:55.417714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:55.417714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:55.417714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 20:17:55.417714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 20:17:55.417714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 20:17:55.417714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 20:17:55.417714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 20:17:55.417714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 20:17:55.417714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Nov 02 20:17:55.417714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:55.417714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 217/437] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Nov 2 20:17:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:55.421623 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20a849-e815-4c15-a0ee-895e2c78ccac None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:55.434084 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:55.483781 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:55.493703 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d988b62-2768-445e-b6bb-1cdd50c50520 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:55.530408 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20a849-e815-4c15-a0ee-895e2c78ccac None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:55.532248 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d768857-fa42-4dcb-8441-ce8ce880456f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:55.533294 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d768857-fa42-4dcb-8441-ce8ce880456f None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:55.533294 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d768857-fa42-4dcb-8441-ce8ce880456f None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:55.533483 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d768857-fa42-4dcb-8441-ce8ce880456f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:55.566584 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c2c58-7f05-4284-b4a9-d92d1032bc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:55.567381 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c2c58-7f05-4284-b4a9-d92d1032bc10 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:55.567672 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c2c58-7f05-4284-b4a9-d92d1032bc10 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:55.567979 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c2c58-7f05-4284-b4a9-d92d1032bc10 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:55.579635 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c2c58-7f05-4284-b4a9-d92d1032bc10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:55.584898 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-a54c2c58-7f05-4284-b4a9-d92d1032bc10 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 20:17:55.584898 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:55.584898 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:55.584898 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:55.584898 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:55.584898 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:55.584898 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:55.584898 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:55.584898 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:55.584898 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:55.584898 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:55.584898 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:55.584898 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:55.584898 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:55.584898 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:55.584898 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:55.585800 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:55.585800 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:55.585800 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:55.585800 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:55.585800 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:55.585800 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:55.585800 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:55.585800 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:55.585800 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:55.585800 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:55.585800 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:55.585800 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:55.585800 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:55.585800 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:55.585800 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:55.585800 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:55.586649 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:55.586649 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:55.586649 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:55.586649 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:55.586649 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:55.586649 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:55.586649 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:55.586649 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:55.586649 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:55.586649 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:55.586649 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 20:17:55.586649 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:55.586649 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 218/438] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Nov 2 20:17:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:55.588197 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf73bc1-dca5-42e5-8d30-38543e8770c0 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:55.588197 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf73bc1-dca5-42e5-8d30-38543e8770c0 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:55.588197 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf73bc1-dca5-42e5-8d30-38543e8770c0 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:55.589442 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 219/439] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:55.594061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf73bc1-dca5-42e5-8d30-38543e8770c0 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:55.607667 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d768857-fa42-4dcb-8441-ce8ce880456f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:55.609234 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d768857-fa42-4dcb-8441-ce8ce880456f None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:55.656892 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:55.701297 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf73bc1-dca5-42e5-8d30-38543e8770c0 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:55.713017 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 221/440] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Nov 2 20:17:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 20:17:55.713863 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d768857-fa42-4dcb-8441-ce8ce880456f None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:55.724603 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:55.741553 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c814e5e-f787-46f4-aedf-f8773218c556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:55.742161 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c814e5e-f787-46f4-aedf-f8773218c556 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:55.742446 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c814e5e-f787-46f4-aedf-f8773218c556 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:55.742723 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c814e5e-f787-46f4-aedf-f8773218c556 None admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:55.743968 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c814e5e-f787-46f4-aedf-f8773218c556 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:55.744275 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c814e5e-f787-46f4-aedf-f8773218c556 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:55.745776 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c814e5e-f787-46f4-aedf-f8773218c556 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:55.762898 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 220/441] 10.222.0.23 () {56 vars in 1135 bytes} [Wed Nov 2 20:17:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:55.764062 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b13e41-5a85-4c3e-a807-cd05a144f42d None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:55.764349 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b13e41-5a85-4c3e-a807-cd05a144f42d None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:55.764663 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b13e41-5a85-4c3e-a807-cd05a144f42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:55.783006 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-f5b13e41-5a85-4c3e-a807-cd05a144f42d None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:55.784188 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-f5b13e41-5a85-4c3e-a807-cd05a144f42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:55.811045 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d768857-fa42-4dcb-8441-ce8ce880456f None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:55.844665 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1a116-8310-4df1-8ef6-f4b9e53d0500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:55.845385 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1a116-8310-4df1-8ef6-f4b9e53d0500 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:55.845668 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1a116-8310-4df1-8ef6-f4b9e53d0500 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:55.845945 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1a116-8310-4df1-8ef6-f4b9e53d0500 None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:55.846602 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1a116-8310-4df1-8ef6-f4b9e53d0500 None admin] RBAC: Adding query filter params (name=service) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:55.846907 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1a116-8310-4df1-8ef6-f4b9e53d0500 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:55.848294 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1a116-8310-4df1-8ef6-f4b9e53d0500 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:55.849278 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 221/442] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:17:55.860727 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b13e41-5a85-4c3e-a807-cd05a144f42d None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:55.860825 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 222/443] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Nov 2 20:17:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:55.860825 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1a116-8310-4df1-8ef6-f4b9e53d0500 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:55.867596 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:55.964444 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b13e41-5a85-4c3e-a807-cd05a144f42d None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:55.966737 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1a116-8310-4df1-8ef6-f4b9e53d0500 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:55.972286 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:56.000746 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3bc33-10f7-4433-8c3f-badcb537cd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:56.001374 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3bc33-10f7-4433-8c3f-badcb537cd23 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:56.001655 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3bc33-10f7-4433-8c3f-badcb537cd23 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:56.001751 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ee4d8-48e0-4685-bc35-c364f4a879d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:56.001932 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3bc33-10f7-4433-8c3f-badcb537cd23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:56.002294 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ee4d8-48e0-4685-bc35-c364f4a879d3 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:56.002578 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ee4d8-48e0-4685-bc35-c364f4a879d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:56.002854 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ee4d8-48e0-4685-bc35-c364f4a879d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:56.012164 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3bc33-10f7-4433-8c3f-badcb537cd23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:56.014032 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ee4d8-48e0-4685-bc35-c364f4a879d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:56.015475 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ee4d8-48e0-4685-bc35-c364f4a879d3 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:56.016953 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-f8b3bc33-10f7-4433-8c3f-badcb537cd23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 20:17:56.016953 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:56.016953 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:56.016953 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:56.016953 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:56.016953 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:56.016953 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:56.016953 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:56.016953 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:56.016953 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:56.016953 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:56.016953 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:56.016953 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:56.016953 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:56.016953 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:56.016953 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:56.018003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:56.018003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:56.018003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:56.018003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:56.018003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:56.018003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:56.018003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:56.018003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:56.018003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:56.018003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:56.018003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:56.018003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:56.018003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:56.018003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:56.018003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:56.018003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:56.019350 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:56.019350 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:56.019350 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:56.019350 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:56.019350 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:56.019350 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:56.019350 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:56.019350 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:56.019350 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:56.019350 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:56.019350 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 20:17:56.019350 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:56.022830 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 222/444] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Nov 2 20:17:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:56.023653 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3bc33-10f7-4433-8c3f-badcb537cd23 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:56.032143 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-670ee4d8-48e0-4685-bc35-c364f4a879d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:56.032143 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:56.032143 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:56.032143 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:56.032143 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:56.032143 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:56.032143 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:56.032143 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:56.032143 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:56.032143 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:56.032143 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:56.032143 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:56.032143 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:17:56.032143 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:17:56.032143 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:17:56.032143 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:17:56.033096 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:56.033096 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:56.033096 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:56.033096 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:56.033096 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:56.033096 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:56.033096 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:56.033096 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:56.033096 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:56.033096 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:56.033096 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:56.033096 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:56.033096 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:56.033096 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:56.033096 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:56.033096 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:56.033096 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:17:56.033926 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:17:56.033926 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:56.033926 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:56.033926 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 223/445] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:17:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:56.035027 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ee4d8-48e0-4685-bc35-c364f4a879d3 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:56.095143 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:56.134478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3bc33-10f7-4433-8c3f-badcb537cd23 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:56.140185 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ee4d8-48e0-4685-bc35-c364f4a879d3 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:56.168350 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26594b-b677-4845-be3f-0f62ca2175b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:56.169020 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26594b-b677-4845-be3f-0f62ca2175b9 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:56.169529 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26594b-b677-4845-be3f-0f62ca2175b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:56.169814 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26594b-b677-4845-be3f-0f62ca2175b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:56.173187 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb573ed1-b065-43cb-a46a-50c8eaec3fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:56.173884 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb573ed1-b065-43cb-a46a-50c8eaec3fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:56.174201 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb573ed1-b065-43cb-a46a-50c8eaec3fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:56.174517 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb573ed1-b065-43cb-a46a-50c8eaec3fb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:56.180139 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a26594b-b677-4845-be3f-0f62ca2175b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:56.181648 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a26594b-b677-4845-be3f-0f62ca2175b9 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:56.185433 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb573ed1-b065-43cb-a46a-50c8eaec3fb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:56.186860 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb573ed1-b065-43cb-a46a-50c8eaec3fb5 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:56.196955 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-0a26594b-b677-4845-be3f-0f62ca2175b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:56.196955 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:56.196955 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:56.196955 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:56.196955 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:56.196955 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:56.196955 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:56.196955 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:56.196955 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:56.196955 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:56.196955 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:56.196955 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:56.196955 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:17:56.196955 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:17:56.196955 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:17:56.196955 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:17:56.198035 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:56.198035 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:56.198035 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:56.198035 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:56.198035 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:56.198035 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:56.198035 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:56.198035 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:56.198035 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:56.198035 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:56.198035 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:56.198035 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:56.198035 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:56.198035 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:56.198035 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:56.198035 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:56.198035 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:17:56.198882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:17:56.198882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:56.198882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:56.198882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 223/446] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:17:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:56.199105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26594b-b677-4845-be3f-0f62ca2175b9 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:56.201087 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-eb573ed1-b065-43cb-a46a-50c8eaec3fb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:56.201087 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:56.201087 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:56.201087 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:56.201087 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:56.201087 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:56.201087 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:56.201087 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:56.201087 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:56.201087 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:56.201087 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:56.201087 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:56.201087 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:17:56.201087 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:17:56.201087 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:17:56.201087 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:17:56.201914 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:56.201914 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:56.201914 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:56.201914 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:56.201914 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:56.201914 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:56.201914 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:56.201914 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:56.201914 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:56.201914 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:56.201914 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:56.201914 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:56.201914 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:56.201914 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:56.201914 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:56.201914 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:56.201914 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:17:56.207452 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:17:56.207452 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:56.207452 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:56.207452 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 224/447] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:17:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:56.207452 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb573ed1-b065-43cb-a46a-50c8eaec3fb5 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:56.224022 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:56.299865 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb573ed1-b065-43cb-a46a-50c8eaec3fb5 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:56.302800 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26594b-b677-4845-be3f-0f62ca2175b9 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:56.310740 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:56.334938 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480a860-85e9-47ae-a2ec-c21504146184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:56.335541 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480a860-85e9-47ae-a2ec-c21504146184 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:56.335822 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480a860-85e9-47ae-a2ec-c21504146184 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:56.336096 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480a860-85e9-47ae-a2ec-c21504146184 None admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:56.336807 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480a860-85e9-47ae-a2ec-c21504146184 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:56.337003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715b463-c4d6-473d-8a94-6ac66486dff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:56.337129 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480a860-85e9-47ae-a2ec-c21504146184 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:56.337604 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715b463-c4d6-473d-8a94-6ac66486dff2 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:56.337890 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715b463-c4d6-473d-8a94-6ac66486dff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:56.338169 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715b463-c4d6-473d-8a94-6ac66486dff2 None admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:56.338534 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480a860-85e9-47ae-a2ec-c21504146184 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:56.338829 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715b463-c4d6-473d-8a94-6ac66486dff2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:56.339138 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715b463-c4d6-473d-8a94-6ac66486dff2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:56.340480 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715b463-c4d6-473d-8a94-6ac66486dff2 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:56.348275 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 224/448] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Nov 2 20:17:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:56.349028 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715b463-c4d6-473d-8a94-6ac66486dff2 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:56.355440 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 225/449] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:56.355440 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480a860-85e9-47ae-a2ec-c21504146184 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:56.428167 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:56.448411 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715b463-c4d6-473d-8a94-6ac66486dff2 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:56.455562 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480a860-85e9-47ae-a2ec-c21504146184 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:56.483330 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2bf19-321f-4fb1-8628-eef9ddad5e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:56.483948 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2bf19-321f-4fb1-8628-eef9ddad5e76 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:56.484225 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2bf19-321f-4fb1-8628-eef9ddad5e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:56.484499 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2bf19-321f-4fb1-8628-eef9ddad5e76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:56.489037 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e224bde-d732-4b55-9e58-bc2299d91d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:56.489631 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e224bde-d732-4b55-9e58-bc2299d91d45 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:56.489913 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e224bde-d732-4b55-9e58-bc2299d91d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:56.490186 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e224bde-d732-4b55-9e58-bc2299d91d45 None admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:56.490819 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e224bde-d732-4b55-9e58-bc2299d91d45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:56.491119 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e224bde-d732-4b55-9e58-bc2299d91d45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:56.492477 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e224bde-d732-4b55-9e58-bc2299d91d45 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:56.495905 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2bf19-321f-4fb1-8628-eef9ddad5e76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:17:56.502784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-0ea2bf19-321f-4fb1-8628-eef9ddad5e76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 20:17:56.502784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:56.502784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:56.502784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:56.502784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:56.502784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:56.502784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:56.502784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:56.502784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:56.502784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:56.502784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:56.502784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:56.502784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:17:56.502784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:17:56.502784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:17:56.502784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:17:56.503928 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:17:56.503928 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:17:56.503928 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:17:56.503928 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:17:56.503928 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:56.503928 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:56.503928 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:56.503928 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:56.503928 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:56.503928 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:56.503928 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:56.503928 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:56.503928 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:56.503928 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:56.503928 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:56.503928 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:56.504880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:56.504880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:56.504880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:56.504880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:56.504880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:17:56.504880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:17:56.504880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:17:56.504880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:17:56.504880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:17:56.504880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:17:56.504880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 20:17:56.504880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:56.508718 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 226/450] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:56.508832 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 225/451] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Nov 2 20:17:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:56.509293 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e224bde-d732-4b55-9e58-bc2299d91d45 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:56.509416 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2bf19-321f-4fb1-8628-eef9ddad5e76 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:56.539579 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:56.608517 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e224bde-d732-4b55-9e58-bc2299d91d45 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:56.609107 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2bf19-321f-4fb1-8628-eef9ddad5e76 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:56.641455 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bba17-f013-4344-8ef1-2b35eb8cef7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:56.641686 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64d60f-917e-48e9-8c10-a2d4a0427ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:56.642058 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bba17-f013-4344-8ef1-2b35eb8cef7f None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:56.642345 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bba17-f013-4344-8ef1-2b35eb8cef7f None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:56.642625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bba17-f013-4344-8ef1-2b35eb8cef7f None admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:56.643264 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4bba17-f013-4344-8ef1-2b35eb8cef7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:56.643354 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64d60f-917e-48e9-8c10-a2d4a0427ccf None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:56.643580 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4bba17-f013-4344-8ef1-2b35eb8cef7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:56.643676 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64d60f-917e-48e9-8c10-a2d4a0427ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:56.643854 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64d60f-917e-48e9-8c10-a2d4a0427ccf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:56.645006 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4bba17-f013-4344-8ef1-2b35eb8cef7f None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:56.652989 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:56.655459 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a64d60f-917e-48e9-8c10-a2d4a0427ccf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:56.657322 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a64d60f-917e-48e9-8c10-a2d4a0427ccf None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:56.658014 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 227/452] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:56.658833 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bba17-f013-4344-8ef1-2b35eb8cef7f None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:56.672838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-1a64d60f-917e-48e9-8c10-a2d4a0427ccf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:56.672838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:56.672838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:56.672838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:56.672838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:56.672838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:56.672838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:56.672838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:56.672838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:56.672838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:56.672838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:56.672838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:56.672838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:17:56.672838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:17:56.672838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:17:56.672838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:17:56.673774 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:56.673774 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:56.673774 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:56.673774 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:56.673774 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:56.673774 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:56.673774 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:56.673774 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:56.673774 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:56.673774 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:56.673774 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:56.673774 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:56.673774 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:56.673774 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:56.673774 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:56.673774 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:56.673774 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:17:56.674608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:17:56.674608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:56.674608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:56.674608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 226/453] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:17:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:56.674821 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64d60f-917e-48e9-8c10-a2d4a0427ccf None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:56.749045 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:56.758822 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bba17-f013-4344-8ef1-2b35eb8cef7f None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:56.774165 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64d60f-917e-48e9-8c10-a2d4a0427ccf None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:56.792722 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d13ee-107c-40f9-840d-0bbdb17bfb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:56.793739 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d13ee-107c-40f9-840d-0bbdb17bfb4a None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:56.794039 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d13ee-107c-40f9-840d-0bbdb17bfb4a None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:56.794319 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d13ee-107c-40f9-840d-0bbdb17bfb4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:56.800792 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d13ee-107c-40f9-840d-0bbdb17bfb4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:56.802234 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d13ee-107c-40f9-840d-0bbdb17bfb4a None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:56.806986 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595811c-2338-460d-b6e3-ed614bde6a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:56.807620 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595811c-2338-460d-b6e3-ed614bde6a25 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:56.808162 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595811c-2338-460d-b6e3-ed614bde6a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:56.808440 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595811c-2338-460d-b6e3-ed614bde6a25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:56.813460 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-0d2d13ee-107c-40f9-840d-0bbdb17bfb4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:17:56.813460 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:56.813460 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:56.813460 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:56.813460 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:56.813460 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:56.813460 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:56.813460 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:56.813460 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:56.813460 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:56.813460 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:56.813460 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:56.813460 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 20:17:56.813460 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 20:17:56.813460 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 20:17:56.814457 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 20:17:56.814457 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:56.814457 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:56.814457 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:56.814457 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:56.814457 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:56.814457 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:56.814457 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:56.814457 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:56.814457 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:56.814457 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:56.814457 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:56.814457 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:56.814457 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:56.814457 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:56.814457 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:56.814457 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:56.815529 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 20:17:56.815529 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 20:17:56.815529 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 20:17:56.815529 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 20:17:56.815529 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 20:17:56.815529 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 20:17:56.815529 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:17:56.815529 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:56.815529 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 228/454] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:17:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:56.815529 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d13ee-107c-40f9-840d-0bbdb17bfb4a None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:56.817374 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595811c-2338-460d-b6e3-ed614bde6a25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:56.818837 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595811c-2338-460d-b6e3-ed614bde6a25 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:56.831136 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-2595811c-2338-460d-b6e3-ed614bde6a25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:17:56.831136 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:56.831136 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:56.831136 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:56.831136 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:56.831136 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:56.831136 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:56.831136 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:56.831136 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:56.831136 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:56.831136 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:56.831136 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:56.831136 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 20:17:56.831136 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 20:17:56.831136 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 20:17:56.832098 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 20:17:56.832098 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:56.832098 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:56.832098 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:56.832098 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:56.832098 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:56.832098 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:56.832098 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:56.832098 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:56.832098 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:56.832098 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:56.832098 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:56.832098 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:56.832098 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:56.832098 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:56.832098 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:56.832098 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:56.832984 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 20:17:56.832984 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 20:17:56.832984 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 20:17:56.832984 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 20:17:56.832984 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 20:17:56.832984 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 20:17:56.832984 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:17:56.832984 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:56.832984 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 227/455] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:17:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:56.832984 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595811c-2338-460d-b6e3-ed614bde6a25 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:56.885770 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:56.914277 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d13ee-107c-40f9-840d-0bbdb17bfb4a None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:56.931643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595811c-2338-460d-b6e3-ed614bde6a25 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:56.946968 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c5208-ca8f-4cbc-9f3f-657ddd998876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:56.947563 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c5208-ca8f-4cbc-9f3f-657ddd998876 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:56.947839 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c5208-ca8f-4cbc-9f3f-657ddd998876 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:56.948119 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c5208-ca8f-4cbc-9f3f-657ddd998876 None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:56.948807 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c5208-ca8f-4cbc-9f3f-657ddd998876 None admin] RBAC: Adding query filter params (name=service) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:56.949111 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c5208-ca8f-4cbc-9f3f-657ddd998876 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:56.950467 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c5208-ca8f-4cbc-9f3f-657ddd998876 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:56.958122 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 229/456] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Nov 2 20:17:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:56.958888 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c5208-ca8f-4cbc-9f3f-657ddd998876 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:56.965139 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77bcfa-ac23-463b-b1e0-f31ec7f0514a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:56.965764 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77bcfa-ac23-463b-b1e0-f31ec7f0514a None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:56.966042 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77bcfa-ac23-463b-b1e0-f31ec7f0514a None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:56.966315 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77bcfa-ac23-463b-b1e0-f31ec7f0514a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:56.973617 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77bcfa-ac23-463b-b1e0-f31ec7f0514a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:56.974590 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:56.975244 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77bcfa-ac23-463b-b1e0-f31ec7f0514a None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:56.986901 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-6b77bcfa-ac23-463b-b1e0-f31ec7f0514a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 02 20:17:56.986901 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:56.986901 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:56.986901 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:56.986901 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:56.986901 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:56.986901 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:56.986901 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:56.986901 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:56.986901 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:56.986901 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:56.986901 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:56.986901 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 20:17:56.986901 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 20:17:56.986901 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 20:17:56.986901 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 20:17:56.987775 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:56.987775 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:56.987775 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 20:17:56.987775 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:17:56.987775 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 20:17:56.987775 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:17:56.987775 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:56.987775 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:56.987775 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:56.987775 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:56.987775 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:56.987775 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:56.987775 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:56.987775 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:56.987775 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:56.987775 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:56.987775 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:56.987775 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:56.988702 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:56.988702 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:56.988702 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 20:17:56.988702 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 20:17:56.988702 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 20:17:56.988702 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 20:17:56.988702 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 20:17:56.988702 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 20:17:56.988702 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Nov 02 20:17:56.988702 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:56.988702 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 228/457] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:17:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:56.989330 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77bcfa-ac23-463b-b1e0-f31ec7f0514a None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:57.063934 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c5208-ca8f-4cbc-9f3f-657ddd998876 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:57.086406 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77bcfa-ac23-463b-b1e0-f31ec7f0514a None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:57.096347 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e7c47-956e-4a2d-9238-62108448fa97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:57.096973 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e7c47-956e-4a2d-9238-62108448fa97 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:57.097259 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e7c47-956e-4a2d-9238-62108448fa97 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:57.097534 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e7c47-956e-4a2d-9238-62108448fa97 None admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:57.098167 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e7c47-956e-4a2d-9238-62108448fa97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:57.098480 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e7c47-956e-4a2d-9238-62108448fa97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:57.098610 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:57.100245 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e7c47-956e-4a2d-9238-62108448fa97 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:57.113438 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 230/458] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:57.114235 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e7c47-956e-4a2d-9238-62108448fa97 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:57.123943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762f9ef-6aef-4ba0-a084-ed9f7b8da966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:57.124559 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762f9ef-6aef-4ba0-a084-ed9f7b8da966 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:57.124849 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762f9ef-6aef-4ba0-a084-ed9f7b8da966 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:57.125125 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762f9ef-6aef-4ba0-a084-ed9f7b8da966 None admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:57.125810 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7762f9ef-6aef-4ba0-a084-ed9f7b8da966 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:57.126115 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7762f9ef-6aef-4ba0-a084-ed9f7b8da966 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:57.127537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7762f9ef-6aef-4ba0-a084-ed9f7b8da966 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:57.139975 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 229/459] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Nov 2 20:17:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:57.140571 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762f9ef-6aef-4ba0-a084-ed9f7b8da966 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:57.185082 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:57.214914 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e7c47-956e-4a2d-9238-62108448fa97 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:57.245142 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762f9ef-6aef-4ba0-a084-ed9f7b8da966 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:57.248431 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aefee6-d026-4c71-a64a-885de14eca85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:57.249055 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aefee6-d026-4c71-a64a-885de14eca85 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:57.249342 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aefee6-d026-4c71-a64a-885de14eca85 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:57.249619 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aefee6-d026-4c71-a64a-885de14eca85 None admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:57.250303 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aefee6-d026-4c71-a64a-885de14eca85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:57.250608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aefee6-d026-4c71-a64a-885de14eca85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:57.252052 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aefee6-d026-4c71-a64a-885de14eca85 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:57.263296 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 231/460] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Nov 2 20:17:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:57.264196 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aefee6-d026-4c71-a64a-885de14eca85 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:57.278639 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74013691-0dd4-4b71-9eb0-425e512dce20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:57.279265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74013691-0dd4-4b71-9eb0-425e512dce20 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:57.279542 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74013691-0dd4-4b71-9eb0-425e512dce20 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:57.279818 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74013691-0dd4-4b71-9eb0-425e512dce20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:57.290757 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74013691-0dd4-4b71-9eb0-425e512dce20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:57.292184 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74013691-0dd4-4b71-9eb0-425e512dce20 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:57.306751 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-74013691-0dd4-4b71-9eb0-425e512dce20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:57.306751 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:57.306751 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:57.306751 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:57.306751 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:57.306751 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:57.306751 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:57.306751 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:57.306751 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:57.306751 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:57.306751 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:57.306751 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:57.306751 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:17:57.306751 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:17:57.306751 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:17:57.306751 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:17:57.307731 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:57.307731 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:57.307731 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:57.307731 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:57.307731 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:57.307731 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:57.307731 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:57.307731 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:57.307731 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:57.307731 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:57.307731 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:57.307731 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:57.307731 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:57.307731 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:57.307731 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:57.307731 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:57.307731 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:17:57.308874 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:17:57.308874 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:57.308874 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:57.308874 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 230/461] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:17:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:57.308874 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74013691-0dd4-4b71-9eb0-425e512dce20 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:57.333812 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:57.365871 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aefee6-d026-4c71-a64a-885de14eca85 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:57.394731 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:57.401455 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92487a-c752-4681-b177-0b4bb3b3e582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:57.402063 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92487a-c752-4681-b177-0b4bb3b3e582 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:57.402346 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92487a-c752-4681-b177-0b4bb3b3e582 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:57.402627 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92487a-c752-4681-b177-0b4bb3b3e582 None admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:57.403346 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d92487a-c752-4681-b177-0b4bb3b3e582 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:57.403657 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d92487a-c752-4681-b177-0b4bb3b3e582 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:57.405127 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d92487a-c752-4681-b177-0b4bb3b3e582 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:57.407867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74013691-0dd4-4b71-9eb0-425e512dce20 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:57.422640 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 232/462] 10.222.0.23 () {56 vars in 1137 bytes} [Wed Nov 2 20:17:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:57.423254 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92487a-c752-4681-b177-0b4bb3b3e582 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:57.446231 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675b6fd-49fd-4f78-a8eb-158487f02f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:57.446863 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675b6fd-49fd-4f78-a8eb-158487f02f3f None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:57.447147 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675b6fd-49fd-4f78-a8eb-158487f02f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:57.447435 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675b6fd-49fd-4f78-a8eb-158487f02f3f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:57.454781 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675b6fd-49fd-4f78-a8eb-158487f02f3f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:57.456214 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675b6fd-49fd-4f78-a8eb-158487f02f3f None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:57.467626 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-e675b6fd-49fd-4f78-a8eb-158487f02f3f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 20:17:57.467626 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:57.467626 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:57.467626 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:57.467626 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:57.467626 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:57.467626 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:57.467626 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:57.467626 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:57.467626 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:57.467626 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:57.467626 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:57.467626 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 20:17:57.467626 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 20:17:57.467626 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 20:17:57.467626 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 20:17:57.468728 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:57.468728 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:57.468728 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 20:17:57.468728 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:17:57.468728 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 20:17:57.468728 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:17:57.468728 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:57.468728 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:57.468728 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:57.468728 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:57.468728 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:57.468728 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:57.468728 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:57.468728 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:57.468728 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:57.468728 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:57.468728 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:57.468728 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:57.469816 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:57.469816 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:57.469816 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 20:17:57.469816 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 20:17:57.469816 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 20:17:57.469816 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 20:17:57.469816 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 20:17:57.469816 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 20:17:57.469816 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 20:17:57.469816 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:57.469816 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 231/463] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:17:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:57.469816 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675b6fd-49fd-4f78-a8eb-158487f02f3f None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:57.527717 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92487a-c752-4681-b177-0b4bb3b3e582 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:57.552622 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:57.563019 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01db98-f0ea-4556-9a73-0274885e77a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:57.563622 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01db98-f0ea-4556-9a73-0274885e77a4 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:57.563902 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01db98-f0ea-4556-9a73-0274885e77a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:57.564175 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01db98-f0ea-4556-9a73-0274885e77a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:57.564960 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01db98-f0ea-4556-9a73-0274885e77a4 None admin] RBAC: Adding query filter params (role.id=59b45b6df1ee465bbbb8bdba4b4e281d, scope.project.id=a144e65ce44c44dc99c07a7f5be303b7, user.id=f906fd11db004026a78eb3d69fa5b298) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:57.565271 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01db98-f0ea-4556-9a73-0274885e77a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:57.566705 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01db98-f0ea-4556-9a73-0274885e77a4 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:57.569326 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675b6fd-49fd-4f78-a8eb-158487f02f3f None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:57.572305 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 233/464] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Nov 2 20:17:57 2022] GET /identity/v3/role_assignments?user.id=f906fd11db004026a78eb3d69fa5b298&scope.project.id=a144e65ce44c44dc99c07a7f5be303b7&role.id=59b45b6df1ee465bbbb8bdba4b4e281d => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:57.573170 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01db98-f0ea-4556-9a73-0274885e77a4 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:57.607453 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c19b12-f506-478e-8a9b-90596630ab8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:57.608236 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c19b12-f506-478e-8a9b-90596630ab8e None admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:57.608627 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c19b12-f506-478e-8a9b-90596630ab8e None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:57.608966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c19b12-f506-478e-8a9b-90596630ab8e None admin] PATH_INFO: `/v3/projects/a144e65ce44c44dc99c07a7f5be303b7/users/95f22f80ac694e9888c132af1e58e292/roles/59b45b6df1ee465bbbb8bdba4b4e281d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:57.625370 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c19b12-f506-478e-8a9b-90596630ab8e None admin] RBAC: Authorizing `identity:create_grant(project_id=a144e65ce44c44dc99c07a7f5be303b7, user_id=95f22f80ac694e9888c132af1e58e292, role_id=59b45b6df1ee465bbbb8bdba4b4e281d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:57.626952 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c19b12-f506-478e-8a9b-90596630ab8e None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:57.642223 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 232/465] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Nov 2 20:17:57 2022] PUT /identity/v3/projects/a144e65ce44c44dc99c07a7f5be303b7/users/95f22f80ac694e9888c132af1e58e292/roles/59b45b6df1ee465bbbb8bdba4b4e281d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:17:57.643441 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c19b12-f506-478e-8a9b-90596630ab8e None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:57.650789 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:57.704051 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01db98-f0ea-4556-9a73-0274885e77a4 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:57.746784 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f08e3d-d441-440a-8d99-15a281e046f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:57.747763 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f08e3d-d441-440a-8d99-15a281e046f4 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:57.748192 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f08e3d-d441-440a-8d99-15a281e046f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:57.748704 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f08e3d-d441-440a-8d99-15a281e046f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:57.749642 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f08e3d-d441-440a-8d99-15a281e046f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:57.750145 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f08e3d-d441-440a-8d99-15a281e046f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:57.751845 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f08e3d-d441-440a-8d99-15a281e046f4 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:57.767525 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 234/466] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:57.772583 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f08e3d-d441-440a-8d99-15a281e046f4 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:57.790562 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c19b12-f506-478e-8a9b-90596630ab8e None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:57.843601 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c56e6-74f0-483e-b6d5-e0b3e75c86fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:57.844227 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c56e6-74f0-483e-b6d5-e0b3e75c86fb None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:57.844511 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c56e6-74f0-483e-b6d5-e0b3e75c86fb None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:57.844878 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c56e6-74f0-483e-b6d5-e0b3e75c86fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:57.847686 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:57.901541 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f08e3d-d441-440a-8d99-15a281e046f4 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:57.918072 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:57.940925 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ee509-66ad-4546-9671-3cee47680daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:57.941532 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ee509-66ad-4546-9671-3cee47680daa None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:57.941813 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ee509-66ad-4546-9671-3cee47680daa None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:57.942087 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ee509-66ad-4546-9671-3cee47680daa None admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:57.942872 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ee509-66ad-4546-9671-3cee47680daa None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:57.943063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c56e6-74f0-483e-b6d5-e0b3e75c86fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:57.943173 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ee509-66ad-4546-9671-3cee47680daa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:57.944661 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ee509-66ad-4546-9671-3cee47680daa None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:57.944776 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c56e6-74f0-483e-b6d5-e0b3e75c86fb None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:57.968659 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 235/467] 10.222.0.23 () {56 vars in 1137 bytes} [Wed Nov 2 20:17:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:57.969576 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ee509-66ad-4546-9671-3cee47680daa None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:58.062950 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 233/468] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Nov 2 20:17:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 20:17:58.063810 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c56e6-74f0-483e-b6d5-e0b3e75c86fb None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:58.083767 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ee509-66ad-4546-9671-3cee47680daa None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:58.105011 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:58.121456 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5031b43-463b-4f63-b8ac-c40e355b5643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:58.122189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5031b43-463b-4f63-b8ac-c40e355b5643 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:58.122476 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5031b43-463b-4f63-b8ac-c40e355b5643 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:58.122752 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5031b43-463b-4f63-b8ac-c40e355b5643 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:58.130848 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5031b43-463b-4f63-b8ac-c40e355b5643 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:58.132423 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5031b43-463b-4f63-b8ac-c40e355b5643 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:58.145072 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-b5031b43-463b-4f63-b8ac-c40e355b5643 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 20:17:58.145072 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:58.145072 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:58.145072 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:58.145072 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:58.145072 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:58.145072 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:58.145072 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:58.145072 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:58.145072 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:58.145072 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:58.145072 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:58.145072 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 20:17:58.145072 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 20:17:58.145072 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 20:17:58.145072 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 20:17:58.146202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:58.146202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:58.146202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 20:17:58.146202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:17:58.146202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 20:17:58.146202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:17:58.146202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:58.146202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:58.146202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:58.146202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:58.146202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:58.146202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:58.146202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:58.146202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:58.146202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:58.146202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:58.146202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:58.146202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:58.147215 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:58.147215 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:58.147215 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 20:17:58.147215 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 20:17:58.147215 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 20:17:58.147215 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 20:17:58.147215 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 20:17:58.147215 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 20:17:58.147215 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 20:17:58.147215 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:58.147215 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 236/469] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Nov 2 20:17:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:58.147215 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5031b43-463b-4f63-b8ac-c40e355b5643 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:58.184340 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:58.193546 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c56e6-74f0-483e-b6d5-e0b3e75c86fb None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:58.232308 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2f3c5-a9f7-4c61-a374-eb3fa8f1e62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:58.232962 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2f3c5-a9f7-4c61-a374-eb3fa8f1e62e None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:58.233241 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2f3c5-a9f7-4c61-a374-eb3fa8f1e62e None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:58.233514 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2f3c5-a9f7-4c61-a374-eb3fa8f1e62e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:58.271776 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5031b43-463b-4f63-b8ac-c40e355b5643 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:58.306734 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e5293-ad97-4f59-91e0-395a4f26c4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:58.307430 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e5293-ad97-4f59-91e0-395a4f26c4cd None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:58.307630 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e5293-ad97-4f59-91e0-395a4f26c4cd None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:58.308176 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e5293-ad97-4f59-91e0-395a4f26c4cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:58.317332 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2f3c5-a9f7-4c61-a374-eb3fa8f1e62e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:58.318755 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e5293-ad97-4f59-91e0-395a4f26c4cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:58.319193 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2f3c5-a9f7-4c61-a374-eb3fa8f1e62e None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:58.320191 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e5293-ad97-4f59-91e0-395a4f26c4cd None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:58.335652 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-182e5293-ad97-4f59-91e0-395a4f26c4cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:58.335652 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:58.335652 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:58.335652 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:58.335652 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:58.335652 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:58.335652 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:58.335652 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:58.335652 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:58.335652 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:58.335652 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:58.335652 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:58.335652 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:17:58.335652 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:17:58.335652 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:17:58.335652 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:17:58.336659 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:58.336659 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:58.336659 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:58.336659 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:58.336659 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:58.336659 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:58.336659 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:58.336659 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:58.336659 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:58.336659 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:58.336659 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:58.336659 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:58.336659 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:58.336659 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:58.336659 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:58.336659 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:58.336659 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:17:58.337518 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:17:58.337518 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:58.337518 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:58.337518 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 237/470] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:17:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:58.338146 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e5293-ad97-4f59-91e0-395a4f26c4cd None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:58.362138 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:58.437221 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:58.448716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 234/471] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Nov 2 20:17:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 20:17:58.450003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2f3c5-a9f7-4c61-a374-eb3fa8f1e62e None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:58.462060 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e5293-ad97-4f59-91e0-395a4f26c4cd None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:58.509301 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4aa39-e380-4129-b941-90ca69076cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:58.509910 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4aa39-e380-4129-b941-90ca69076cdd None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:58.510186 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4aa39-e380-4129-b941-90ca69076cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:58.510456 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4aa39-e380-4129-b941-90ca69076cdd None admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:58.511174 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4aa39-e380-4129-b941-90ca69076cdd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:58.511480 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4aa39-e380-4129-b941-90ca69076cdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:58.512958 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4aa39-e380-4129-b941-90ca69076cdd None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:58.531696 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 238/472] 10.222.0.23 () {56 vars in 1139 bytes} [Wed Nov 2 20:17:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:58.532642 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4aa39-e380-4129-b941-90ca69076cdd None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:58.584732 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2f3c5-a9f7-4c61-a374-eb3fa8f1e62e None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:58.627053 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ababc6e-6e12-4852-a25e-8c638c77bf4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:58.629329 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ababc6e-6e12-4852-a25e-8c638c77bf4e None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:58.629830 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ababc6e-6e12-4852-a25e-8c638c77bf4e None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:58.630549 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ababc6e-6e12-4852-a25e-8c638c77bf4e None admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:58.631433 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ababc6e-6e12-4852-a25e-8c638c77bf4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:58.631967 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ababc6e-6e12-4852-a25e-8c638c77bf4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:58.634253 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ababc6e-6e12-4852-a25e-8c638c77bf4e None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:58.636908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:58.639555 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4aa39-e380-4129-b941-90ca69076cdd None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:58.649595 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 235/473] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:58.651009 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ababc6e-6e12-4852-a25e-8c638c77bf4e None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:58.682659 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4206d-0151-4df7-bbd6-36c34d749133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:58.684267 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4206d-0151-4df7-bbd6-36c34d749133 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:58.684767 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4206d-0151-4df7-bbd6-36c34d749133 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:58.685315 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4206d-0151-4df7-bbd6-36c34d749133 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:58.696838 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4206d-0151-4df7-bbd6-36c34d749133 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:58.698581 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4206d-0151-4df7-bbd6-36c34d749133 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:58.700475 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:58.716469 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-deb4206d-0151-4df7-bbd6-36c34d749133 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:58.716469 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:58.716469 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:58.716469 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:58.716469 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:58.716469 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:58.716469 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:58.716469 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:58.716469 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:58.716469 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:58.716469 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:58.716469 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:58.716469 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:17:58.716469 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:17:58.716469 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:17:58.716469 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:17:58.717408 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:58.717408 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:58.717408 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:58.717408 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:58.717408 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:58.717408 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:58.717408 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:58.717408 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:58.717408 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:58.717408 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:58.717408 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:58.717408 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:58.717408 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:58.717408 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:58.717408 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:58.717408 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:58.717408 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:17:58.718235 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:17:58.718235 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:58.718235 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:58.720469 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 239/474] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:17:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:58.721723 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4206d-0151-4df7-bbd6-36c34d749133 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:58.772661 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ababc6e-6e12-4852-a25e-8c638c77bf4e None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:58.813903 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc343062-7dbc-4c02-8acf-c8bd25766b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:58.814845 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc343062-7dbc-4c02-8acf-c8bd25766b9a None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:58.815338 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc343062-7dbc-4c02-8acf-c8bd25766b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:58.815816 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc343062-7dbc-4c02-8acf-c8bd25766b9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:58.858158 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4206d-0151-4df7-bbd6-36c34d749133 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:58.880700 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:58.890413 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc343062-7dbc-4c02-8acf-c8bd25766b9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:58.892227 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc343062-7dbc-4c02-8acf-c8bd25766b9a None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:58.904250 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644af272-0a76-49e7-abfe-6ecb21a6366a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:58.904923 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644af272-0a76-49e7-abfe-6ecb21a6366a None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:58.905204 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644af272-0a76-49e7-abfe-6ecb21a6366a None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:58.905480 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644af272-0a76-49e7-abfe-6ecb21a6366a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:58.914730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644af272-0a76-49e7-abfe-6ecb21a6366a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:58.916719 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644af272-0a76-49e7-abfe-6ecb21a6366a None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:58.933291 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-644af272-0a76-49e7-abfe-6ecb21a6366a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:17:58.933291 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:58.933291 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:58.933291 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:58.933291 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:58.933291 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:58.933291 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:58.933291 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:58.933291 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:58.933291 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:58.933291 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:58.933291 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:58.933291 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 20:17:58.933291 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 20:17:58.933291 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 20:17:58.934159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 20:17:58.934159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:58.934159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:58.934159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:58.934159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:58.934159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:58.934159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:58.934159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:58.934159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:58.934159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:58.934159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:58.934159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:58.934159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:58.934159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:58.934159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:58.934159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:58.934159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:58.935040 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 20:17:58.935040 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 20:17:58.935040 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 20:17:58.935040 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 20:17:58.935040 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 20:17:58.935040 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 20:17:58.935040 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:17:58.935040 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:58.935040 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 240/475] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:17:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:58.935983 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644af272-0a76-49e7-abfe-6ecb21a6366a None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:59.005825 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:59.007828 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 236/476] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Nov 2 20:17:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 20:17:59.009054 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc343062-7dbc-4c02-8acf-c8bd25766b9a None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:59.057634 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644af272-0a76-49e7-abfe-6ecb21a6366a None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:59.093579 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472e456-378d-413e-a0ed-021bfbbd3ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:59.094230 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472e456-378d-413e-a0ed-021bfbbd3ece None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:59.094452 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472e456-378d-413e-a0ed-021bfbbd3ece None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:59.094792 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472e456-378d-413e-a0ed-021bfbbd3ece None admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:59.095413 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472e456-378d-413e-a0ed-021bfbbd3ece None admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:59.095714 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472e456-378d-413e-a0ed-021bfbbd3ece None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:59.097210 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472e456-378d-413e-a0ed-021bfbbd3ece None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:59.107537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:59.114999 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc343062-7dbc-4c02-8acf-c8bd25766b9a None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:59.115232 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 241/477] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:59.116220 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472e456-378d-413e-a0ed-021bfbbd3ece None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:59.151262 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8f670-a578-42a9-8280-b1bcc77fd496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:59.152031 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8f670-a578-42a9-8280-b1bcc77fd496 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:59.152436 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8f670-a578-42a9-8280-b1bcc77fd496 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:59.152845 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8f670-a578-42a9-8280-b1bcc77fd496 None admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:59.153628 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8f670-a578-42a9-8280-b1bcc77fd496 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:59.154469 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8f670-a578-42a9-8280-b1bcc77fd496 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:59.155539 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8f670-a578-42a9-8280-b1bcc77fd496 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:59.169059 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 237/478] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Nov 2 20:17:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:59.170027 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8f670-a578-42a9-8280-b1bcc77fd496 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:59.223793 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472e456-378d-413e-a0ed-021bfbbd3ece None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:59.245981 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:59.262176 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18a006-cb7a-413c-8c45-c654ef32c9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:59.262991 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18a006-cb7a-413c-8c45-c654ef32c9d7 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:59.263526 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18a006-cb7a-413c-8c45-c654ef32c9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:59.264001 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18a006-cb7a-413c-8c45-c654ef32c9d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:59.275377 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18a006-cb7a-413c-8c45-c654ef32c9d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:59.277151 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18a006-cb7a-413c-8c45-c654ef32c9d7 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:59.287411 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8f670-a578-42a9-8280-b1bcc77fd496 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:59.294018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-ae18a006-cb7a-413c-8c45-c654ef32c9d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:59.294018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:59.294018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:59.294018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:59.294018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:59.294018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:59.294018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:59.294018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:59.294018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:59.294018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:59.294018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:59.294018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:59.294018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:17:59.294018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:17:59.294018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:17:59.294018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:17:59.294878 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:59.294878 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:59.294878 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:59.294878 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:59.294878 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:59.294878 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:59.294878 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:59.294878 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:59.294878 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:59.294878 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:59.294878 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:59.294878 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:59.294878 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:59.294878 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:59.294878 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:59.294878 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:59.294878 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:17:59.295711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:17:59.295711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:17:59.295711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:17:59.302292 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 242/479] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:17:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:59.303415 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18a006-cb7a-413c-8c45-c654ef32c9d7 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:59.330656 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6b1d1-24d4-45d1-9a49-984fc3d16f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:59.331323 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6b1d1-24d4-45d1-9a49-984fc3d16f86 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:59.331609 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6b1d1-24d4-45d1-9a49-984fc3d16f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:59.332033 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6b1d1-24d4-45d1-9a49-984fc3d16f86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:59.339848 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6b1d1-24d4-45d1-9a49-984fc3d16f86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:59.341329 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6b1d1-24d4-45d1-9a49-984fc3d16f86 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:59.353888 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-94c6b1d1-24d4-45d1-9a49-984fc3d16f86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:17:59.353888 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:59.353888 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:59.353888 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:59.353888 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:59.353888 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:59.353888 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:59.353888 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:59.353888 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:59.353888 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:59.353888 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:59.353888 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:59.353888 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 20:17:59.353888 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 20:17:59.353888 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 20:17:59.354736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 20:17:59.354736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:59.354736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:59.354736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:59.354736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:59.354736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:59.354736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:59.354736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:59.354736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:59.354736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:59.354736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:59.354736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:59.354736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:59.354736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:59.354736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:59.354736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:59.354736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:59.355591 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 20:17:59.355591 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 20:17:59.355591 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 20:17:59.355591 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 20:17:59.355591 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 20:17:59.355591 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 20:17:59.355591 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:17:59.355591 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:59.355591 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 238/480] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:17:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:17:59.356485 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6b1d1-24d4-45d1-9a49-984fc3d16f86 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:59.373359 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:59.429820 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18a006-cb7a-413c-8c45-c654ef32c9d7 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:59.475481 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6b1d1-24d4-45d1-9a49-984fc3d16f86 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:59.481828 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c265fa4-036f-4317-a613-000d0b7ad913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:59.482671 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c265fa4-036f-4317-a613-000d0b7ad913 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:59.483687 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c265fa4-036f-4317-a613-000d0b7ad913 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:59.484159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c265fa4-036f-4317-a613-000d0b7ad913 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:59.485584 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c265fa4-036f-4317-a613-000d0b7ad913 None admin] RBAC: Adding query filter params (role.id=59b45b6df1ee465bbbb8bdba4b4e281d, scope.project.id=a144e65ce44c44dc99c07a7f5be303b7, user.id=62ca656e59ff46b08661385d8ec79846) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:59.486092 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c265fa4-036f-4317-a613-000d0b7ad913 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:59.488434 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c265fa4-036f-4317-a613-000d0b7ad913 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:59.497857 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 243/481] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Nov 2 20:17:59 2022] GET /identity/v3/role_assignments?user.id=62ca656e59ff46b08661385d8ec79846&scope.project.id=a144e65ce44c44dc99c07a7f5be303b7&role.id=59b45b6df1ee465bbbb8bdba4b4e281d => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:59.499231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c265fa4-036f-4317-a613-000d0b7ad913 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:59.532585 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb79e4-29cf-4229-991d-25649c48ee8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:59.536591 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb79e4-29cf-4229-991d-25649c48ee8f None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:59.536591 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb79e4-29cf-4229-991d-25649c48ee8f None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:59.536591 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb79e4-29cf-4229-991d-25649c48ee8f None admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:59.536591 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb79e4-29cf-4229-991d-25649c48ee8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:59.536591 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb79e4-29cf-4229-991d-25649c48ee8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:59.536591 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb79e4-29cf-4229-991d-25649c48ee8f None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:59.538346 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:59.569413 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 239/482] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:59.576232 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb79e4-29cf-4229-991d-25649c48ee8f None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:59.635797 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c265fa4-036f-4317-a613-000d0b7ad913 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:59.682028 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e44dc7-3101-489a-bdfd-5bfcfc28b393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:59.682028 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e44dc7-3101-489a-bdfd-5bfcfc28b393 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:59.682290 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e44dc7-3101-489a-bdfd-5bfcfc28b393 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:59.682504 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e44dc7-3101-489a-bdfd-5bfcfc28b393 None admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:59.683366 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e44dc7-3101-489a-bdfd-5bfcfc28b393 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:59.683951 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e44dc7-3101-489a-bdfd-5bfcfc28b393 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:59.685526 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e44dc7-3101-489a-bdfd-5bfcfc28b393 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:59.701366 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 244/483] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Nov 2 20:17:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:17:59.707302 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e44dc7-3101-489a-bdfd-5bfcfc28b393 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:59.722934 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:59.752430 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb79e4-29cf-4229-991d-25649c48ee8f None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:59.788821 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d53bf-e37a-4995-b890-5df4d9f91fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:59.790296 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d53bf-e37a-4995-b890-5df4d9f91fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:59.790774 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d53bf-e37a-4995-b890-5df4d9f91fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:59.791260 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d53bf-e37a-4995-b890-5df4d9f91fe5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:59.805833 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d53bf-e37a-4995-b890-5df4d9f91fe5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:59.807599 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d53bf-e37a-4995-b890-5df4d9f91fe5 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:59.816317 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:17:59.826182 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-627d53bf-e37a-4995-b890-5df4d9f91fe5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:17:59.826182 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:17:59.826182 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:17:59.826182 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:17:59.826182 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:17:59.826182 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:17:59.826182 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:17:59.826182 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:17:59.826182 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:17:59.826182 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:17:59.826182 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:17:59.826182 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:17:59.826182 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 20:17:59.826182 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 20:17:59.826182 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 20:17:59.827088 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 20:17:59.827088 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:17:59.827088 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:17:59.827088 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:17:59.827088 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:17:59.827088 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:17:59.827088 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:17:59.827088 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:17:59.827088 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:17:59.827088 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:17:59.827088 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:17:59.827088 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:17:59.827088 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:17:59.827088 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:17:59.827088 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:17:59.827088 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:17:59.827088 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:17:59.827972 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 20:17:59.827972 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 20:17:59.827972 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 20:17:59.827972 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 20:17:59.827972 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 20:17:59.827972 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 20:17:59.827972 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:17:59.827972 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:17:59.827972 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 240/484] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:17:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 20:17:59.830616 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e44dc7-3101-489a-bdfd-5bfcfc28b393 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:17:59.833348 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d53bf-e37a-4995-b890-5df4d9f91fe5 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:17:59.873108 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6f320-e16b-4d38-b476-02ec03d6c7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:17:59.873715 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6f320-e16b-4d38-b476-02ec03d6c7cd None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:59.873994 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6f320-e16b-4d38-b476-02ec03d6c7cd None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:59.874270 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6f320-e16b-4d38-b476-02ec03d6c7cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:59.874998 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab6f320-e16b-4d38-b476-02ec03d6c7cd None admin] RBAC: Adding query filter params (role.id=59b45b6df1ee465bbbb8bdba4b4e281d, scope.project.id=a144e65ce44c44dc99c07a7f5be303b7, user.id=3860ca67d4c446ac9d7617fb4608408f) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:17:59.875318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab6f320-e16b-4d38-b476-02ec03d6c7cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:17:59.876751 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab6f320-e16b-4d38-b476-02ec03d6c7cd None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:17:59.885293 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 245/485] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Nov 2 20:17:59 2022] GET /identity/v3/role_assignments?user.id=3860ca67d4c446ac9d7617fb4608408f&scope.project.id=a144e65ce44c44dc99c07a7f5be303b7&role.id=59b45b6df1ee465bbbb8bdba4b4e281d => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:17:59.886311 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dc3e4-fd44-4f92-abef-d5a7ff744b3d None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:59.886599 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dc3e4-fd44-4f92-abef-d5a7ff744b3d None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:59.886877 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dc3e4-fd44-4f92-abef-d5a7ff744b3d None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:59.888292 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 246/486] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:17:59.893580 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd812a-a1bd-49cd-8ba6-44f6ed06f934 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:17:59.893869 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd812a-a1bd-49cd-8ba6-44f6ed06f934 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:17:59.894221 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd812a-a1bd-49cd-8ba6-44f6ed06f934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:17:59.915866 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-63bd812a-a1bd-49cd-8ba6-44f6ed06f934 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:17:59.917129 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-63bd812a-a1bd-49cd-8ba6-44f6ed06f934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:17:59.970111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d53bf-e37a-4995-b890-5df4d9f91fe5 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:00.013637 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508099b8-16b0-4ea8-afe4-a23b17a64fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:00.014275 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508099b8-16b0-4ea8-afe4-a23b17a64fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:00.014558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508099b8-16b0-4ea8-afe4-a23b17a64fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:00.014835 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508099b8-16b0-4ea8-afe4-a23b17a64fa7 None admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:00.015685 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508099b8-16b0-4ea8-afe4-a23b17a64fa7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:00.016000 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508099b8-16b0-4ea8-afe4-a23b17a64fa7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:00.020576 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508099b8-16b0-4ea8-afe4-a23b17a64fa7 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:00.020576 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:00.022138 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 247/487] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:17:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 20:18:00.041432 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 241/488] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Nov 2 20:17:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:00.047394 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd812a-a1bd-49cd-8ba6-44f6ed06f934 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:00.066769 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1ec6d-5ea3-40b6-96ad-ae48edbc8a64 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:00.067099 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1ec6d-5ea3-40b6-96ad-ae48edbc8a64 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:00.067379 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1ec6d-5ea3-40b6-96ad-ae48edbc8a64 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:00.069027 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 242/489] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 20:18:00.081307 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fc395-2945-4004-a4df-954a5f2ae28b None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:00.081706 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fc395-2945-4004-a4df-954a5f2ae28b None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:00.081994 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fc395-2945-4004-a4df-954a5f2ae28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:00.117745 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-5b1fc395-2945-4004-a4df-954a5f2ae28b None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:00.119038 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-5b1fc395-2945-4004-a4df-954a5f2ae28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:00.152223 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:00.170099 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd812a-a1bd-49cd-8ba6-44f6ed06f934 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:00.211197 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e0276-f58d-4407-a843-9e23823d48c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:00.212318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e0276-f58d-4407-a843-9e23823d48c5 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:00.212956 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e0276-f58d-4407-a843-9e23823d48c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:00.213070 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e0276-f58d-4407-a843-9e23823d48c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:00.213786 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e0276-f58d-4407-a843-9e23823d48c5 None admin] RBAC: Adding query filter params (role.id=59b45b6df1ee465bbbb8bdba4b4e281d, scope.project.id=a144e65ce44c44dc99c07a7f5be303b7, user.id=fdb57cba49ce43ad95096047859dfe1d) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:00.214120 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e0276-f58d-4407-a843-9e23823d48c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:00.215743 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e0276-f58d-4407-a843-9e23823d48c5 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:00.223156 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 248/490] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Nov 2 20:18:00 2022] GET /identity/v3/role_assignments?user.id=fdb57cba49ce43ad95096047859dfe1d&scope.project.id=a144e65ce44c44dc99c07a7f5be303b7&role.id=59b45b6df1ee465bbbb8bdba4b4e281d => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:00.225300 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 243/491] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 20:18:00.381868 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e0276-f58d-4407-a843-9e23823d48c5 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:00.494301 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e0276-f58d-4407-a843-9e23823d48c5 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:00.539065 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f095fa-71ab-4f86-80e8-6b655d922c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:00.540587 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f095fa-71ab-4f86-80e8-6b655d922c3e None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:00.541041 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f095fa-71ab-4f86-80e8-6b655d922c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:00.541506 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f095fa-71ab-4f86-80e8-6b655d922c3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:00.547323 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fc395-2945-4004-a4df-954a5f2ae28b None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:00.557754 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f095fa-71ab-4f86-80e8-6b655d922c3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:18:00.564768 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-56f095fa-71ab-4f86-80e8-6b655d922c3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:18:00.564768 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:00.564768 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:00.564768 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:00.564768 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:00.564768 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:00.564768 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:00.564768 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:00.564768 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:00.564768 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:00.564768 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:00.564768 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:00.564768 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:18:00.564768 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:18:00.564768 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:18:00.564768 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:18:00.565676 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:18:00.565676 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:18:00.565676 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:18:00.565676 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:18:00.565676 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:00.565676 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:00.565676 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:00.565676 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:00.565676 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:00.565676 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:00.565676 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:00.565676 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:00.565676 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:00.565676 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:00.565676 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:00.565676 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:00.566448 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:00.566448 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:00.566448 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:00.566448 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:00.566448 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:18:00.566448 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:18:00.566448 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:18:00.566448 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:18:00.566448 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:18:00.566448 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:18:00.566448 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:18:00.566448 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:00.568876 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 249/492] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Nov 2 20:18:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:00.575147 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f095fa-71ab-4f86-80e8-6b655d922c3e None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:00.590518 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:00.711269 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fc395-2945-4004-a4df-954a5f2ae28b None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:00.746806 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:00.748090 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f095fa-71ab-4f86-80e8-6b655d922c3e None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:00.757279 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95740a10-d2ac-46a1-b754-db00751e0e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:00.757916 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95740a10-d2ac-46a1-b754-db00751e0e0d None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:00.758195 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95740a10-d2ac-46a1-b754-db00751e0e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:00.758991 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95740a10-d2ac-46a1-b754-db00751e0e0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:00.769720 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95740a10-d2ac-46a1-b754-db00751e0e0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:18:00.774985 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-95740a10-d2ac-46a1-b754-db00751e0e0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 20:18:00.774985 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:00.774985 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:00.774985 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:00.774985 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:00.774985 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:00.774985 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:00.774985 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:00.774985 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:00.774985 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:00.774985 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:00.774985 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:00.774985 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:18:00.774985 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:18:00.774985 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:18:00.774985 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:18:00.775860 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:18:00.775860 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:18:00.775860 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:18:00.775860 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:18:00.775860 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:00.775860 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:00.775860 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:00.775860 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:00.775860 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:00.775860 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:00.775860 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:00.775860 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:00.775860 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:00.775860 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:00.775860 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:00.775860 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:00.777188 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:00.777188 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:00.777188 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:00.777188 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:00.777188 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:18:00.777188 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:18:00.777188 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:18:00.777188 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:18:00.777188 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:18:00.777188 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:18:00.777188 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 20:18:00.777188 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:00.777188 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 244/493] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Nov 2 20:18:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:00.793899 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95740a10-d2ac-46a1-b754-db00751e0e0d None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:00.820250 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e0eb3-edb0-433b-97fb-6fc15b1cdcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:00.821835 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e0eb3-edb0-433b-97fb-6fc15b1cdcfb None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:00.822315 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e0eb3-edb0-433b-97fb-6fc15b1cdcfb None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:00.822785 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e0eb3-edb0-433b-97fb-6fc15b1cdcfb None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:00.823747 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e0eb3-edb0-433b-97fb-6fc15b1cdcfb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:00.824257 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e0eb3-edb0-433b-97fb-6fc15b1cdcfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:00.825899 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e0eb3-edb0-433b-97fb-6fc15b1cdcfb None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:00.844311 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 250/494] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:18:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:00.850732 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e0eb3-edb0-433b-97fb-6fc15b1cdcfb None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:00.951840 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95740a10-d2ac-46a1-b754-db00751e0e0d None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:00.975871 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:01.017889 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e0eb3-edb0-433b-97fb-6fc15b1cdcfb None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:01.022990 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f5cba-4c32-4cf5-a871-37e8cfc89988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:01.023614 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f5cba-4c32-4cf5-a871-37e8cfc89988 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:01.023899 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f5cba-4c32-4cf5-a871-37e8cfc89988 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:01.024739 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f5cba-4c32-4cf5-a871-37e8cfc89988 None admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:01.025570 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f5cba-4c32-4cf5-a871-37e8cfc89988 None admin] RBAC: Adding query filter params (name=service) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:01.025882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f5cba-4c32-4cf5-a871-37e8cfc89988 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:01.027266 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f5cba-4c32-4cf5-a871-37e8cfc89988 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:01.048371 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 245/495] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Nov 2 20:18:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:01.053999 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f5cba-4c32-4cf5-a871-37e8cfc89988 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:01.071983 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e83094-711f-4acc-81e5-4e62b95f7cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:01.073008 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e83094-711f-4acc-81e5-4e62b95f7cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:01.073491 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e83094-711f-4acc-81e5-4e62b95f7cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:01.073958 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e83094-711f-4acc-81e5-4e62b95f7cf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:01.101388 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e83094-711f-4acc-81e5-4e62b95f7cf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:01.103817 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e83094-711f-4acc-81e5-4e62b95f7cf8 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:01.109143 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:01.124074 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-48e83094-711f-4acc-81e5-4e62b95f7cf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:01.124074 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:01.124074 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:01.124074 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:01.124074 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:01.124074 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:01.124074 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:01.124074 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:01.124074 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:01.124074 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:01.124074 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:01.124074 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:01.124074 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:18:01.124074 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:18:01.124074 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:18:01.124074 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:18:01.125187 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:01.125187 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:01.125187 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:01.125187 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:01.125187 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:01.125187 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:01.125187 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:01.125187 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:01.125187 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:01.125187 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:01.125187 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:01.125187 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:01.125187 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:01.125187 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:01.125187 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:01.125187 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:01.125187 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:18:01.126159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:18:01.126159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:01.126159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:01.126159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 251/496] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:18:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 20:18:01.131791 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e83094-711f-4acc-81e5-4e62b95f7cf8 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:01.250666 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f5cba-4c32-4cf5-a871-37e8cfc89988 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:01.272007 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e83094-711f-4acc-81e5-4e62b95f7cf8 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:01.298948 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:01.321366 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c99409-5a0c-4c70-8f10-3c3a5790f846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:01.321980 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c99409-5a0c-4c70-8f10-3c3a5790f846 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:01.322261 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c99409-5a0c-4c70-8f10-3c3a5790f846 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:01.322538 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c99409-5a0c-4c70-8f10-3c3a5790f846 None admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:01.323187 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c99409-5a0c-4c70-8f10-3c3a5790f846 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:01.323492 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c99409-5a0c-4c70-8f10-3c3a5790f846 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:01.324896 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c99409-5a0c-4c70-8f10-3c3a5790f846 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:01.327349 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bae1e4-29a2-4398-b079-629d1dff2225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:01.328039 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bae1e4-29a2-4398-b079-629d1dff2225 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:01.328324 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bae1e4-29a2-4398-b079-629d1dff2225 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:01.328678 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bae1e4-29a2-4398-b079-629d1dff2225 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:01.345611 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bae1e4-29a2-4398-b079-629d1dff2225 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:01.348440 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bae1e4-29a2-4398-b079-629d1dff2225 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:01.354334 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 252/497] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:01.364321 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c99409-5a0c-4c70-8f10-3c3a5790f846 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:01.383157 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-c0bae1e4-29a2-4398-b079-629d1dff2225 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:01.383157 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:01.383157 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:01.383157 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:01.383157 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:01.383157 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:01.383157 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:01.383157 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:01.383157 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:01.383157 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:01.383157 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:01.383157 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:01.383157 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:18:01.383157 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:18:01.383157 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:18:01.383157 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:18:01.384201 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:01.384201 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:01.384201 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:01.384201 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:01.384201 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:01.384201 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:01.384201 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:01.384201 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:01.384201 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:01.384201 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:01.384201 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:01.384201 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:01.384201 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:01.384201 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:01.384201 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:01.384201 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:01.384201 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:18:01.385215 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:18:01.385215 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:01.385215 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:01.385215 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 246/498] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:18:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 20:18:01.388490 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bae1e4-29a2-4398-b079-629d1dff2225 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:01.490063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:01.495418 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bae1e4-29a2-4398-b079-629d1dff2225 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:01.535349 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa7fb8-17d1-42b1-9311-89772190d250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:01.535968 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa7fb8-17d1-42b1-9311-89772190d250 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:01.536252 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa7fb8-17d1-42b1-9311-89772190d250 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:01.536531 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa7fb8-17d1-42b1-9311-89772190d250 None admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:01.537200 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa7fb8-17d1-42b1-9311-89772190d250 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:01.537506 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa7fb8-17d1-42b1-9311-89772190d250 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:01.539155 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa7fb8-17d1-42b1-9311-89772190d250 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:01.570171 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 247/499] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:18:01.572406 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa7fb8-17d1-42b1-9311-89772190d250 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:01.603462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c99409-5a0c-4c70-8f10-3c3a5790f846 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:01.673832 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f36ab-7060-43f7-b941-95f312cd5501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:01.674537 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f36ab-7060-43f7-b941-95f312cd5501 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:01.674818 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f36ab-7060-43f7-b941-95f312cd5501 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:01.675092 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f36ab-7060-43f7-b941-95f312cd5501 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:01.684652 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f36ab-7060-43f7-b941-95f312cd5501 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:01.686106 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f36ab-7060-43f7-b941-95f312cd5501 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:01.699582 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-3f3f36ab-7060-43f7-b941-95f312cd5501 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 20:18:01.699582 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:01.699582 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:01.699582 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:01.699582 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:01.699582 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:01.699582 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:01.699582 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:01.699582 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:01.699582 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:01.699582 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:01.699582 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:01.699582 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 20:18:01.699582 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 20:18:01.699582 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 20:18:01.699582 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 20:18:01.700499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:01.700499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:01.700499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 20:18:01.700499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:18:01.700499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 20:18:01.700499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:18:01.700499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:01.700499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:01.700499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:01.700499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:01.700499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:01.700499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:01.700499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:01.700499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:01.700499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:01.700499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:01.700499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:01.700499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:01.702844 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:01.702844 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:01.702844 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 20:18:01.702844 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 20:18:01.702844 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 20:18:01.702844 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 20:18:01.702844 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 20:18:01.702844 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 20:18:01.702844 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 20:18:01.702844 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:01.702844 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 253/500] 10.222.0.23 () {56 vars in 1093 bytes} [Wed Nov 2 20:18:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:01.711260 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f36ab-7060-43f7-b941-95f312cd5501 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:01.769500 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa7fb8-17d1-42b1-9311-89772190d250 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:01.810188 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ab536-f486-4d25-a5f4-edec38ca5d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:01.810831 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ab536-f486-4d25-a5f4-edec38ca5d8b None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:01.812813 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:01.813429 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ab536-f486-4d25-a5f4-edec38ca5d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:01.813429 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ab536-f486-4d25-a5f4-edec38ca5d8b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:01.821315 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ab536-f486-4d25-a5f4-edec38ca5d8b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:01.823026 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ab536-f486-4d25-a5f4-edec38ca5d8b None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:01.835529 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-962ab536-f486-4d25-a5f4-edec38ca5d8b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 20:18:01.835529 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:01.835529 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:01.835529 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:01.835529 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:01.835529 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:01.835529 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:01.835529 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:01.835529 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:01.835529 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:01.835529 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:01.835529 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:01.835529 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 20:18:01.835529 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 20:18:01.835529 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 20:18:01.835529 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 20:18:01.837261 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:01.837261 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:01.837261 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 20:18:01.837261 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:18:01.837261 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 20:18:01.837261 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:18:01.837261 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:01.837261 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:01.837261 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:01.837261 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:01.837261 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:01.837261 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:01.837261 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:01.837261 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:01.837261 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:01.837261 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:01.837261 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:01.837261 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:01.838423 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:01.838423 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:01.838423 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 20:18:01.838423 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 20:18:01.838423 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 20:18:01.838423 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 20:18:01.838423 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 20:18:01.838423 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 20:18:01.838423 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Nov 02 20:18:01.838423 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:01.843533 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 248/501] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Nov 2 20:18:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:01.845851 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ab536-f486-4d25-a5f4-edec38ca5d8b None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:01.866120 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:01.952071 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ab536-f486-4d25-a5f4-edec38ca5d8b None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:01.975386 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f36ab-7060-43f7-b941-95f312cd5501 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:01.993827 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3fbf0-2a39-41b9-aefd-d76b00e3c23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:01.994496 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3fbf0-2a39-41b9-aefd-d76b00e3c23d None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:01.994781 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3fbf0-2a39-41b9-aefd-d76b00e3c23d None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:01.995059 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3fbf0-2a39-41b9-aefd-d76b00e3c23d None admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:01.995788 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3fbf0-2a39-41b9-aefd-d76b00e3c23d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:01.996099 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3fbf0-2a39-41b9-aefd-d76b00e3c23d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:01.997561 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3fbf0-2a39-41b9-aefd-d76b00e3c23d None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:02.027123 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 249/502] 10.222.0.23 () {56 vars in 1135 bytes} [Wed Nov 2 20:18:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:18:02.032740 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3fbf0-2a39-41b9-aefd-d76b00e3c23d None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:02.049626 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8214c8-8247-4f2a-9e3b-893f566c17a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:02.050243 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8214c8-8247-4f2a-9e3b-893f566c17a7 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:02.050527 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8214c8-8247-4f2a-9e3b-893f566c17a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:02.050800 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8214c8-8247-4f2a-9e3b-893f566c17a7 None admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:02.051528 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8214c8-8247-4f2a-9e3b-893f566c17a7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:02.051887 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8214c8-8247-4f2a-9e3b-893f566c17a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:02.054161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8214c8-8247-4f2a-9e3b-893f566c17a7 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:02.092179 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 254/503] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Nov 2 20:18:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:02.109625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8214c8-8247-4f2a-9e3b-893f566c17a7 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:02.137027 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:02.160143 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3fbf0-2a39-41b9-aefd-d76b00e3c23d None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:02.202695 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53c08f-47e7-470f-8288-5d5af7b89ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:02.203312 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53c08f-47e7-470f-8288-5d5af7b89ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:02.203594 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53c08f-47e7-470f-8288-5d5af7b89ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:02.203869 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53c08f-47e7-470f-8288-5d5af7b89ff4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:02.276076 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53c08f-47e7-470f-8288-5d5af7b89ff4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:02.277963 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53c08f-47e7-470f-8288-5d5af7b89ff4 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:02.323326 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:02.326484 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8214c8-8247-4f2a-9e3b-893f566c17a7 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:02.362820 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6cda32-0f19-467c-9dcd-c666ebefb21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:02.363453 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6cda32-0f19-467c-9dcd-c666ebefb21e None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:02.363732 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6cda32-0f19-467c-9dcd-c666ebefb21e None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:02.364003 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6cda32-0f19-467c-9dcd-c666ebefb21e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:02.367337 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:02.376162 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6cda32-0f19-467c-9dcd-c666ebefb21e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:02.377658 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6cda32-0f19-467c-9dcd-c666ebefb21e None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:02.393289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-0e6cda32-0f19-467c-9dcd-c666ebefb21e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:02.393289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:02.393289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:02.393289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:02.393289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:02.393289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:02.393289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:02.393289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:02.393289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:02.393289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:02.393289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:02.393289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:02.393289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:18:02.393289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:18:02.393289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:18:02.393289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:18:02.395004 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:02.395004 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:02.395004 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:02.395004 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:02.395004 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:02.395004 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:02.395004 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:02.395004 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:02.395004 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:02.395004 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:02.395004 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:02.395004 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:02.395004 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:02.395004 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:02.395004 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:02.395004 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:02.395004 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:18:02.397179 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:18:02.397179 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:02.397179 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:02.397567 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 250/505] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Nov 2 20:18:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 20:18:02.397567 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce3d75-ef28-4041-8ded-f40387a00448 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:02.397567 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce3d75-ef28-4041-8ded-f40387a00448 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:02.397567 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce3d75-ef28-4041-8ded-f40387a00448 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:02.399429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 255/505] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:18:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:02.402718 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6cda32-0f19-467c-9dcd-c666ebefb21e None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:02.402966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 251/506] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:02.403992 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce3d75-ef28-4041-8ded-f40387a00448 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:02.517847 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6cda32-0f19-467c-9dcd-c666ebefb21e None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:02.538552 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce3d75-ef28-4041-8ded-f40387a00448 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:02.549854 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf2ce3-37d4-4f3e-ab83-4c089568c7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:02.550461 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf2ce3-37d4-4f3e-ab83-4c089568c7bc None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:02.550738 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf2ce3-37d4-4f3e-ab83-4c089568c7bc None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:02.551012 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf2ce3-37d4-4f3e-ab83-4c089568c7bc None admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:02.551657 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf2ce3-37d4-4f3e-ab83-4c089568c7bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:02.551960 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf2ce3-37d4-4f3e-ab83-4c089568c7bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:02.553377 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf2ce3-37d4-4f3e-ab83-4c089568c7bc None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:02.571146 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 256/507] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:02.572486 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db843b-dadc-4e66-bed5-3746299fcb13 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:02.572798 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db843b-dadc-4e66-bed5-3746299fcb13 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:02.573075 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db843b-dadc-4e66-bed5-3746299fcb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:02.577132 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7d14b-e644-4f3f-9bb8-81dd5d30b2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:02.577777 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7d14b-e644-4f3f-9bb8-81dd5d30b2f0 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:02.578056 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7d14b-e644-4f3f-9bb8-81dd5d30b2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:02.578332 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7d14b-e644-4f3f-9bb8-81dd5d30b2f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:02.591549 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff7d14b-e644-4f3f-9bb8-81dd5d30b2f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:02.591839 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-e3db843b-dadc-4e66-bed5-3746299fcb13 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:02.593032 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff7d14b-e644-4f3f-9bb8-81dd5d30b2f0 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:02.593136 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-e3db843b-dadc-4e66-bed5-3746299fcb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:02.600591 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:02.609794 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-dff7d14b-e644-4f3f-9bb8-81dd5d30b2f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:02.609794 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:02.609794 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:02.609794 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:02.609794 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:02.609794 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:02.609794 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:02.609794 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:02.609794 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:02.609794 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:02.609794 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:02.609794 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:02.609794 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:18:02.609794 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:18:02.609794 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:18:02.609794 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:18:02.610748 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:02.610748 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:02.610748 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:02.610748 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:02.610748 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:02.610748 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:02.610748 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:02.610748 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:02.610748 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:02.610748 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:02.610748 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:02.610748 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:02.610748 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:02.610748 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:02.610748 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:02.610748 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:02.610748 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:18:02.611687 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:18:02.611687 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:02.611687 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:02.611687 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 252/508] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:18:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:02.611687 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7d14b-e644-4f3f-9bb8-81dd5d30b2f0 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:02.641707 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:02.676585 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 257/509] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:18:02.676585 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e85b1-e358-4e9b-a7b9-63bcf1e3a6c1 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:02.676585 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e85b1-e358-4e9b-a7b9-63bcf1e3a6c1 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:02.676585 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e85b1-e358-4e9b-a7b9-63bcf1e3a6c1 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:02.679295 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 258/510] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:02.680541 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e85b1-e358-4e9b-a7b9-63bcf1e3a6c1 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:02.725925 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7d14b-e644-4f3f-9bb8-81dd5d30b2f0 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:02.766304 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636f2b1-834a-4314-97ac-4bedbc66aadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:02.767072 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636f2b1-834a-4314-97ac-4bedbc66aadc None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:02.767422 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636f2b1-834a-4314-97ac-4bedbc66aadc None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:02.767777 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636f2b1-834a-4314-97ac-4bedbc66aadc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:02.776785 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636f2b1-834a-4314-97ac-4bedbc66aadc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:02.778377 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636f2b1-834a-4314-97ac-4bedbc66aadc None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:02.791177 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-6636f2b1-834a-4314-97ac-4bedbc66aadc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:18:02.791177 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:02.791177 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:02.791177 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:02.791177 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:02.791177 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:02.791177 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:02.791177 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:02.791177 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:02.791177 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:02.791177 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:02.791177 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:02.791177 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 20:18:02.791177 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 20:18:02.791177 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 20:18:02.792028 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 20:18:02.792028 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:02.792028 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:02.792028 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:02.792028 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:02.792028 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:02.792028 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:02.792028 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:02.792028 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:02.792028 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:02.792028 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:02.792028 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:02.792028 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:02.792028 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:02.792028 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:02.792028 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:02.792028 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:02.792933 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 20:18:02.792933 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 20:18:02.792933 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 20:18:02.792933 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 20:18:02.792933 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 20:18:02.792933 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 20:18:02.792933 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:18:02.792933 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:02.792933 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 253/511] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:18:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:02.793570 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951daea-73d5-4208-9362-4143ff064d4f None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:02.794183 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951daea-73d5-4208-9362-4143ff064d4f None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:02.794562 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951daea-73d5-4208-9362-4143ff064d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:02.811577 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e85b1-e358-4e9b-a7b9-63bcf1e3a6c1 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:02.815508 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-f951daea-73d5-4208-9362-4143ff064d4f None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:02.816869 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-f951daea-73d5-4208-9362-4143ff064d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:02.856372 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599db907-e133-4fe8-9251-4777468353d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:02.857010 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599db907-e133-4fe8-9251-4777468353d8 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:02.857293 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599db907-e133-4fe8-9251-4777468353d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:02.857569 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599db907-e133-4fe8-9251-4777468353d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:02.858401 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599db907-e133-4fe8-9251-4777468353d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:02.858708 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599db907-e133-4fe8-9251-4777468353d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:02.860967 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599db907-e133-4fe8-9251-4777468353d8 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:02.878229 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 259/512] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:02.878229 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599db907-e133-4fe8-9251-4777468353d8 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:02.878229 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:02.898351 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 254/513] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:18:02.899801 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38be91c-f95f-4808-9a5c-25f31d038fb3 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:02.900160 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38be91c-f95f-4808-9a5c-25f31d038fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:02.900508 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38be91c-f95f-4808-9a5c-25f31d038fb3 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:02.905902 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 255/514] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:02.905902 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38be91c-f95f-4808-9a5c-25f31d038fb3 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:02.926097 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:02.991935 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599db907-e133-4fe8-9251-4777468353d8 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:03.027060 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa0a81-900f-46e2-a065-578ab9db05b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:03.027270 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38be91c-f95f-4808-9a5c-25f31d038fb3 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:03.027661 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa0a81-900f-46e2-a065-578ab9db05b2 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:03.027940 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa0a81-900f-46e2-a065-578ab9db05b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:03.028213 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa0a81-900f-46e2-a065-578ab9db05b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:03.028934 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa0a81-900f-46e2-a065-578ab9db05b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:03.029239 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa0a81-900f-46e2-a065-578ab9db05b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:03.030667 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa0a81-900f-46e2-a065-578ab9db05b2 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:03.047218 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 260/515] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Nov 2 20:18:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:03.047218 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afad0b-eb0d-4244-bfdb-e18f7a89eeaf None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:03.047218 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afad0b-eb0d-4244-bfdb-e18f7a89eeaf None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:03.047218 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afad0b-eb0d-4244-bfdb-e18f7a89eeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:03.062363 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-19afad0b-eb0d-4244-bfdb-e18f7a89eeaf None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:03.063550 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-19afad0b-eb0d-4244-bfdb-e18f7a89eeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:03.069788 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6ed8f-0180-4403-8472-107bf0a1aed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:03.070419 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6ed8f-0180-4403-8472-107bf0a1aed6 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:03.070696 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6ed8f-0180-4403-8472-107bf0a1aed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:03.071498 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6ed8f-0180-4403-8472-107bf0a1aed6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:03.078192 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6ed8f-0180-4403-8472-107bf0a1aed6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:03.079617 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6ed8f-0180-4403-8472-107bf0a1aed6 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:03.091298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-27b6ed8f-0180-4403-8472-107bf0a1aed6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:18:03.091298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:03.091298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:03.091298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:03.091298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:03.091298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:03.091298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:03.091298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:03.091298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:03.091298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:03.091298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:03.091298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:03.091298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 20:18:03.091298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 20:18:03.091298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 20:18:03.092342 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 20:18:03.092342 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:03.092342 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:03.092342 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:03.092342 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:03.092342 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:03.092342 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:03.092342 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:03.092342 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:03.092342 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:03.092342 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:03.092342 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:03.092342 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:03.092342 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:03.092342 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:03.092342 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:03.092342 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:03.093507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 20:18:03.093507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 20:18:03.093507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 20:18:03.093507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 20:18:03.093507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 20:18:03.093507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 20:18:03.093507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:18:03.093507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:03.093507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 256/516] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:18:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:03.093507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6ed8f-0180-4403-8472-107bf0a1aed6 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:03.128835 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:03.142670 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 261/517] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:18:03.143476 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afad0b-eb0d-4244-bfdb-e18f7a89eeaf None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:03.183922 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:03.206281 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6ed8f-0180-4403-8472-107bf0a1aed6 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:03.242314 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07d636-dbec-402f-b4dc-0b79cb030c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:03.242980 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07d636-dbec-402f-b4dc-0b79cb030c12 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:03.243514 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07d636-dbec-402f-b4dc-0b79cb030c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:03.243795 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07d636-dbec-402f-b4dc-0b79cb030c12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:03.255839 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07d636-dbec-402f-b4dc-0b79cb030c12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:03.258215 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07d636-dbec-402f-b4dc-0b79cb030c12 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:03.259803 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afad0b-eb0d-4244-bfdb-e18f7a89eeaf None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:03.274541 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-4b07d636-dbec-402f-b4dc-0b79cb030c12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:03.274541 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:03.274541 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:03.274541 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:03.274541 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:03.274541 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:03.274541 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:03.274541 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:03.274541 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:03.274541 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:03.274541 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:03.274541 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:03.274541 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:18:03.274541 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:18:03.274541 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:18:03.274541 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:18:03.275472 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:03.275472 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:03.275472 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:03.275472 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:03.275472 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:03.275472 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:03.275472 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:03.275472 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:03.275472 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:03.275472 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:03.275472 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:03.275472 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:03.275472 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:03.275472 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:03.275472 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:03.275472 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:03.275472 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:18:03.276335 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:18:03.276335 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:03.276335 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:03.282954 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 257/518] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:18:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:03.282954 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07d636-dbec-402f-b4dc-0b79cb030c12 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:03.296411 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b36710-975f-4a7b-b094-65437a107c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:03.297283 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b36710-975f-4a7b-b094-65437a107c78 None admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:03.297530 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b36710-975f-4a7b-b094-65437a107c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:03.297745 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b36710-975f-4a7b-b094-65437a107c78 None admin] PATH_INFO: `/v3/projects/a144e65ce44c44dc99c07a7f5be303b7/users/f906fd11db004026a78eb3d69fa5b298/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:03.299667 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b36710-975f-4a7b-b094-65437a107c78 None admin] RBAC: Authorizing `identity:create_grant(project_id=a144e65ce44c44dc99c07a7f5be303b7, user_id=f906fd11db004026a78eb3d69fa5b298, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:03.301085 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b36710-975f-4a7b-b094-65437a107c78 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:03.314438 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 262/519] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Nov 2 20:18:03 2022] PUT /identity/v3/projects/a144e65ce44c44dc99c07a7f5be303b7/users/f906fd11db004026a78eb3d69fa5b298/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:18:03.315599 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b36710-975f-4a7b-b094-65437a107c78 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:03.389703 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:03.413205 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07d636-dbec-402f-b4dc-0b79cb030c12 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:03.446594 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b36710-975f-4a7b-b094-65437a107c78 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:03.446811 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:03.453982 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd067b-aa74-4e98-b433-8e89ff7685b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:03.455066 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd067b-aa74-4e98-b433-8e89ff7685b9 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:03.455544 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd067b-aa74-4e98-b433-8e89ff7685b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:03.456014 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd067b-aa74-4e98-b433-8e89ff7685b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:03.457012 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd067b-aa74-4e98-b433-8e89ff7685b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:03.457388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd067b-aa74-4e98-b433-8e89ff7685b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:03.458857 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd067b-aa74-4e98-b433-8e89ff7685b9 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:03.472371 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 258/520] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Nov 2 20:18:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:03.473698 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd067b-aa74-4e98-b433-8e89ff7685b9 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:03.492336 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3371aa7-8a1a-45b4-8da9-1b3bf94d10f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:03.493564 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3371aa7-8a1a-45b4-8da9-1b3bf94d10f2 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:03.493845 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3371aa7-8a1a-45b4-8da9-1b3bf94d10f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:03.494116 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3371aa7-8a1a-45b4-8da9-1b3bf94d10f2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:03.494703 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3371aa7-8a1a-45b4-8da9-1b3bf94d10f2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:03.496100 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3371aa7-8a1a-45b4-8da9-1b3bf94d10f2 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:03.511429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-f3371aa7-8a1a-45b4-8da9-1b3bf94d10f2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 20:18:03.511429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:03.511429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 20:18:03.511429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 20:18:03.511429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 20:18:03.511429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 20:18:03.511429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 20:18:03.511429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:03.511429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 20:18:03.511429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:03.511429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 20:18:03.511429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:03.511429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:03.511429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:03.511429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:03.511429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:03.511429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:03.512727 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:03.512727 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:03.512727 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:03.512727 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:03.512727 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:03.512727 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:03.512727 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 20:18:03.512727 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 20:18:03.512727 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 20:18:03.512727 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 20:18:03.512727 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:03.512727 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:03.512727 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:03.512727 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:03.512727 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:03.512727 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:03.513728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:03.513728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:03.513728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:03.513728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:03.513728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:03.513728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:03.513728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:03.513728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:03.513728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:03.513728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:03.513728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 20:18:03.513728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:03.513728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 20:18:03.513728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:03.513728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 263/521] 10.222.0.23 () {56 vars in 1129 bytes} [Wed Nov 2 20:18:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:03.518302 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3371aa7-8a1a-45b4-8da9-1b3bf94d10f2 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:03.587631 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd067b-aa74-4e98-b433-8e89ff7685b9 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:03.622442 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3371aa7-8a1a-45b4-8da9-1b3bf94d10f2 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:03.624701 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee685f77-06be-4e5f-a0fb-f71527a8eb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:03.625326 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee685f77-06be-4e5f-a0fb-f71527a8eb79 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:03.625604 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee685f77-06be-4e5f-a0fb-f71527a8eb79 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:03.625879 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee685f77-06be-4e5f-a0fb-f71527a8eb79 None admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:03.626513 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee685f77-06be-4e5f-a0fb-f71527a8eb79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:03.626816 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee685f77-06be-4e5f-a0fb-f71527a8eb79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:03.628174 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee685f77-06be-4e5f-a0fb-f71527a8eb79 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:03.644965 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 259/522] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:18:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:03.644965 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee685f77-06be-4e5f-a0fb-f71527a8eb79 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:03.646207 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:03.662839 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127055e-f5c5-4392-ba78-cfad8cd60a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:03.663470 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127055e-f5c5-4392-ba78-cfad8cd60a2a None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:03.663748 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127055e-f5c5-4392-ba78-cfad8cd60a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:03.664171 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127055e-f5c5-4392-ba78-cfad8cd60a2a None admin] PATH_INFO: `/v3/services/network` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:03.665123 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127055e-f5c5-4392-ba78-cfad8cd60a2a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:03.666508 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127055e-f5c5-4392-ba78-cfad8cd60a2a None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:03.675886 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-7127055e-f5c5-4392-ba78-cfad8cd60a2a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 20:18:03.675886 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:03.675886 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 20:18:03.675886 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 20:18:03.675886 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 20:18:03.675886 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 20:18:03.675886 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 20:18:03.675886 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:03.675886 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 20:18:03.675886 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:03.675886 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 20:18:03.675886 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:03.675886 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:03.675886 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:03.675886 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:03.675886 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:03.675886 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:03.676937 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:03.676937 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:03.676937 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:03.676937 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:03.676937 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:03.676937 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:03.676937 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 20:18:03.676937 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 20:18:03.676937 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 20:18:03.676937 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 20:18:03.676937 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:03.676937 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:03.676937 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:03.676937 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:03.676937 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:03.676937 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:03.677776 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:03.677776 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:03.677776 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:03.677776 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:03.677776 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:03.677776 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:03.677776 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:03.677776 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:03.677776 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:03.677776 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:03.677776 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 20:18:03.677776 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:03.677776 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 20:18:03.677776 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:03.677776 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 264/523] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:18:03 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:03.678575 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127055e-f5c5-4392-ba78-cfad8cd60a2a None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:03.701420 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:03.751233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee685f77-06be-4e5f-a0fb-f71527a8eb79 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:03.785813 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12bb3ae-25f4-4c2c-80a8-7b5885ea13b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:03.786475 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127055e-f5c5-4392-ba78-cfad8cd60a2a None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:03.787269 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bb3ae-25f4-4c2c-80a8-7b5885ea13b5 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:03.787724 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bb3ae-25f4-4c2c-80a8-7b5885ea13b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:03.788142 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bb3ae-25f4-4c2c-80a8-7b5885ea13b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:03.789040 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12bb3ae-25f4-4c2c-80a8-7b5885ea13b5 None admin] RBAC: Adding query filter params (role.id=59b45b6df1ee465bbbb8bdba4b4e281d, scope.project.id=a144e65ce44c44dc99c07a7f5be303b7, user.id=95f22f80ac694e9888c132af1e58e292) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:03.789406 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12bb3ae-25f4-4c2c-80a8-7b5885ea13b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:03.791364 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12bb3ae-25f4-4c2c-80a8-7b5885ea13b5 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:03.804583 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 260/524] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Nov 2 20:18:03 2022] GET /identity/v3/role_assignments?user.id=95f22f80ac694e9888c132af1e58e292&scope.project.id=a144e65ce44c44dc99c07a7f5be303b7&role.id=59b45b6df1ee465bbbb8bdba4b4e281d => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:03.804583 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12bb3ae-25f4-4c2c-80a8-7b5885ea13b5 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:03.841007 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8025b-c136-4ef3-be11-e9820e377fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:03.841864 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8025b-c136-4ef3-be11-e9820e377fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:03.842652 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8025b-c136-4ef3-be11-e9820e377fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:03.842935 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8025b-c136-4ef3-be11-e9820e377fb5 None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:03.843879 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8025b-c136-4ef3-be11-e9820e377fb5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:03.844190 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8025b-c136-4ef3-be11-e9820e377fb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:03.846718 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8025b-c136-4ef3-be11-e9820e377fb5 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:03.854138 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 265/525] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Nov 2 20:18:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:03.855001 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8025b-c136-4ef3-be11-e9820e377fb5 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:03.911992 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:03.922125 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12bb3ae-25f4-4c2c-80a8-7b5885ea13b5 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:03.938181 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:03.960283 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6ba69-5c23-49c5-93e2-ce21b3542dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:03.961028 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6ba69-5c23-49c5-93e2-ce21b3542dd9 None admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:03.961377 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6ba69-5c23-49c5-93e2-ce21b3542dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:03.962254 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6ba69-5c23-49c5-93e2-ce21b3542dd9 None admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:03.962977 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6ba69-5c23-49c5-93e2-ce21b3542dd9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:03.964600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6ba69-5c23-49c5-93e2-ce21b3542dd9 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:03.978878 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8025b-c136-4ef3-be11-e9820e377fb5 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:03.989897 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 261/526] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Nov 2 20:18:03 2022] POST /identity/v3/users => generated 254 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:18:03.990797 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6ba69-5c23-49c5-93e2-ce21b3542dd9 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:04.031146 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c024885-ff5d-40a0-9928-3c62cd22e2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:04.031776 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c024885-ff5d-40a0-9928-3c62cd22e2f2 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:04.032056 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c024885-ff5d-40a0-9928-3c62cd22e2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:04.032332 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c024885-ff5d-40a0-9928-3c62cd22e2f2 None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:04.033026 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c024885-ff5d-40a0-9928-3c62cd22e2f2 None admin] RBAC: Adding query filter params (name=network) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:04.033333 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c024885-ff5d-40a0-9928-3c62cd22e2f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:04.034741 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c024885-ff5d-40a0-9928-3c62cd22e2f2 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:04.040337 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 266/527] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Nov 2 20:18:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:04.046656 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c024885-ff5d-40a0-9928-3c62cd22e2f2 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:04.138658 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6ba69-5c23-49c5-93e2-ce21b3542dd9 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:04.179707 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c024885-ff5d-40a0-9928-3c62cd22e2f2 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:04.192011 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:04.197907 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f627a-1919-403a-bc82-5d1b064bc591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:04.198542 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f627a-1919-403a-bc82-5d1b064bc591 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:04.198824 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f627a-1919-403a-bc82-5d1b064bc591 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:04.199100 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f627a-1919-403a-bc82-5d1b064bc591 None admin] PATH_INFO: `/v3/services` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:04.199744 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f627a-1919-403a-bc82-5d1b064bc591 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:04.200049 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f627a-1919-403a-bc82-5d1b064bc591 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:04.201513 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f627a-1919-403a-bc82-5d1b064bc591 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:04.220969 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 262/528] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Nov 2 20:18:03 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:04.230081 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82cc38-434f-4afd-96e5-9a55666df296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:04.230703 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82cc38-434f-4afd-96e5-9a55666df296 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:04.230984 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82cc38-434f-4afd-96e5-9a55666df296 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:04.231258 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82cc38-434f-4afd-96e5-9a55666df296 None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:04.231901 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c82cc38-434f-4afd-96e5-9a55666df296 None admin] RBAC: Adding query filter params (type=network) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:04.232205 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c82cc38-434f-4afd-96e5-9a55666df296 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:04.233748 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c82cc38-434f-4afd-96e5-9a55666df296 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:04.240774 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 267/529] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Nov 2 20:18:04 2022] GET /identity/v3/services?type=network => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:18:05.636391 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29cbd3-af3f-45d5-a362-9af5ab4ce0d4 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:05.636971 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29cbd3-af3f-45d5-a362-9af5ab4ce0d4 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:05.636971 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29cbd3-af3f-45d5-a362-9af5ab4ce0d4 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:05.638547 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 263/530] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:05.644324 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4f3f4-3150-41b9-a7df-02f96d715664 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:05.644872 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4f3f4-3150-41b9-a7df-02f96d715664 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:05.644872 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4f3f4-3150-41b9-a7df-02f96d715664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:05.669657 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-69c4f3f4-3150-41b9-a7df-02f96d715664 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:05.670871 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-69c4f3f4-3150-41b9-a7df-02f96d715664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:05.761840 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 268/531] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:18:06.189773 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29cbd3-af3f-45d5-a362-9af5ab4ce0d4 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:06.231585 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:06.314170 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29cbd3-af3f-45d5-a362-9af5ab4ce0d4 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:06.365445 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b511f-c557-41a5-bcb3-f4709d460ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:06.366121 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b511f-c557-41a5-bcb3-f4709d460ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:06.366409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b511f-c557-41a5-bcb3-f4709d460ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:06.366679 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b511f-c557-41a5-bcb3-f4709d460ee7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:06.381688 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b511f-c557-41a5-bcb3-f4709d460ee7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:18:06.386558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-7b6b511f-c557-41a5-bcb3-f4709d460ee7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:18:06.386558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:06.386558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:06.386558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:06.386558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:06.386558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:06.386558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:06.386558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:06.386558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:06.386558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:06.386558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:06.386558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:06.386558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:18:06.386558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:18:06.386558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:18:06.386558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:18:06.387464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:18:06.387464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:18:06.387464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:18:06.387464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:18:06.387464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:06.387464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:06.387464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:06.387464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:06.387464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:06.387464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:06.387464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:06.387464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:06.387464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:06.387464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:06.387464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:06.387464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:06.388280 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:06.388280 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:06.388280 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:06.388280 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:06.388280 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:18:06.388280 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:18:06.388280 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:18:06.388280 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:18:06.388280 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:18:06.388280 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:18:06.388280 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:18:06.388280 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:06.388280 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 264/532] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Nov 2 20:18:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:06.395596 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4f3f4-3150-41b9-a7df-02f96d715664 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:06.488021 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8a4b5-7c70-4327-b047-e4116a304acf None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:06.488229 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8a4b5-7c70-4327-b047-e4116a304acf None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:06.488512 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8a4b5-7c70-4327-b047-e4116a304acf None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:06.490138 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 265/533] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 20:18:06.495281 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7b63b-d2f6-4787-8083-1ef15471c330 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:06.495565 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7b63b-d2f6-4787-8083-1ef15471c330 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:06.495838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7b63b-d2f6-4787-8083-1ef15471c330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:06.526150 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-deb7b63b-d2f6-4787-8083-1ef15471c330 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:06.527352 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-deb7b63b-d2f6-4787-8083-1ef15471c330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:06.543222 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4f3f4-3150-41b9-a7df-02f96d715664 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:06.544906 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:06.605821 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28afc4c-6bfe-4cbf-a603-21ff40bec173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:06.606431 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28afc4c-6bfe-4cbf-a603-21ff40bec173 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:06.606719 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28afc4c-6bfe-4cbf-a603-21ff40bec173 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:06.606995 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28afc4c-6bfe-4cbf-a603-21ff40bec173 None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:06.607669 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28afc4c-6bfe-4cbf-a603-21ff40bec173 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:06.607974 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28afc4c-6bfe-4cbf-a603-21ff40bec173 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:06.609375 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28afc4c-6bfe-4cbf-a603-21ff40bec173 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:06.626333 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 269/534] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:18:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:06.631763 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28afc4c-6bfe-4cbf-a603-21ff40bec173 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:06.663941 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 266/535] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 20:18:06.758043 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28afc4c-6bfe-4cbf-a603-21ff40bec173 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:06.797504 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3b7ac-25c2-4d98-9dd3-4308427bc045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:06.798142 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3b7ac-25c2-4d98-9dd3-4308427bc045 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:06.798428 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3b7ac-25c2-4d98-9dd3-4308427bc045 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:06.798702 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3b7ac-25c2-4d98-9dd3-4308427bc045 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:06.812034 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b3b7ac-25c2-4d98-9dd3-4308427bc045 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:06.813590 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b3b7ac-25c2-4d98-9dd3-4308427bc045 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:06.828861 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-90b3b7ac-25c2-4d98-9dd3-4308427bc045 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:06.828861 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:06.828861 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:06.828861 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:06.828861 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:06.828861 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:06.828861 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:06.828861 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:06.828861 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:06.828861 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:06.828861 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:06.828861 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:06.828861 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:18:06.828861 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:18:06.828861 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:18:06.828861 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:18:06.829833 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:06.829833 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:06.829833 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:06.829833 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:06.829833 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:06.829833 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:06.829833 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:06.829833 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:06.829833 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:06.829833 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:06.829833 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:06.829833 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:06.829833 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:06.829833 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:06.829833 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:06.829833 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:06.829833 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:18:06.830707 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:18:06.830707 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:06.830707 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:06.830707 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 270/536] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:18:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:06.836883 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7b63b-d2f6-4787-8083-1ef15471c330 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:06.873641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580152f2-2fbb-4bd8-bd07-3ba6c3ec8fa6 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:06.873641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580152f2-2fbb-4bd8-bd07-3ba6c3ec8fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:06.873641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580152f2-2fbb-4bd8-bd07-3ba6c3ec8fa6 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:06.874375 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 271/537] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:06.880183 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020fc69-3002-4853-b1f6-29ab26bfe382 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:06.880830 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020fc69-3002-4853-b1f6-29ab26bfe382 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:06.881334 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020fc69-3002-4853-b1f6-29ab26bfe382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:06.885701 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:06.904350 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-8020fc69-3002-4853-b1f6-29ab26bfe382 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:06.905905 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-8020fc69-3002-4853-b1f6-29ab26bfe382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:06.918465 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:06.982577 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 272/538] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 20:18:07.030725 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7b63b-d2f6-4787-8083-1ef15471c330 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:07.053377 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020fc69-3002-4853-b1f6-29ab26bfe382 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:07.083225 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22e388-74fa-450f-9657-69c0d8ab95ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:07.083874 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22e388-74fa-450f-9657-69c0d8ab95ff None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:07.084161 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22e388-74fa-450f-9657-69c0d8ab95ff None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:07.084441 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22e388-74fa-450f-9657-69c0d8ab95ff None admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:07.085152 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22e388-74fa-450f-9657-69c0d8ab95ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:07.085468 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22e388-74fa-450f-9657-69c0d8ab95ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:07.087455 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22e388-74fa-450f-9657-69c0d8ab95ff None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:07.102136 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 267/539] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:07.104008 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152511e8-d9af-4550-86e9-8b77f76bcff4 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:07.104008 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152511e8-d9af-4550-86e9-8b77f76bcff4 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:07.104200 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152511e8-d9af-4550-86e9-8b77f76bcff4 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:07.105885 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 268/540] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:07.111131 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152511e8-d9af-4550-86e9-8b77f76bcff4 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:07.182479 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020fc69-3002-4853-b1f6-29ab26bfe382 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:07.213982 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:07.224161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11319c-0bbc-4d83-9885-d44b20059baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:07.224859 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11319c-0bbc-4d83-9885-d44b20059baf None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:07.225109 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11319c-0bbc-4d83-9885-d44b20059baf None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:07.225379 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11319c-0bbc-4d83-9885-d44b20059baf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:07.231585 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152511e8-d9af-4550-86e9-8b77f76bcff4 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:07.235600 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11319c-0bbc-4d83-9885-d44b20059baf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:18:07.240338 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-1e11319c-0bbc-4d83-9885-d44b20059baf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:18:07.240338 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:07.240338 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:07.240338 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:07.240338 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:07.240338 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:07.240338 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:07.240338 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:07.240338 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:07.240338 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:07.240338 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:07.240338 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:07.240338 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:18:07.240338 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:18:07.240338 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:18:07.240338 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:18:07.241308 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:18:07.241308 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:18:07.241308 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:18:07.241308 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:18:07.241308 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:07.241308 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:07.241308 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:07.241308 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:07.241308 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:07.241308 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:07.241308 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:07.241308 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:07.241308 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:07.241308 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:07.241308 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:07.241308 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:07.242137 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:07.242137 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:07.242137 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:07.242137 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:07.242137 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:18:07.242137 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:18:07.242137 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:18:07.242137 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:18:07.242137 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:18:07.242137 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:18:07.242137 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:18:07.242137 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:07.242137 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 273/541] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Nov 2 20:18:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:07.243340 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3124399-9800-4e38-b452-6a53058cb908 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:07.243340 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3124399-9800-4e38-b452-6a53058cb908 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:07.244306 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3124399-9800-4e38-b452-6a53058cb908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:07.256623 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:07.262750 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-e3124399-9800-4e38-b452-6a53058cb908 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:07.263859 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-e3124399-9800-4e38-b452-6a53058cb908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:07.272887 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f841a0a-c6af-459b-b07b-1074d89b0c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:07.273525 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f841a0a-c6af-459b-b07b-1074d89b0c5b None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:07.273807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f841a0a-c6af-459b-b07b-1074d89b0c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:07.274137 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f841a0a-c6af-459b-b07b-1074d89b0c5b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:07.281767 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f841a0a-c6af-459b-b07b-1074d89b0c5b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:07.283146 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f841a0a-c6af-459b-b07b-1074d89b0c5b None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:07.295711 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-0f841a0a-c6af-459b-b07b-1074d89b0c5b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 20:18:07.295711 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:07.295711 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:07.295711 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:07.295711 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:07.295711 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:07.295711 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:07.295711 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:07.295711 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:07.295711 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:07.295711 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:07.295711 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:07.295711 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 20:18:07.295711 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 20:18:07.295711 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 20:18:07.295711 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 20:18:07.296720 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:07.296720 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:07.296720 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 20:18:07.296720 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:18:07.296720 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 20:18:07.296720 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:18:07.296720 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:07.296720 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:07.296720 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:07.296720 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:07.296720 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:07.296720 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:07.296720 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:07.296720 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:07.296720 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:07.296720 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:07.296720 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:07.296720 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:07.297682 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:07.297682 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:07.297682 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 20:18:07.297682 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 20:18:07.297682 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 20:18:07.297682 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 20:18:07.297682 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 20:18:07.297682 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 20:18:07.297682 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 20:18:07.297682 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:07.297682 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 269/542] 10.222.0.23 () {56 vars in 1093 bytes} [Wed Nov 2 20:18:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:07.298274 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec29b77-4571-4bda-8307-954dc5c8df6f None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:07.298343 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec29b77-4571-4bda-8307-954dc5c8df6f None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:07.298597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec29b77-4571-4bda-8307-954dc5c8df6f None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:07.299791 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 270/543] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:07.300490 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec29b77-4571-4bda-8307-954dc5c8df6f None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:07.336295 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 274/544] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:18:07.337122 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3124399-9800-4e38-b452-6a53058cb908 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:07.403138 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec29b77-4571-4bda-8307-954dc5c8df6f None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:07.438013 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbe513-1df8-4c3f-a50e-70ad2c7d16a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:07.438626 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbe513-1df8-4c3f-a50e-70ad2c7d16a1 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:07.438931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbe513-1df8-4c3f-a50e-70ad2c7d16a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:07.439187 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbe513-1df8-4c3f-a50e-70ad2c7d16a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:07.439847 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbe513-1df8-4c3f-a50e-70ad2c7d16a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:07.440155 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbe513-1df8-4c3f-a50e-70ad2c7d16a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:07.441553 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbe513-1df8-4c3f-a50e-70ad2c7d16a1 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:07.441881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3124399-9800-4e38-b452-6a53058cb908 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:07.452591 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 271/545] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:18:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:07.452591 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308c5a6-8438-4ce1-a4b1-ac6ee8651b47 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:07.452591 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308c5a6-8438-4ce1-a4b1-ac6ee8651b47 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:07.452591 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308c5a6-8438-4ce1-a4b1-ac6ee8651b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:07.464291 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:07.470560 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-7308c5a6-8438-4ce1-a4b1-ac6ee8651b47 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:07.471757 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-7308c5a6-8438-4ce1-a4b1-ac6ee8651b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:07.483464 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390adcf-3fd0-4ad1-a2dd-13eb6cc260c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:07.484092 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390adcf-3fd0-4ad1-a2dd-13eb6cc260c0 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:07.484372 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390adcf-3fd0-4ad1-a2dd-13eb6cc260c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:07.484688 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390adcf-3fd0-4ad1-a2dd-13eb6cc260c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:07.487774 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:07.497287 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390adcf-3fd0-4ad1-a2dd-13eb6cc260c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:18:07.502626 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-5390adcf-3fd0-4ad1-a2dd-13eb6cc260c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 20:18:07.502626 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:07.502626 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:07.502626 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:07.502626 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:07.502626 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:07.502626 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:07.502626 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:07.502626 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:07.502626 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:07.502626 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:07.502626 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:07.502626 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:18:07.502626 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:18:07.502626 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:18:07.502626 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:18:07.503547 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:18:07.503547 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:18:07.503547 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:18:07.503547 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:18:07.503547 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:07.503547 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:07.503547 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:07.503547 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:07.503547 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:07.503547 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:07.503547 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:07.503547 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:07.503547 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:07.503547 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:07.503547 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:07.503547 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:07.504390 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:07.504390 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:07.504390 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:07.504390 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:07.504390 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:18:07.504390 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:18:07.504390 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:18:07.504390 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:18:07.504390 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:18:07.504390 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:18:07.504390 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 20:18:07.504390 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:07.504390 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 275/546] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Nov 2 20:18:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:07.505756 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390adcf-3fd0-4ad1-a2dd-13eb6cc260c0 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:07.551026 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 272/547] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 20:18:07.551807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308c5a6-8438-4ce1-a4b1-ac6ee8651b47 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:07.635669 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390adcf-3fd0-4ad1-a2dd-13eb6cc260c0 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:07.655723 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308c5a6-8438-4ce1-a4b1-ac6ee8651b47 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:07.669697 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a552b-c5f4-447a-8f70-2c8b50b24574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:07.670308 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a552b-c5f4-447a-8f70-2c8b50b24574 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:07.670593 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a552b-c5f4-447a-8f70-2c8b50b24574 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:07.670868 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a552b-c5f4-447a-8f70-2c8b50b24574 None admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:07.671613 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a552b-c5f4-447a-8f70-2c8b50b24574 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:07.671887 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a552b-c5f4-447a-8f70-2c8b50b24574 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:07.673350 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a552b-c5f4-447a-8f70-2c8b50b24574 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:07.692418 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58254746-efd5-4774-9c3d-27073f498736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:07.697393 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 276/548] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Nov 2 20:18:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:07.697489 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58254746-efd5-4774-9c3d-27073f498736 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:07.697489 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58254746-efd5-4774-9c3d-27073f498736 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:07.697666 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a552b-c5f4-447a-8f70-2c8b50b24574 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:07.697769 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58254746-efd5-4774-9c3d-27073f498736 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:07.700916 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:07.711934 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58254746-efd5-4774-9c3d-27073f498736 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:07.713418 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58254746-efd5-4774-9c3d-27073f498736 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:07.730409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-58254746-efd5-4774-9c3d-27073f498736 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:07.730409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:07.730409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:07.730409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:07.730409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:07.730409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:07.730409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:07.730409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:07.730409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:07.730409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:07.730409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:07.730409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:07.730409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:18:07.730409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:18:07.730409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:18:07.730409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:18:07.731358 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:07.731358 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:07.731358 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:07.731358 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:07.731358 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:07.731358 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:07.731358 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:07.731358 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:07.731358 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:07.731358 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:07.731358 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:07.731358 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:07.731358 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:07.731358 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:07.731358 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:07.731358 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:07.731358 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:18:07.732345 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:18:07.732345 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:07.732345 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:07.732929 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 273/549] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:18:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:07.733451 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58254746-efd5-4774-9c3d-27073f498736 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:07.756654 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:07.803570 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a552b-c5f4-447a-8f70-2c8b50b24574 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:07.838171 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b2900-84c5-47a4-882b-fa5cd8ba2761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:07.838790 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b2900-84c5-47a4-882b-fa5cd8ba2761 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:07.839064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b2900-84c5-47a4-882b-fa5cd8ba2761 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:07.839337 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b2900-84c5-47a4-882b-fa5cd8ba2761 None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:07.839995 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b2900-84c5-47a4-882b-fa5cd8ba2761 None admin] RBAC: Adding query filter params (name=service) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:07.840299 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b2900-84c5-47a4-882b-fa5cd8ba2761 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:07.841638 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58254746-efd5-4774-9c3d-27073f498736 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:07.841741 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b2900-84c5-47a4-882b-fa5cd8ba2761 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:07.849432 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 277/550] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Nov 2 20:18:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:07.850289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b2900-84c5-47a4-882b-fa5cd8ba2761 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:07.877238 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a706aca-a739-4d11-8e77-006bce728ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:07.877846 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a706aca-a739-4d11-8e77-006bce728ce9 None admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:07.878130 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a706aca-a739-4d11-8e77-006bce728ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:07.878404 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a706aca-a739-4d11-8e77-006bce728ce9 None admin] PATH_INFO: `/v3/services` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:07.879046 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a706aca-a739-4d11-8e77-006bce728ce9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:07.880404 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a706aca-a739-4d11-8e77-006bce728ce9 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:07.895417 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 274/551] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Nov 2 20:18:07 2022] POST /identity/v3/services => generated 240 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:18:07.895417 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a706aca-a739-4d11-8e77-006bce728ce9 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:07.958904 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b2900-84c5-47a4-882b-fa5cd8ba2761 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:07.960800 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:07.980021 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:08.007351 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba957a6-7220-467b-a74c-997e0316a10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:08.008028 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba957a6-7220-467b-a74c-997e0316a10c None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:08.008902 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba957a6-7220-467b-a74c-997e0316a10c None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:08.009186 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba957a6-7220-467b-a74c-997e0316a10c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:08.020679 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a706aca-a739-4d11-8e77-006bce728ce9 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:08.058787 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c160a38-52d2-4a8c-8b78-5325f84fffe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:08.059314 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c160a38-52d2-4a8c-8b78-5325f84fffe6 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:08.059597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c160a38-52d2-4a8c-8b78-5325f84fffe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:08.059874 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c160a38-52d2-4a8c-8b78-5325f84fffe6 None admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:08.060527 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c160a38-52d2-4a8c-8b78-5325f84fffe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:08.060861 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c160a38-52d2-4a8c-8b78-5325f84fffe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:08.062238 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c160a38-52d2-4a8c-8b78-5325f84fffe6 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:08.076401 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 275/552] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:08.077189 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c160a38-52d2-4a8c-8b78-5325f84fffe6 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:08.090030 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba957a6-7220-467b-a74c-997e0316a10c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:08.090758 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba957a6-7220-467b-a74c-997e0316a10c None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:08.189872 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c160a38-52d2-4a8c-8b78-5325f84fffe6 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:08.200613 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:08.206036 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 278/553] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Nov 2 20:18:07 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 20:18:08.206036 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba957a6-7220-467b-a74c-997e0316a10c None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:08.221370 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:08.231064 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8c7d8-d2f6-482d-a3b4-3a6f0577f8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:08.231774 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8c7d8-d2f6-482d-a3b4-3a6f0577f8a0 None admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:08.232122 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8c7d8-d2f6-482d-a3b4-3a6f0577f8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:08.232459 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8c7d8-d2f6-482d-a3b4-3a6f0577f8a0 None admin] PATH_INFO: `/v3/services` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:08.233228 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8c7d8-d2f6-482d-a3b4-3a6f0577f8a0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:08.234643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8c7d8-d2f6-482d-a3b4-3a6f0577f8a0 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:08.252600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 276/554] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Nov 2 20:18:08 2022] POST /identity/v3/services => generated 251 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:18:08.252600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8c7d8-d2f6-482d-a3b4-3a6f0577f8a0 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:08.333577 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba957a6-7220-467b-a74c-997e0316a10c None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:08.379781 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534b77f-b597-4e77-b699-03a689049147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:08.380644 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534b77f-b597-4e77-b699-03a689049147 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:08.381029 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534b77f-b597-4e77-b699-03a689049147 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:08.381405 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534b77f-b597-4e77-b699-03a689049147 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:08.387869 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8c7d8-d2f6-482d-a3b4-3a6f0577f8a0 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:08.394703 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534b77f-b597-4e77-b699-03a689049147 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:08.396454 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534b77f-b597-4e77-b699-03a689049147 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:08.413446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-6534b77f-b597-4e77-b699-03a689049147 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:08.413446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:08.413446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:08.413446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:08.413446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:08.413446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:08.413446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:08.413446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:08.413446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:08.413446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:08.413446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:08.413446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:08.413446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:18:08.413446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:18:08.413446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:18:08.413446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:18:08.414708 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:08.414708 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:08.414708 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:08.414708 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:08.414708 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:08.414708 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:08.414708 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:08.414708 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:08.414708 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:08.414708 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:08.414708 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:08.414708 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:08.414708 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:08.414708 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:08.414708 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:08.414708 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:08.414708 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:18:08.415807 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:18:08.415807 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:08.415807 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:08.417256 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 279/555] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:18:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:08.418305 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534b77f-b597-4e77-b699-03a689049147 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:08.432259 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eae413-13eb-45f0-b48c-52fe13b5a224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:08.433411 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eae413-13eb-45f0-b48c-52fe13b5a224 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:08.433856 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eae413-13eb-45f0-b48c-52fe13b5a224 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:08.434279 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eae413-13eb-45f0-b48c-52fe13b5a224 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:08.443551 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eae413-13eb-45f0-b48c-52fe13b5a224 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:08.445138 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eae413-13eb-45f0-b48c-52fe13b5a224 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:08.457929 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-c1eae413-13eb-45f0-b48c-52fe13b5a224 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 20:18:08.457929 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:08.457929 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:08.457929 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:08.457929 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:08.457929 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:08.457929 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:08.457929 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:08.457929 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:08.457929 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:08.457929 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:08.457929 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:08.457929 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 20:18:08.457929 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 20:18:08.457929 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 20:18:08.457929 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 20:18:08.459061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:08.459061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:08.459061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 20:18:08.459061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:18:08.459061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 20:18:08.459061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:18:08.459061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:08.459061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:08.459061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:08.459061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:08.459061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:08.459061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:08.459061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:08.459061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:08.459061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:08.459061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:08.459061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:08.459061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:08.460220 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:08.460220 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:08.460220 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 20:18:08.460220 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 20:18:08.460220 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 20:18:08.460220 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 20:18:08.460220 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 20:18:08.460220 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 20:18:08.460220 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Nov 02 20:18:08.460220 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:08.462537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 277/556] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Nov 2 20:18:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:08.463572 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eae413-13eb-45f0-b48c-52fe13b5a224 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:08.493478 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:08.493846 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:08.561030 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534b77f-b597-4e77-b699-03a689049147 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:08.601194 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eae413-13eb-45f0-b48c-52fe13b5a224 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:08.604699 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a3d2f-742a-413b-a0f8-cc00d5e8ea32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:08.605520 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a3d2f-742a-413b-a0f8-cc00d5e8ea32 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:08.605954 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a3d2f-742a-413b-a0f8-cc00d5e8ea32 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:08.606371 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a3d2f-742a-413b-a0f8-cc00d5e8ea32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:08.621533 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a3d2f-742a-413b-a0f8-cc00d5e8ea32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:08.623755 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a3d2f-742a-413b-a0f8-cc00d5e8ea32 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:08.638217 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98306fb-b8e7-425a-955e-0f3af481a6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:08.638975 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98306fb-b8e7-425a-955e-0f3af481a6a6 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:08.639534 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98306fb-b8e7-425a-955e-0f3af481a6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:08.639912 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98306fb-b8e7-425a-955e-0f3af481a6a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:08.640708 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98306fb-b8e7-425a-955e-0f3af481a6a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:08.641167 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98306fb-b8e7-425a-955e-0f3af481a6a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:08.642677 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98306fb-b8e7-425a-955e-0f3af481a6a6 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:08.643748 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-403a3d2f-742a-413b-a0f8-cc00d5e8ea32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:08.643748 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:08.643748 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:08.643748 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:08.643748 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:08.643748 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:08.643748 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:08.643748 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:08.643748 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:08.643748 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:08.643748 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:08.643748 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:08.643748 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:18:08.643748 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:18:08.643748 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:18:08.643748 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:18:08.644846 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:08.644846 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:08.644846 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:08.644846 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:08.644846 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:08.644846 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:08.644846 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:08.644846 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:08.644846 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:08.644846 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:08.644846 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:08.644846 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:08.644846 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:08.644846 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:08.644846 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:08.644846 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:08.644846 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:18:08.645912 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:18:08.645912 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:08.645912 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:08.648489 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 280/557] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:18:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:08.653516 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a3d2f-742a-413b-a0f8-cc00d5e8ea32 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:08.658869 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 278/558] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:08.659970 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98306fb-b8e7-425a-955e-0f3af481a6a6 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:08.764400 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:08.785323 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98306fb-b8e7-425a-955e-0f3af481a6a6 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:08.796664 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a3d2f-742a-413b-a0f8-cc00d5e8ea32 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:08.815152 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:08.829872 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308d78a-6a95-4786-9222-5de8ff4aa7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:08.830721 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308d78a-6a95-4786-9222-5de8ff4aa7d0 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:08.831099 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308d78a-6a95-4786-9222-5de8ff4aa7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:08.831461 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308d78a-6a95-4786-9222-5de8ff4aa7d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:08.832415 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308d78a-6a95-4786-9222-5de8ff4aa7d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:08.832596 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308d78a-6a95-4786-9222-5de8ff4aa7d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:08.834054 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308d78a-6a95-4786-9222-5de8ff4aa7d0 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:08.845450 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155214b-76f9-4c09-ae29-316eb5ad9e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:08.846301 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155214b-76f9-4c09-ae29-316eb5ad9e72 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:08.846729 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155214b-76f9-4c09-ae29-316eb5ad9e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:08.847148 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155214b-76f9-4c09-ae29-316eb5ad9e72 None admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:08.848011 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155214b-76f9-4c09-ae29-316eb5ad9e72 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:08.848469 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155214b-76f9-4c09-ae29-316eb5ad9e72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:08.850139 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155214b-76f9-4c09-ae29-316eb5ad9e72 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:08.853185 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 279/559] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:08.855033 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308d78a-6a95-4786-9222-5de8ff4aa7d0 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:08.870931 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 281/560] 10.222.0.23 () {56 vars in 1135 bytes} [Wed Nov 2 20:18:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:08.872026 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155214b-76f9-4c09-ae29-316eb5ad9e72 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:08.970317 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308d78a-6a95-4786-9222-5de8ff4aa7d0 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:08.988260 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155214b-76f9-4c09-ae29-316eb5ad9e72 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:09.009202 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676b8fe-8dec-4b93-a816-255561f7441d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:09.009871 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676b8fe-8dec-4b93-a816-255561f7441d None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:09.010156 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676b8fe-8dec-4b93-a816-255561f7441d None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:09.010463 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676b8fe-8dec-4b93-a816-255561f7441d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:09.019726 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676b8fe-8dec-4b93-a816-255561f7441d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:09.022124 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676b8fe-8dec-4b93-a816-255561f7441d None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:09.025893 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6155c3-a639-450c-8d30-73f0e0eba573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:09.026642 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6155c3-a639-450c-8d30-73f0e0eba573 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:09.027068 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6155c3-a639-450c-8d30-73f0e0eba573 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:09.027436 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6155c3-a639-450c-8d30-73f0e0eba573 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:09.034409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-2676b8fe-8dec-4b93-a816-255561f7441d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 20:18:09.034409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:09.034409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:09.034409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:09.034409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:09.034409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:09.034409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:09.034409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:09.034409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:09.034409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:09.034409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:09.034409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:09.034409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 20:18:09.034409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 20:18:09.034409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 20:18:09.034409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 20:18:09.035536 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:09.035536 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:09.035536 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 20:18:09.035536 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:18:09.035536 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 20:18:09.035536 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:18:09.035536 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:09.035536 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:09.035536 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:09.035536 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:09.035536 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:09.035536 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:09.035536 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:09.035536 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:09.035536 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:09.035536 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:09.035536 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:09.035536 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:09.036660 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:09.036660 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:09.036660 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 20:18:09.036660 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 20:18:09.036660 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 20:18:09.036660 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 20:18:09.036660 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 20:18:09.036660 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 20:18:09.036660 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 20:18:09.036660 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:09.037312 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6155c3-a639-450c-8d30-73f0e0eba573 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:09.037403 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 280/561] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Nov 2 20:18:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:09.037403 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676b8fe-8dec-4b93-a816-255561f7441d None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:09.041779 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6155c3-a639-450c-8d30-73f0e0eba573 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:09.043644 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:09.056378 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-ab6155c3-a639-450c-8d30-73f0e0eba573 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:18:09.056378 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:09.056378 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:09.056378 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:09.056378 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:09.056378 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:09.056378 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:09.056378 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:09.056378 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:09.056378 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:09.056378 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:09.056378 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:09.056378 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 20:18:09.056378 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 20:18:09.056378 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 20:18:09.057522 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 20:18:09.057522 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:09.057522 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:09.057522 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:09.057522 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:09.057522 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:09.057522 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:09.057522 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:09.057522 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:09.057522 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:09.057522 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:09.057522 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:09.057522 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:09.057522 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:09.057522 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:09.057522 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:09.057522 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:09.058837 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 20:18:09.058837 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 20:18:09.058837 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 20:18:09.058837 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 20:18:09.058837 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 20:18:09.058837 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 20:18:09.058837 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:18:09.058837 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:09.064363 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 282/562] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:18:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:09.065285 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6155c3-a639-450c-8d30-73f0e0eba573 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:09.098941 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:09.167694 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676b8fe-8dec-4b93-a816-255561f7441d None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:09.176279 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6155c3-a639-450c-8d30-73f0e0eba573 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:09.214474 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1b652-9e32-4bab-9fe9-e17f1e627e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:09.215222 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1b652-9e32-4bab-9fe9-e17f1e627e31 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:09.215561 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1b652-9e32-4bab-9fe9-e17f1e627e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:09.215932 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1b652-9e32-4bab-9fe9-e17f1e627e31 None admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:09.217138 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e1b652-9e32-4bab-9fe9-e17f1e627e31 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:09.217520 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e1b652-9e32-4bab-9fe9-e17f1e627e31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:09.218847 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dfb1ee-f5ae-45ed-ab3b-23332dda9454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:09.219219 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e1b652-9e32-4bab-9fe9-e17f1e627e31 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:09.219897 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfb1ee-f5ae-45ed-ab3b-23332dda9454 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:09.220360 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfb1ee-f5ae-45ed-ab3b-23332dda9454 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:09.221099 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfb1ee-f5ae-45ed-ab3b-23332dda9454 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:09.235777 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dfb1ee-f5ae-45ed-ab3b-23332dda9454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:09.237535 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dfb1ee-f5ae-45ed-ab3b-23332dda9454 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:09.241094 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 283/563] 10.222.0.23 () {56 vars in 1149 bytes} [Wed Nov 2 20:18:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:09.242041 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1b652-9e32-4bab-9fe9-e17f1e627e31 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:09.255738 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-c1dfb1ee-f5ae-45ed-ab3b-23332dda9454 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:09.255738 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:09.255738 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:09.255738 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:09.255738 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:09.255738 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:09.255738 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:09.255738 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:09.255738 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:09.255738 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:09.255738 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:09.255738 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:09.255738 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:18:09.255738 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:18:09.255738 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:18:09.255738 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:18:09.256789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:09.256789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:09.256789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:09.256789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:09.256789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:09.256789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:09.256789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:09.256789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:09.256789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:09.256789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:09.256789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:09.256789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:09.256789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:09.256789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:09.256789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:09.256789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:09.256789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:18:09.257664 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:18:09.257664 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:09.257664 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:09.257664 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 281/564] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:18:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:09.257664 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dfb1ee-f5ae-45ed-ab3b-23332dda9454 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:09.329873 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:09.385144 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dfb1ee-f5ae-45ed-ab3b-23332dda9454 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:09.388448 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:09.404918 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1b652-9e32-4bab-9fe9-e17f1e627e31 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:09.431171 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34ee10-618d-42a4-aad0-1c1f0fb9b7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:09.431729 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34ee10-618d-42a4-aad0-1c1f0fb9b7c8 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:09.432008 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34ee10-618d-42a4-aad0-1c1f0fb9b7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:09.432329 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34ee10-618d-42a4-aad0-1c1f0fb9b7c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:09.450196 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34ee10-618d-42a4-aad0-1c1f0fb9b7c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:09.451749 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34ee10-618d-42a4-aad0-1c1f0fb9b7c8 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:09.452752 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f59dcc-0f4f-430e-b2ce-75ee40875536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:09.455179 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f59dcc-0f4f-430e-b2ce-75ee40875536 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:09.455673 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f59dcc-0f4f-430e-b2ce-75ee40875536 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:09.456149 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f59dcc-0f4f-430e-b2ce-75ee40875536 None admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:09.457308 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f59dcc-0f4f-430e-b2ce-75ee40875536 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:09.460712 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f59dcc-0f4f-430e-b2ce-75ee40875536 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:09.463294 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f59dcc-0f4f-430e-b2ce-75ee40875536 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:09.472998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-de34ee10-618d-42a4-aad0-1c1f0fb9b7c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:09.472998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:09.472998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:09.472998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:09.472998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:09.472998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:09.472998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:09.472998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:09.472998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:09.472998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:09.472998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:09.472998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:09.472998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:18:09.472998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:18:09.472998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:18:09.472998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:18:09.473956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:09.473956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:09.473956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:09.473956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:09.473956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:09.473956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:09.473956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:09.473956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:09.473956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:09.473956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:09.473956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:09.473956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:09.473956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:09.473956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:09.473956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:09.473956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:09.473956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:18:09.474839 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:18:09.474839 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:09.474839 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:09.479093 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 282/565] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:18:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:09.479922 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34ee10-618d-42a4-aad0-1c1f0fb9b7c8 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:09.493353 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 284/566] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Nov 2 20:18:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:09.494504 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f59dcc-0f4f-430e-b2ce-75ee40875536 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:09.630499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f59dcc-0f4f-430e-b2ce-75ee40875536 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:09.667905 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34ee10-618d-42a4-aad0-1c1f0fb9b7c8 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:09.673702 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd694e3-276c-4e8a-9cfd-0d85834be6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:09.674564 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd694e3-276c-4e8a-9cfd-0d85834be6e5 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:09.675051 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd694e3-276c-4e8a-9cfd-0d85834be6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:09.675685 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd694e3-276c-4e8a-9cfd-0d85834be6e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:09.676654 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd694e3-276c-4e8a-9cfd-0d85834be6e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:09.677591 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd694e3-276c-4e8a-9cfd-0d85834be6e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:09.679005 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:09.679688 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd694e3-276c-4e8a-9cfd-0d85834be6e5 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:09.701641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 285/567] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:09.702811 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd694e3-276c-4e8a-9cfd-0d85834be6e5 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:09.715771 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:09.724197 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0421d73-5e9b-4a7e-870a-84af125ad4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:09.724838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0421d73-5e9b-4a7e-870a-84af125ad4d8 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:09.725121 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0421d73-5e9b-4a7e-870a-84af125ad4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:09.725397 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0421d73-5e9b-4a7e-870a-84af125ad4d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:09.729697 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0421d73-5e9b-4a7e-870a-84af125ad4d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:09.730395 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0421d73-5e9b-4a7e-870a-84af125ad4d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:09.731973 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0421d73-5e9b-4a7e-870a-84af125ad4d8 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:09.757813 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 283/568] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:09.759179 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0421d73-5e9b-4a7e-870a-84af125ad4d8 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:09.825432 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd694e3-276c-4e8a-9cfd-0d85834be6e5 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:09.867053 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2924f-21a8-49fe-8365-5762dd15d549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:09.868886 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2924f-21a8-49fe-8365-5762dd15d549 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:09.869965 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2924f-21a8-49fe-8365-5762dd15d549 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:09.870652 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2924f-21a8-49fe-8365-5762dd15d549 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:09.871720 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2924f-21a8-49fe-8365-5762dd15d549 None admin] RBAC: Adding query filter params (role.id=bca2e686aa5e4fdc844fc679a4c41939, scope.project.id=a144e65ce44c44dc99c07a7f5be303b7, user.id=f906fd11db004026a78eb3d69fa5b298) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:09.872730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2924f-21a8-49fe-8365-5762dd15d549 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:09.875362 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2924f-21a8-49fe-8365-5762dd15d549 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:09.884509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 286/569] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Nov 2 20:18:09 2022] GET /identity/v3/role_assignments?user.id=f906fd11db004026a78eb3d69fa5b298&scope.project.id=a144e65ce44c44dc99c07a7f5be303b7&role.id=bca2e686aa5e4fdc844fc679a4c41939 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:09.885820 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2924f-21a8-49fe-8365-5762dd15d549 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:09.970013 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:10.006941 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2924f-21a8-49fe-8365-5762dd15d549 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:10.023663 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0421d73-5e9b-4a7e-870a-84af125ad4d8 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:10.066983 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2edfd-9e19-4ca7-86e4-885c1cee84fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:10.067642 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2edfd-9e19-4ca7-86e4-885c1cee84fd None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:10.068226 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2edfd-9e19-4ca7-86e4-885c1cee84fd None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:10.068226 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2edfd-9e19-4ca7-86e4-885c1cee84fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:10.089494 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d2edfd-9e19-4ca7-86e4-885c1cee84fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:10.091026 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d2edfd-9e19-4ca7-86e4-885c1cee84fd None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:10.115734 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-c9d2edfd-9e19-4ca7-86e4-885c1cee84fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:18:10.115734 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:10.115734 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:10.115734 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:10.115734 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:10.115734 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:10.115734 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:10.115734 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:10.115734 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:10.115734 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:10.115734 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:10.115734 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:10.115734 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 20:18:10.115734 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 20:18:10.115734 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 20:18:10.116786 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 20:18:10.116786 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:10.116786 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:10.116786 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:10.116786 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:10.116786 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:10.116786 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:10.116786 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:10.116786 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:10.116786 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:10.116786 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:10.116786 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:10.116786 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:10.116786 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:10.116786 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:10.116786 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:10.116786 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:10.118204 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 20:18:10.118204 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 20:18:10.118204 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 20:18:10.118204 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 20:18:10.118204 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 20:18:10.118204 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 20:18:10.118204 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:18:10.118204 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:10.119278 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 287/570] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:18:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:10.128014 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2edfd-9e19-4ca7-86e4-885c1cee84fd None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:10.138967 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94cab9-4e12-499d-a943-27e25402b3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:10.139818 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94cab9-4e12-499d-a943-27e25402b3bb None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:10.140093 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94cab9-4e12-499d-a943-27e25402b3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:10.140363 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94cab9-4e12-499d-a943-27e25402b3bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:10.157327 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94cab9-4e12-499d-a943-27e25402b3bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:10.158805 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94cab9-4e12-499d-a943-27e25402b3bb None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:10.174408 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-3a94cab9-4e12-499d-a943-27e25402b3bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:18:10.174408 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:10.174408 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:10.174408 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:10.174408 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:10.174408 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:10.174408 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:10.174408 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:10.174408 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:10.174408 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:10.174408 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:10.174408 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:10.174408 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 20:18:10.174408 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 20:18:10.174408 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 20:18:10.175387 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 20:18:10.175387 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:10.175387 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:10.175387 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:10.175387 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:10.175387 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:10.175387 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:10.175387 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:10.175387 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:10.175387 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:10.175387 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:10.175387 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:10.175387 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:10.175387 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:10.175387 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:10.175387 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:10.175387 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:10.176478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 20:18:10.176478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 20:18:10.176478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 20:18:10.176478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 20:18:10.176478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 20:18:10.176478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 20:18:10.176478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:18:10.176478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:10.176478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 284/571] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:18:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 417 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:10.177479 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf300e-334f-48d1-bb7b-1b967eafa1a8 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:10.177479 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf300e-334f-48d1-bb7b-1b967eafa1a8 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:10.177720 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf300e-334f-48d1-bb7b-1b967eafa1a8 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:10.184027 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 285/572] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:10.185018 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf300e-334f-48d1-bb7b-1b967eafa1a8 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:10.220092 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:10.288394 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2edfd-9e19-4ca7-86e4-885c1cee84fd None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:10.320072 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:10.322874 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf300e-334f-48d1-bb7b-1b967eafa1a8 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:10.326578 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6076c-7ada-40a0-8352-ac620d2b849a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:10.327094 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6076c-7ada-40a0-8352-ac620d2b849a None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:10.327470 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6076c-7ada-40a0-8352-ac620d2b849a None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:10.327845 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6076c-7ada-40a0-8352-ac620d2b849a None admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:10.328689 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6076c-7ada-40a0-8352-ac620d2b849a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:10.329153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6076c-7ada-40a0-8352-ac620d2b849a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:10.330774 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6076c-7ada-40a0-8352-ac620d2b849a None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:10.344926 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 288/573] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Nov 2 20:18:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:10.346500 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d9da6-7287-4aba-a5c1-d55ce65b1f68 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:10.347024 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d9da6-7287-4aba-a5c1-d55ce65b1f68 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:10.347391 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d9da6-7287-4aba-a5c1-d55ce65b1f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:10.365035 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f214f15-9186-4373-adb0-dec9dd72724a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:10.365888 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f214f15-9186-4373-adb0-dec9dd72724a None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:10.366319 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f214f15-9186-4373-adb0-dec9dd72724a None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:10.366768 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f214f15-9186-4373-adb0-dec9dd72724a None admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:10.368216 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f214f15-9186-4373-adb0-dec9dd72724a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:10.368738 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f214f15-9186-4373-adb0-dec9dd72724a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:10.370349 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f214f15-9186-4373-adb0-dec9dd72724a None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:10.371702 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-800d9da6-7287-4aba-a5c1-d55ce65b1f68 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:10.373228 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-800d9da6-7287-4aba-a5c1-d55ce65b1f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:10.385780 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 286/574] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Nov 2 20:18:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:10.386876 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f214f15-9186-4373-adb0-dec9dd72724a None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:10.464657 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 289/575] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:18:10.465789 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d9da6-7287-4aba-a5c1-d55ce65b1f68 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:10.514965 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:10.548858 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f214f15-9186-4373-adb0-dec9dd72724a None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:10.601534 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69fe3e-893b-4855-9c9e-2cf782afd6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:10.603177 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69fe3e-893b-4855-9c9e-2cf782afd6fa None admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:10.603851 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69fe3e-893b-4855-9c9e-2cf782afd6fa None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:10.604877 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69fe3e-893b-4855-9c9e-2cf782afd6fa None admin] PATH_INFO: `/v3/projects/a144e65ce44c44dc99c07a7f5be303b7/users/95f22f80ac694e9888c132af1e58e292/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:10.609356 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69fe3e-893b-4855-9c9e-2cf782afd6fa None admin] RBAC: Authorizing `identity:create_grant(project_id=a144e65ce44c44dc99c07a7f5be303b7, user_id=95f22f80ac694e9888c132af1e58e292, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:10.611227 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69fe3e-893b-4855-9c9e-2cf782afd6fa None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:10.638428 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 287/576] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Nov 2 20:18:10 2022] PUT /identity/v3/projects/a144e65ce44c44dc99c07a7f5be303b7/users/95f22f80ac694e9888c132af1e58e292/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:18:10.640526 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1636d8d-5ec9-4439-83c0-bd4cc0b672c7 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:10.640838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1636d8d-5ec9-4439-83c0-bd4cc0b672c7 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:10.641109 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1636d8d-5ec9-4439-83c0-bd4cc0b672c7 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:10.643100 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 288/577] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:10.657934 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81361a0a-b2d4-46ab-8f35-e39b52a7c278 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:10.658265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81361a0a-b2d4-46ab-8f35-e39b52a7c278 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:10.658548 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81361a0a-b2d4-46ab-8f35-e39b52a7c278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:10.662313 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d9da6-7287-4aba-a5c1-d55ce65b1f68 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:10.687485 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-81361a0a-b2d4-46ab-8f35-e39b52a7c278 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:10.689222 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-81361a0a-b2d4-46ab-8f35-e39b52a7c278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:10.706547 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:10.737484 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b044f2-4c85-4020-9f0a-b982cb18c7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:10.738173 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b044f2-4c85-4020-9f0a-b982cb18c7c8 None admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:10.738457 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b044f2-4c85-4020-9f0a-b982cb18c7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:10.738737 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b044f2-4c85-4020-9f0a-b982cb18c7c8 None admin] PATH_INFO: `/v3/projects/a144e65ce44c44dc99c07a7f5be303b7/users/66937804f65147f392f4ddfc3e961d5d/roles/59b45b6df1ee465bbbb8bdba4b4e281d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:10.767545 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b044f2-4c85-4020-9f0a-b982cb18c7c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=a144e65ce44c44dc99c07a7f5be303b7, user_id=66937804f65147f392f4ddfc3e961d5d, role_id=59b45b6df1ee465bbbb8bdba4b4e281d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:10.769082 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b044f2-4c85-4020-9f0a-b982cb18c7c8 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:10.780496 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 289/578] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Nov 02 20:18:10.786391 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 290/579] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Nov 2 20:18:10 2022] PUT /identity/v3/projects/a144e65ce44c44dc99c07a7f5be303b7/users/66937804f65147f392f4ddfc3e961d5d/roles/59b45b6df1ee465bbbb8bdba4b4e281d => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:18:10.790139 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81361a0a-b2d4-46ab-8f35-e39b52a7c278 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:10.902906 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:10.932536 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81361a0a-b2d4-46ab-8f35-e39b52a7c278 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:10.970870 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d5f03e-2ffe-4a52-a8e5-09d4808b93b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:10.971759 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5f03e-2ffe-4a52-a8e5-09d4808b93b9 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:10.972179 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5f03e-2ffe-4a52-a8e5-09d4808b93b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:10.972620 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5f03e-2ffe-4a52-a8e5-09d4808b93b9 None admin] PATH_INFO: `/v3/services/network` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:10.973380 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d5f03e-2ffe-4a52-a8e5-09d4808b93b9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:10.974891 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d5f03e-2ffe-4a52-a8e5-09d4808b93b9 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:10.989373 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-39d5f03e-2ffe-4a52-a8e5-09d4808b93b9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 20:18:10.989373 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:10.989373 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 20:18:10.989373 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 20:18:10.989373 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 20:18:10.989373 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 20:18:10.989373 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 20:18:10.989373 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:10.989373 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 20:18:10.989373 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:10.989373 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 20:18:10.989373 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:10.989373 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:10.989373 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:10.989373 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:10.989373 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:10.989373 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:10.990641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:10.990641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:10.990641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:10.990641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:10.990641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:10.990641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:10.990641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 20:18:10.990641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 20:18:10.990641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 20:18:10.990641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 20:18:10.990641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:10.990641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:10.990641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:10.990641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:10.990641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:10.990641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:10.991679 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:10.991679 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:10.991679 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:10.991679 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:10.991679 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:10.991679 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:10.991679 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:10.991679 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:10.991679 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:10.991679 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:10.991679 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 20:18:10.991679 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:10.991679 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 20:18:10.991679 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:10.995084 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 290/580] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:18:10 2022] GET /identity/v3/services/network => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:11.004067 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b044f2-4c85-4020-9f0a-b982cb18c7c8 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:11.109235 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d5f03e-2ffe-4a52-a8e5-09d4808b93b9 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:11.132327 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b044f2-4c85-4020-9f0a-b982cb18c7c8 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:11.196103 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f108c6a-04f9-4b4c-b096-80396547ad44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:11.196749 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f108c6a-04f9-4b4c-b096-80396547ad44 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:11.197086 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f108c6a-04f9-4b4c-b096-80396547ad44 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:11.197367 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f108c6a-04f9-4b4c-b096-80396547ad44 None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:11.198006 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f108c6a-04f9-4b4c-b096-80396547ad44 None admin] RBAC: Adding query filter params (name=network) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:11.198312 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f108c6a-04f9-4b4c-b096-80396547ad44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:11.199677 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f108c6a-04f9-4b4c-b096-80396547ad44 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:11.211503 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 291/581] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Nov 2 20:18:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:11.229326 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f108c6a-04f9-4b4c-b096-80396547ad44 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:11.230483 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d5f03e-2ffe-4a52-a8e5-09d4808b93b9 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:11.275988 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c80ac-88bc-4c6e-bb56-f713702fce8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:11.276718 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c80ac-88bc-4c6e-bb56-f713702fce8e None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:11.277069 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c80ac-88bc-4c6e-bb56-f713702fce8e None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:11.277351 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c80ac-88bc-4c6e-bb56-f713702fce8e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:11.277949 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c80ac-88bc-4c6e-bb56-f713702fce8e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:11.279389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c80ac-88bc-4c6e-bb56-f713702fce8e None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:11.281708 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:11.298247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-192c80ac-88bc-4c6e-bb56-f713702fce8e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 20:18:11.298247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:11.298247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 20:18:11.298247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 20:18:11.298247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 20:18:11.298247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 20:18:11.298247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 20:18:11.298247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:11.298247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 20:18:11.298247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:11.298247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 20:18:11.298247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:11.298247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:11.298247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:11.298247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:11.298247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:11.298247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:11.299574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:11.299574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:11.299574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:11.299574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:11.299574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:11.299574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:11.299574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 20:18:11.299574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 20:18:11.299574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 20:18:11.299574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 20:18:11.299574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:11.299574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:11.299574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:11.299574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:11.299574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:11.299574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:11.300716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:11.300716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:11.300716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:11.300716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:11.300716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:11.300716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:11.300716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:11.300716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:11.300716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:11.300716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:11.300716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 20:18:11.300716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:11.300716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 20:18:11.300716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:11.309102 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 291/582] 10.222.0.23 () {56 vars in 1129 bytes} [Wed Nov 2 20:18:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:11.315212 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c80ac-88bc-4c6e-bb56-f713702fce8e None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:11.333121 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:11.380535 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f108c6a-04f9-4b4c-b096-80396547ad44 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:11.433693 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c80ac-88bc-4c6e-bb56-f713702fce8e None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:11.469932 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308a9e0-a9c0-45b5-ab63-42058842a603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:11.470555 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308a9e0-a9c0-45b5-ab63-42058842a603 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:11.470838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308a9e0-a9c0-45b5-ab63-42058842a603 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:11.471118 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308a9e0-a9c0-45b5-ab63-42058842a603 None admin] PATH_INFO: `/v3/services` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:11.471755 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308a9e0-a9c0-45b5-ab63-42058842a603 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:11.472062 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308a9e0-a9c0-45b5-ab63-42058842a603 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:11.473469 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308a9e0-a9c0-45b5-ab63-42058842a603 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:11.478509 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 292/583] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Nov 2 20:18:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:18:11.484097 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308a9e0-a9c0-45b5-ab63-42058842a603 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:11.492457 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659ccdd-5877-4b8b-b311-4f642e4ed68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:11.493779 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659ccdd-5877-4b8b-b311-4f642e4ed68f None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:11.494046 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659ccdd-5877-4b8b-b311-4f642e4ed68f None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:11.494320 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659ccdd-5877-4b8b-b311-4f642e4ed68f None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:11.494963 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659ccdd-5877-4b8b-b311-4f642e4ed68f None admin] RBAC: Adding query filter params (type=network) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:11.495266 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659ccdd-5877-4b8b-b311-4f642e4ed68f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:11.496786 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659ccdd-5877-4b8b-b311-4f642e4ed68f None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:11.509696 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 292/584] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Nov 2 20:18:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:18:11.516972 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659ccdd-5877-4b8b-b311-4f642e4ed68f None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:11.574582 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:11.608275 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308a9e0-a9c0-45b5-ab63-42058842a603 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:11.643907 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2871a-929d-4286-86d2-e94722a18e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:11.644503 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2871a-929d-4286-86d2-e94722a18e0b None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:11.644821 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2871a-929d-4286-86d2-e94722a18e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:11.645103 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2871a-929d-4286-86d2-e94722a18e0b None admin] PATH_INFO: `/v3/services` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:11.645905 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2871a-929d-4286-86d2-e94722a18e0b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:11.646219 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2871a-929d-4286-86d2-e94722a18e0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:11.647597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2871a-929d-4286-86d2-e94722a18e0b None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:11.654263 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 293/585] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Nov 2 20:18:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:18:11.661906 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2871a-929d-4286-86d2-e94722a18e0b None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:11.739269 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:11.743848 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659ccdd-5877-4b8b-b311-4f642e4ed68f None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:11.796399 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2871a-929d-4286-86d2-e94722a18e0b None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:11.822219 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6076b-aac2-4b7b-bf94-19f3e058cda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:11.822847 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6076b-aac2-4b7b-bf94-19f3e058cda6 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:11.823131 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6076b-aac2-4b7b-bf94-19f3e058cda6 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:11.823407 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6076b-aac2-4b7b-bf94-19f3e058cda6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:11.824118 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6076b-aac2-4b7b-bf94-19f3e058cda6 None admin] RBAC: Adding query filter params (interface=public, service_id=83a2f96b98f348cdbc9faf93d1f5eb9e, region_id=RegionOne) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:11.824427 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6076b-aac2-4b7b-bf94-19f3e058cda6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:11.825829 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6076b-aac2-4b7b-bf94-19f3e058cda6 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:11.840491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0913072-018d-430c-93a1-11b16bf5ae2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:11.841141 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0913072-018d-430c-93a1-11b16bf5ae2b None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:11.841426 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0913072-018d-430c-93a1-11b16bf5ae2b None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:11.841705 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0913072-018d-430c-93a1-11b16bf5ae2b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:11.842416 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0913072-018d-430c-93a1-11b16bf5ae2b None admin] RBAC: Adding query filter params (interface=public, service_id=50031481acf046c3a3437b97ec5b8b01, region_id=RegionOne) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:11.842730 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0913072-018d-430c-93a1-11b16bf5ae2b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:11.844117 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0913072-018d-430c-93a1-11b16bf5ae2b None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:11.847582 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 293/586] 10.222.0.23 () {56 vars in 1251 bytes} [Wed Nov 2 20:18:11 2022] GET /identity/v3/endpoints?service_id=83a2f96b98f348cdbc9faf93d1f5eb9e&interface=public®ion_id=RegionOne => generated 194 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:18:11.854707 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 294/587] 10.222.0.23 () {56 vars in 1251 bytes} [Wed Nov 2 20:18:11 2022] GET /identity/v3/endpoints?service_id=50031481acf046c3a3437b97ec5b8b01&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:11.855316 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:11.860182 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6076b-aac2-4b7b-bf94-19f3e058cda6 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:11.870229 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0913072-018d-430c-93a1-11b16bf5ae2b None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:11.994941 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0913072-018d-430c-93a1-11b16bf5ae2b None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:12.031179 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3554d4a-796b-43c3-b17e-4fc01bd3f54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:12.032195 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3554d4a-796b-43c3-b17e-4fc01bd3f54d None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:12.032723 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3554d4a-796b-43c3-b17e-4fc01bd3f54d None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:12.033205 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3554d4a-796b-43c3-b17e-4fc01bd3f54d None admin] PATH_INFO: `/v3/services` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:12.034016 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3554d4a-796b-43c3-b17e-4fc01bd3f54d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:12.035567 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3554d4a-796b-43c3-b17e-4fc01bd3f54d None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:12.041993 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 295/588] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Nov 2 20:18:11 2022] GET /identity/v3/services => generated 772 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:12.072956 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6076b-aac2-4b7b-bf94-19f3e058cda6 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:12.116710 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c022c9-344e-419c-895c-b87c96510c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:12.117783 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c022c9-344e-419c-895c-b87c96510c5b None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:12.118284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c022c9-344e-419c-895c-b87c96510c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:12.118787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c022c9-344e-419c-895c-b87c96510c5b None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:12.119631 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c022c9-344e-419c-895c-b87c96510c5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:12.121439 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c022c9-344e-419c-895c-b87c96510c5b None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:12.128279 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 294/589] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Nov 2 20:18:11 2022] GET /identity/v3/services => generated 772 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:12.507204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d42e9-7b1a-43b1-86e5-a4565ec241f3 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:12.507737 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d42e9-7b1a-43b1-86e5-a4565ec241f3 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:12.507737 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d42e9-7b1a-43b1-86e5-a4565ec241f3 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:12.509450 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 296/590] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:12.514355 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2b79a-957e-4c93-9dda-1eafe1e7676b None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:12.514648 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2b79a-957e-4c93-9dda-1eafe1e7676b None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:12.514926 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2b79a-957e-4c93-9dda-1eafe1e7676b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:12.545530 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-2cd2b79a-957e-4c93-9dda-1eafe1e7676b None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:12.546732 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-2cd2b79a-957e-4c93-9dda-1eafe1e7676b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:12.579331 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:12.639368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 295/591] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:18:13.000237 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d42e9-7b1a-43b1-86e5-a4565ec241f3 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:13.082240 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:13.133433 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d42e9-7b1a-43b1-86e5-a4565ec241f3 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:13.172635 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0eeb57-2b9d-486c-8f33-ea9c9fc7b79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:13.173274 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0eeb57-2b9d-486c-8f33-ea9c9fc7b79d None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:13.173558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0eeb57-2b9d-486c-8f33-ea9c9fc7b79d None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:13.173892 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0eeb57-2b9d-486c-8f33-ea9c9fc7b79d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:13.174481 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0eeb57-2b9d-486c-8f33-ea9c9fc7b79d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:13.175971 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0eeb57-2b9d-486c-8f33-ea9c9fc7b79d None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:13.187623 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-4f0eeb57-2b9d-486c-8f33-ea9c9fc7b79d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 20:18:13.187623 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:13.187623 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 20:18:13.187623 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 20:18:13.187623 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 20:18:13.187623 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 20:18:13.187623 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 20:18:13.187623 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:13.187623 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 20:18:13.187623 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:13.187623 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 20:18:13.187623 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:13.187623 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:13.187623 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:13.187623 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:13.187623 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:13.188663 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:13.188663 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:13.188663 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:13.188663 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:13.188663 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:13.188663 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:13.188663 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:13.188663 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 20:18:13.188663 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 20:18:13.188663 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 20:18:13.188663 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 20:18:13.188663 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:13.188663 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:13.188663 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:13.188663 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:13.188663 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:13.188663 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:13.189643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:13.189643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:13.189643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:13.189643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:13.189643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:13.189643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:13.189643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:13.189643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:13.189643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:13.189643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:13.189643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 20:18:13.189643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:13.189643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 20:18:13.189643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:13.189643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 297/592] 10.222.0.23 () {56 vars in 1132 bytes} [Wed Nov 2 20:18:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:13.195142 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2b79a-957e-4c93-9dda-1eafe1e7676b None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:13.342422 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f13f9-7fcc-4481-ad12-d6b3e6c258a8 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:13.343295 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f13f9-7fcc-4481-ad12-d6b3e6c258a8 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:13.343576 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f13f9-7fcc-4481-ad12-d6b3e6c258a8 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:13.345308 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 298/593] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 20:18:13.346020 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2b79a-957e-4c93-9dda-1eafe1e7676b None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:13.351054 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abcfb8-4392-4308-b631-2ba1ba5061c7 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:13.351349 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abcfb8-4392-4308-b631-2ba1ba5061c7 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:13.351601 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abcfb8-4392-4308-b631-2ba1ba5061c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:13.385590 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-24abcfb8-4392-4308-b631-2ba1ba5061c7 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:13.386788 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-24abcfb8-4392-4308-b631-2ba1ba5061c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:13.390036 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb7f81-618c-4ad2-b5df-00fbc7f7ea89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:13.390714 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb7f81-618c-4ad2-b5df-00fbc7f7ea89 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:13.391049 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb7f81-618c-4ad2-b5df-00fbc7f7ea89 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:13.391328 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb7f81-618c-4ad2-b5df-00fbc7f7ea89 None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:13.391978 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb7f81-618c-4ad2-b5df-00fbc7f7ea89 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:13.392298 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb7f81-618c-4ad2-b5df-00fbc7f7ea89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:13.393851 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb7f81-618c-4ad2-b5df-00fbc7f7ea89 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:13.405157 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 296/594] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Nov 2 20:18:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:13.412825 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb7f81-618c-4ad2-b5df-00fbc7f7ea89 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:13.453219 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:13.520574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 299/595] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 20:18:13.520574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723eaf5-db76-4b04-b532-0269faf8c016 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:13.520574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723eaf5-db76-4b04-b532-0269faf8c016 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:13.520574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723eaf5-db76-4b04-b532-0269faf8c016 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:13.520574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 300/596] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:13.535329 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5faf637-cbbc-48b5-9ee0-0c03c702696e None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:13.536636 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5faf637-cbbc-48b5-9ee0-0c03c702696e None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:13.537268 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5faf637-cbbc-48b5-9ee0-0c03c702696e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:13.555313 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb7f81-618c-4ad2-b5df-00fbc7f7ea89 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:13.566002 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-f5faf637-cbbc-48b5-9ee0-0c03c702696e None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:13.567523 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-f5faf637-cbbc-48b5-9ee0-0c03c702696e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:13.598024 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8193d-a5fb-4c5d-b2a0-50994c68023f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:13.599609 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8193d-a5fb-4c5d-b2a0-50994c68023f None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:13.599894 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8193d-a5fb-4c5d-b2a0-50994c68023f None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:13.600174 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8193d-a5fb-4c5d-b2a0-50994c68023f None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:13.602738 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8193d-a5fb-4c5d-b2a0-50994c68023f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:13.603051 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8193d-a5fb-4c5d-b2a0-50994c68023f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:13.607073 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8193d-a5fb-4c5d-b2a0-50994c68023f None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:13.617160 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 297/597] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Nov 2 20:18:13 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:18:13.650305 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:13.675385 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 301/598] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:18:13.853306 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8193d-a5fb-4c5d-b2a0-50994c68023f None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:13.956484 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:13.973881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8193d-a5fb-4c5d-b2a0-50994c68023f None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:14.011708 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a28d7a9-0a86-4270-9948-67d5a872d055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:14.012337 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28d7a9-0a86-4270-9948-67d5a872d055 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:14.012679 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28d7a9-0a86-4270-9948-67d5a872d055 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:14.012955 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28d7a9-0a86-4270-9948-67d5a872d055 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:14.023283 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a28d7a9-0a86-4270-9948-67d5a872d055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:18:14.028113 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-4a28d7a9-0a86-4270-9948-67d5a872d055 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:18:14.028113 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:14.028113 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:14.028113 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:14.028113 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:14.028113 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:14.028113 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:14.028113 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:14.028113 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:14.028113 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:14.028113 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:14.028113 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:14.028113 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:18:14.028113 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:18:14.028113 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:18:14.028113 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:18:14.029051 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:18:14.029051 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:18:14.029051 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:18:14.029051 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:18:14.029051 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:14.029051 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:14.029051 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:14.029051 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:14.029051 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:14.029051 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:14.029051 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:14.029051 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:14.029051 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:14.029051 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:14.029051 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:14.029051 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:14.029881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:14.029881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:14.029881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:14.029881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:14.029881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:18:14.029881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:18:14.029881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:18:14.029881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:18:14.029881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:18:14.029881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:18:14.029881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:18:14.029881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:14.029881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 298/599] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Nov 2 20:18:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:14.036453 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5faf637-cbbc-48b5-9ee0-0c03c702696e None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:14.055149 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a28d7a9-0a86-4270-9948-67d5a872d055 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:14.147361 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5faf637-cbbc-48b5-9ee0-0c03c702696e None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:14.187165 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7725266-03d8-4146-8f55-79d51dba1911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:14.188659 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7725266-03d8-4146-8f55-79d51dba1911 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:14.189174 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7725266-03d8-4146-8f55-79d51dba1911 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:14.189645 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7725266-03d8-4146-8f55-79d51dba1911 None admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:14.190513 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7725266-03d8-4146-8f55-79d51dba1911 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:14.191016 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7725266-03d8-4146-8f55-79d51dba1911 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:14.192761 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7725266-03d8-4146-8f55-79d51dba1911 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:14.203207 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 302/600] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:18:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:14.210473 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7725266-03d8-4146-8f55-79d51dba1911 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:14.274523 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a28d7a9-0a86-4270-9948-67d5a872d055 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:14.300225 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:14.342962 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fab0c-5f4a-4753-97a5-4c7cb99dfd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:14.343604 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fab0c-5f4a-4753-97a5-4c7cb99dfd98 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:14.343889 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fab0c-5f4a-4753-97a5-4c7cb99dfd98 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:14.344166 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fab0c-5f4a-4753-97a5-4c7cb99dfd98 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:14.355753 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99fab0c-5f4a-4753-97a5-4c7cb99dfd98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:18:14.360759 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-b99fab0c-5f4a-4753-97a5-4c7cb99dfd98 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 20:18:14.360759 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:14.360759 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:14.360759 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:14.360759 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:14.360759 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:14.360759 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:14.360759 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:14.360759 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:14.360759 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:14.360759 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:14.360759 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:14.360759 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:18:14.360759 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:18:14.360759 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:18:14.360759 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:18:14.361673 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:18:14.361673 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:18:14.361673 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:18:14.361673 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:18:14.361673 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:14.361673 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:14.361673 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:14.361673 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:14.361673 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:14.361673 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:14.361673 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:14.361673 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:14.361673 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:14.361673 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:14.361673 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:14.361673 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:14.362950 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:14.362950 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:14.362950 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:14.362950 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:14.362950 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:18:14.362950 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:18:14.362950 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:18:14.362950 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:18:14.362950 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:18:14.362950 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:18:14.362950 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 20:18:14.362950 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:14.362950 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 299/601] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Nov 2 20:18:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 20:18:14.368009 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fab0c-5f4a-4753-97a5-4c7cb99dfd98 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:14.378824 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:14.423401 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7725266-03d8-4146-8f55-79d51dba1911 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:14.474929 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0e841-8547-4ee9-afdc-f77fdeb1b74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:14.475567 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0e841-8547-4ee9-afdc-f77fdeb1b74c None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:14.475843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0e841-8547-4ee9-afdc-f77fdeb1b74c None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:14.476114 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0e841-8547-4ee9-afdc-f77fdeb1b74c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:14.493931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc0e841-8547-4ee9-afdc-f77fdeb1b74c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:14.495394 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc0e841-8547-4ee9-afdc-f77fdeb1b74c None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:14.509671 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fab0c-5f4a-4753-97a5-4c7cb99dfd98 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:14.524479 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-dbc0e841-8547-4ee9-afdc-f77fdeb1b74c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:14.524479 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:14.524479 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:14.524479 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:14.524479 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:14.524479 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:14.524479 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:14.524479 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:14.524479 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:14.524479 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:14.524479 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:14.524479 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:14.524479 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:18:14.524479 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:18:14.524479 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:18:14.524479 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:18:14.525781 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:14.525781 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:14.525781 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:14.525781 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:14.525781 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:14.525781 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:14.525781 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:14.525781 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:14.525781 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:14.525781 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:14.525781 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:14.525781 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:14.525781 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:14.525781 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:14.525781 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:14.525781 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:14.525781 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:18:14.526678 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:18:14.526678 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:14.526678 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:14.526678 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 303/602] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:18:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 20:18:14.535781 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0e841-8547-4ee9-afdc-f77fdeb1b74c None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:14.584281 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4aed9-2fb6-45cd-a949-fa30f57de99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:14.584922 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4aed9-2fb6-45cd-a949-fa30f57de99d None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:14.585198 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4aed9-2fb6-45cd-a949-fa30f57de99d None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:14.585468 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4aed9-2fb6-45cd-a949-fa30f57de99d None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:14.586143 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4aed9-2fb6-45cd-a949-fa30f57de99d None admin] RBAC: Adding query filter params (name=service) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:14.586974 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4aed9-2fb6-45cd-a949-fa30f57de99d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:14.589564 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4aed9-2fb6-45cd-a949-fa30f57de99d None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:14.609495 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 300/603] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Nov 2 20:18:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:14.615581 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4aed9-2fb6-45cd-a949-fa30f57de99d None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:14.722694 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:14.726356 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0e841-8547-4ee9-afdc-f77fdeb1b74c None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:14.739631 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:14.801582 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4aed9-2fb6-45cd-a949-fa30f57de99d None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:14.803915 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e6d95-82b7-40bf-86b3-eb9af7638b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:14.804613 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e6d95-82b7-40bf-86b3-eb9af7638b90 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:14.804897 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e6d95-82b7-40bf-86b3-eb9af7638b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:14.805246 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e6d95-82b7-40bf-86b3-eb9af7638b90 None admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:14.805959 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e6d95-82b7-40bf-86b3-eb9af7638b90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:14.806267 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e6d95-82b7-40bf-86b3-eb9af7638b90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:14.807645 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e6d95-82b7-40bf-86b3-eb9af7638b90 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:14.828893 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 304/604] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:14.837238 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e6d95-82b7-40bf-86b3-eb9af7638b90 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:14.862254 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05301b-7f91-4bcb-97ff-c4ce17e52905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:14.862911 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05301b-7f91-4bcb-97ff-c4ce17e52905 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:14.863357 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05301b-7f91-4bcb-97ff-c4ce17e52905 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:14.863635 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05301b-7f91-4bcb-97ff-c4ce17e52905 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:14.875887 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05301b-7f91-4bcb-97ff-c4ce17e52905 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:14.877579 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05301b-7f91-4bcb-97ff-c4ce17e52905 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:14.895189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-bc05301b-7f91-4bcb-97ff-c4ce17e52905 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:14.895189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:14.895189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:14.895189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:14.895189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:14.895189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:14.895189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:14.895189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:14.895189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:14.895189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:14.895189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:14.895189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:14.895189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:18:14.895189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:18:14.895189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:18:14.895189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:18:14.897006 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:14.897006 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:14.897006 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:14.897006 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:14.897006 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:14.897006 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:14.897006 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:14.897006 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:14.897006 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:14.897006 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:14.897006 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:14.897006 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:14.897006 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:14.897006 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:14.897006 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:14.897006 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:14.897006 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:18:14.898835 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:18:14.898835 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:14.898835 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:14.902554 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 301/605] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:18:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 20:18:14.903590 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05301b-7f91-4bcb-97ff-c4ce17e52905 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:15.019183 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05301b-7f91-4bcb-97ff-c4ce17e52905 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:15.028779 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e6d95-82b7-40bf-86b3-eb9af7638b90 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:15.048906 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:15.057514 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537a21e-50e9-48c8-8162-ed02ea4d6195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:15.058646 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537a21e-50e9-48c8-8162-ed02ea4d6195 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:15.059093 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537a21e-50e9-48c8-8162-ed02ea4d6195 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:15.059639 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537a21e-50e9-48c8-8162-ed02ea4d6195 None admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:15.060675 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537a21e-50e9-48c8-8162-ed02ea4d6195 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:15.061334 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537a21e-50e9-48c8-8162-ed02ea4d6195 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:15.062939 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537a21e-50e9-48c8-8162-ed02ea4d6195 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:15.080661 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 302/606] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:18:15.082309 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9864a2-1be2-4f7f-8480-78e8b675e853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:15.082456 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f5633-699a-4f65-ba42-db4dcab8797a None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:15.082728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f5633-699a-4f65-ba42-db4dcab8797a None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:15.082944 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9864a2-1be2-4f7f-8480-78e8b675e853 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:15.083049 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f5633-699a-4f65-ba42-db4dcab8797a None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:15.083227 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9864a2-1be2-4f7f-8480-78e8b675e853 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:15.083510 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9864a2-1be2-4f7f-8480-78e8b675e853 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:15.084761 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 303/607] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:15.085900 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112900d-7bad-4872-ba7a-10d13ea5fc6d None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:15.086192 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112900d-7bad-4872-ba7a-10d13ea5fc6d None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:15.087027 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112900d-7bad-4872-ba7a-10d13ea5fc6d None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:15.088469 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 304/608] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:15.089206 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112900d-7bad-4872-ba7a-10d13ea5fc6d None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:15.091688 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9864a2-1be2-4f7f-8480-78e8b675e853 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:15.093218 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9864a2-1be2-4f7f-8480-78e8b675e853 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:15.105140 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-2a9864a2-1be2-4f7f-8480-78e8b675e853 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 20:18:15.105140 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:15.105140 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:15.105140 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:15.105140 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:15.105140 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:15.105140 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:15.105140 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:15.105140 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:15.105140 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:15.105140 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:15.105140 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:15.105140 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 20:18:15.105140 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 20:18:15.105140 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 20:18:15.105140 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 20:18:15.106120 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:15.106120 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:15.106120 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 20:18:15.106120 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:18:15.106120 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 20:18:15.106120 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:18:15.106120 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:15.106120 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:15.106120 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:15.106120 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:15.106120 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:15.106120 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:15.106120 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:15.106120 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:15.106120 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:15.106120 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:15.106120 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:15.106120 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:15.107183 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:15.107183 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:15.107183 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 20:18:15.107183 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 20:18:15.107183 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 20:18:15.107183 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 20:18:15.107183 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 20:18:15.107183 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 20:18:15.107183 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Nov 02 20:18:15.107183 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:15.107183 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 305/609] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Nov 2 20:18:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:15.107793 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229455cf-2ff3-421b-aeec-566c193c1224 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:15.108216 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229455cf-2ff3-421b-aeec-566c193c1224 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:15.108216 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229455cf-2ff3-421b-aeec-566c193c1224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:15.130680 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-229455cf-2ff3-421b-aeec-566c193c1224 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:15.132149 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-229455cf-2ff3-421b-aeec-566c193c1224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:15.146937 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:15.201247 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112900d-7bad-4872-ba7a-10d13ea5fc6d None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:15.208594 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 306/610] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:18:15.208594 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb16d2b-295d-4078-9b7b-411c91b95e3f None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:15.208594 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb16d2b-295d-4078-9b7b-411c91b95e3f None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:15.208594 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb16d2b-295d-4078-9b7b-411c91b95e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:15.233777 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-8eb16d2b-295d-4078-9b7b-411c91b95e3f None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:15.235119 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-8eb16d2b-295d-4078-9b7b-411c91b95e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:15.236471 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f806c3-0fd6-4750-b3aa-734160e4c2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:15.237320 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f806c3-0fd6-4750-b3aa-734160e4c2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:15.237604 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f806c3-0fd6-4750-b3aa-734160e4c2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:15.237885 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f806c3-0fd6-4750-b3aa-734160e4c2d7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:15.249542 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f806c3-0fd6-4750-b3aa-734160e4c2d7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:15.251542 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f806c3-0fd6-4750-b3aa-734160e4c2d7 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:15.264747 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-15f806c3-0fd6-4750-b3aa-734160e4c2d7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 20:18:15.264747 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:15.264747 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:15.264747 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:15.264747 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:15.264747 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:15.264747 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:15.264747 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:15.264747 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:15.264747 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:15.264747 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:15.264747 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:15.264747 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 20:18:15.264747 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 20:18:15.264747 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 20:18:15.264747 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 20:18:15.265697 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:15.265697 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:15.265697 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 20:18:15.265697 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:18:15.265697 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 20:18:15.265697 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:18:15.265697 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:15.265697 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:15.265697 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:15.265697 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:15.265697 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:15.265697 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:15.265697 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:15.265697 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:15.265697 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:15.265697 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:15.265697 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:15.265697 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:15.266657 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:15.266657 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:15.266657 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 20:18:15.266657 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 20:18:15.266657 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 20:18:15.266657 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 20:18:15.266657 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 20:18:15.266657 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 20:18:15.266657 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 20:18:15.266657 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:15.273632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 305/611] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Nov 2 20:18:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:15.273632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f806c3-0fd6-4750-b3aa-734160e4c2d7 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:15.314241 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 307/612] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:18:15.315529 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb16d2b-295d-4078-9b7b-411c91b95e3f None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:15.327925 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:15.401964 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:15.410706 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f806c3-0fd6-4750-b3aa-734160e4c2d7 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:15.424015 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb16d2b-295d-4078-9b7b-411c91b95e3f None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:15.475184 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40229b4-9e4e-4a04-a570-7d08f66a7437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:15.476162 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40229b4-9e4e-4a04-a570-7d08f66a7437 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:15.476704 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40229b4-9e4e-4a04-a570-7d08f66a7437 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:15.477243 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40229b4-9e4e-4a04-a570-7d08f66a7437 None admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:15.478247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40229b4-9e4e-4a04-a570-7d08f66a7437 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:15.478753 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40229b4-9e4e-4a04-a570-7d08f66a7437 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:15.480367 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40229b4-9e4e-4a04-a570-7d08f66a7437 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:15.485217 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256cb6f8-1156-4ca3-a0c1-4e9bfa478992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:15.485834 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cb6f8-1156-4ca3-a0c1-4e9bfa478992 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:15.486124 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cb6f8-1156-4ca3-a0c1-4e9bfa478992 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:15.486413 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cb6f8-1156-4ca3-a0c1-4e9bfa478992 None admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:15.487151 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256cb6f8-1156-4ca3-a0c1-4e9bfa478992 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:15.487464 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256cb6f8-1156-4ca3-a0c1-4e9bfa478992 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:15.488995 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256cb6f8-1156-4ca3-a0c1-4e9bfa478992 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:15.505808 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 308/613] 10.222.0.23 () {56 vars in 1149 bytes} [Wed Nov 2 20:18:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:15.507293 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40229b4-9e4e-4a04-a570-7d08f66a7437 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:15.534497 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 306/614] 10.222.0.23 () {56 vars in 1135 bytes} [Wed Nov 2 20:18:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:15.541159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256cb6f8-1156-4ca3-a0c1-4e9bfa478992 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:15.642297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:15.646517 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256cb6f8-1156-4ca3-a0c1-4e9bfa478992 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:15.656051 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40229b4-9e4e-4a04-a570-7d08f66a7437 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:15.685189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b704f4-abc4-4e2b-a947-27586e6a4ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:15.685932 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b704f4-abc4-4e2b-a947-27586e6a4ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:15.686210 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b704f4-abc4-4e2b-a947-27586e6a4ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:15.686481 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b704f4-abc4-4e2b-a947-27586e6a4ee0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:15.690761 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f894117-bd5d-4bff-8b63-c1857493622c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:15.691367 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f894117-bd5d-4bff-8b63-c1857493622c None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:15.691649 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f894117-bd5d-4bff-8b63-c1857493622c None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:15.691924 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f894117-bd5d-4bff-8b63-c1857493622c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:15.700882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:15.755316 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b704f4-abc4-4e2b-a947-27586e6a4ee0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:15.756795 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b704f4-abc4-4e2b-a947-27586e6a4ee0 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:15.763807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f894117-bd5d-4bff-8b63-c1857493622c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:15.765262 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f894117-bd5d-4bff-8b63-c1857493622c None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:15.856831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:15.861427 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 307/615] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Nov 2 20:18:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Nov 02 20:18:15.866660 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b704f4-abc4-4e2b-a947-27586e6a4ee0 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:15.874004 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 309/616] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Nov 2 20:18:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Nov 02 20:18:15.877968 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f894117-bd5d-4bff-8b63-c1857493622c None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:15.921618 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:15.966689 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b704f4-abc4-4e2b-a947-27586e6a4ee0 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:15.989398 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f894117-bd5d-4bff-8b63-c1857493622c None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:16.001502 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52c70a-71d9-4f35-a06a-8926f311c3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:16.002044 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52c70a-71d9-4f35-a06a-8926f311c3c3 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:16.002327 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52c70a-71d9-4f35-a06a-8926f311c3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:16.002602 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52c70a-71d9-4f35-a06a-8926f311c3c3 None admin] PATH_INFO: `/v3/services/network` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:16.003196 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52c70a-71d9-4f35-a06a-8926f311c3c3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:16.004583 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52c70a-71d9-4f35-a06a-8926f311c3c3 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:16.013355 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-dd52c70a-71d9-4f35-a06a-8926f311c3c3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 20:18:16.013355 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:16.013355 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 20:18:16.013355 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 20:18:16.013355 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 20:18:16.013355 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 20:18:16.013355 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 20:18:16.013355 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:16.013355 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 20:18:16.013355 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:16.013355 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 20:18:16.013355 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:16.013355 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:16.013355 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:16.013355 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:16.013355 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:16.013355 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:16.014389 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:16.014389 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:16.014389 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:16.014389 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:16.014389 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:16.014389 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:16.014389 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 20:18:16.014389 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 20:18:16.014389 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 20:18:16.014389 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 20:18:16.014389 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:16.014389 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:16.014389 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:16.014389 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:16.014389 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:16.014389 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:16.015282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:16.015282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:16.015282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:16.015282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:16.015282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:16.015282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:16.015282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:16.015282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:16.015282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:16.015282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:16.015282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 20:18:16.015282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:16.015282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 20:18:16.015282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:16.015282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 308/617] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:18:15 2022] GET /identity/v3/services/network => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:16.016095 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52c70a-71d9-4f35-a06a-8926f311c3c3 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:16.029881 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38048112-a676-4742-a44a-818ad19f0475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:16.030512 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38048112-a676-4742-a44a-818ad19f0475 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:16.030791 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38048112-a676-4742-a44a-818ad19f0475 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:16.031069 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38048112-a676-4742-a44a-818ad19f0475 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:16.031649 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38048112-a676-4742-a44a-818ad19f0475 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:16.033048 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38048112-a676-4742-a44a-818ad19f0475 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:16.042252 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-38048112-a676-4742-a44a-818ad19f0475 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 20:18:16.042252 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:16.042252 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 20:18:16.042252 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 20:18:16.042252 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 20:18:16.042252 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 20:18:16.042252 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 20:18:16.042252 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:16.042252 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 20:18:16.042252 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:16.042252 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 20:18:16.042252 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:16.042252 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:16.042252 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:16.042252 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:16.042252 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:16.042252 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:16.043265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:16.043265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:16.043265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:16.043265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:16.043265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:16.043265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:16.043265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 20:18:16.043265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 20:18:16.043265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 20:18:16.043265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 20:18:16.043265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:16.043265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:16.043265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:16.043265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:16.043265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:16.043265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:16.044094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:16.044094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:16.044094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:16.044094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:16.044094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:16.044094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:16.044094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:16.044094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:16.044094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:16.044094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:16.044094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 20:18:16.044094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:16.044094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 20:18:16.044094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:16.044094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 310/618] 10.222.0.23 () {56 vars in 1129 bytes} [Wed Nov 2 20:18:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:16.044922 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38048112-a676-4742-a44a-818ad19f0475 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:16.088452 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:16.131316 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52c70a-71d9-4f35-a06a-8926f311c3c3 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:16.153744 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38048112-a676-4742-a44a-818ad19f0475 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:16.156458 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:16.172442 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba559db9-2a5b-4b3b-a3d2-94e00d574bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:16.173505 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba559db9-2a5b-4b3b-a3d2-94e00d574bfa None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:16.173793 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba559db9-2a5b-4b3b-a3d2-94e00d574bfa None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:16.174068 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba559db9-2a5b-4b3b-a3d2-94e00d574bfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:16.187725 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba559db9-2a5b-4b3b-a3d2-94e00d574bfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:16.189267 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba559db9-2a5b-4b3b-a3d2-94e00d574bfa None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:16.192419 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb278680-cb87-4891-b4e6-97fbe0e7a2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:16.193079 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb278680-cb87-4891-b4e6-97fbe0e7a2e6 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:16.193364 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb278680-cb87-4891-b4e6-97fbe0e7a2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:16.193640 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb278680-cb87-4891-b4e6-97fbe0e7a2e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:16.203416 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-ba559db9-2a5b-4b3b-a3d2-94e00d574bfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:16.203416 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:16.203416 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:16.203416 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:16.203416 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:16.203416 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:16.203416 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:16.203416 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:16.203416 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:16.203416 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:16.203416 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:16.203416 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:16.203416 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:18:16.203416 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:18:16.203416 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:18:16.203416 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:18:16.204583 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:16.204583 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:16.204583 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:16.204583 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:16.204583 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:16.204583 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:16.204583 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:16.204583 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:16.204583 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:16.204583 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:16.204583 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:16.204583 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:16.204583 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:16.204583 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:16.204583 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:16.204583 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:16.204583 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:18:16.205955 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:18:16.205955 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:16.205955 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:16.205955 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 309/619] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:18:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:16.205955 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba559db9-2a5b-4b3b-a3d2-94e00d574bfa None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:16.212095 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb278680-cb87-4891-b4e6-97fbe0e7a2e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:16.213880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb278680-cb87-4891-b4e6-97fbe0e7a2e6 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:16.233336 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-eb278680-cb87-4891-b4e6-97fbe0e7a2e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:16.233336 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:16.233336 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:16.233336 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:16.233336 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:16.233336 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:16.233336 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:16.233336 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:16.233336 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:16.233336 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:16.233336 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:16.233336 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:16.233336 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:18:16.233336 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:18:16.233336 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:18:16.233336 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:18:16.234376 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:16.234376 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:16.234376 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:16.234376 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:16.234376 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:16.234376 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:16.234376 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:16.234376 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:16.234376 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:16.234376 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:16.234376 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:16.234376 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:16.234376 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:16.234376 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:16.234376 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:16.234376 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:16.234376 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:18:16.235262 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:18:16.235262 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:16.235262 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:16.235262 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 311/620] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:18:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:16.236026 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb278680-cb87-4891-b4e6-97fbe0e7a2e6 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:16.311030 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba559db9-2a5b-4b3b-a3d2-94e00d574bfa None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:16.324245 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:16.337736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb278680-cb87-4891-b4e6-97fbe0e7a2e6 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:16.345058 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40b3eb-9f0c-473a-b07b-b99cd028786f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:16.345658 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40b3eb-9f0c-473a-b07b-b99cd028786f None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:16.345940 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40b3eb-9f0c-473a-b07b-b99cd028786f None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:16.346217 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40b3eb-9f0c-473a-b07b-b99cd028786f None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:16.346840 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40b3eb-9f0c-473a-b07b-b99cd028786f None admin] RBAC: Adding query filter params (name=network) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:16.347174 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40b3eb-9f0c-473a-b07b-b99cd028786f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:16.348527 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40b3eb-9f0c-473a-b07b-b99cd028786f None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:16.353368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 310/621] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Nov 2 20:18:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:16.354142 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40b3eb-9f0c-473a-b07b-b99cd028786f None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:16.376237 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52858cb8-a156-4891-9498-e1160d5b903c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:16.376867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52858cb8-a156-4891-9498-e1160d5b903c None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:16.377155 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52858cb8-a156-4891-9498-e1160d5b903c None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:16.377430 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52858cb8-a156-4891-9498-e1160d5b903c None admin] PATH_INFO: `/v3/services` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:16.378048 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52858cb8-a156-4891-9498-e1160d5b903c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:16.378349 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52858cb8-a156-4891-9498-e1160d5b903c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:16.379688 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52858cb8-a156-4891-9498-e1160d5b903c None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:16.384571 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 312/622] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Nov 2 20:18:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:16.385283 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52858cb8-a156-4891-9498-e1160d5b903c None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:16.403292 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:16.454914 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40b3eb-9f0c-473a-b07b-b99cd028786f None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:16.483688 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52858cb8-a156-4891-9498-e1160d5b903c None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:16.487346 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714e760-0110-43a0-a299-73bf59ecb636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:16.487938 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714e760-0110-43a0-a299-73bf59ecb636 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:16.488217 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714e760-0110-43a0-a299-73bf59ecb636 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:16.488489 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714e760-0110-43a0-a299-73bf59ecb636 None admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:16.489151 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714e760-0110-43a0-a299-73bf59ecb636 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:16.489455 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714e760-0110-43a0-a299-73bf59ecb636 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:16.490824 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714e760-0110-43a0-a299-73bf59ecb636 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:16.502162 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 311/623] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:16.503300 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2bd8d1-5e10-4dd0-9d8e-4bc56031d670 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:16.503580 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2bd8d1-5e10-4dd0-9d8e-4bc56031d670 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:16.503849 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2bd8d1-5e10-4dd0-9d8e-4bc56031d670 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:16.505229 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 312/624] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:16.505735 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2bd8d1-5e10-4dd0-9d8e-4bc56031d670 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:16.528041 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c49444-d95a-4684-bcc0-266a13067164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:16.528689 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c49444-d95a-4684-bcc0-266a13067164 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:16.529001 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c49444-d95a-4684-bcc0-266a13067164 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:16.529283 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c49444-d95a-4684-bcc0-266a13067164 None admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:16.529927 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c49444-d95a-4684-bcc0-266a13067164 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:16.530235 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c49444-d95a-4684-bcc0-266a13067164 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:16.531591 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c49444-d95a-4684-bcc0-266a13067164 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:16.543509 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 313/625] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:16.544272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c49444-d95a-4684-bcc0-266a13067164 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:16.553492 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:16.614318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2bd8d1-5e10-4dd0-9d8e-4bc56031d670 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:16.621376 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:16.644264 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c49444-d95a-4684-bcc0-266a13067164 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:16.648116 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614a170-51e5-4f52-b54f-f20005bfe29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:16.648806 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614a170-51e5-4f52-b54f-f20005bfe29e None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:16.649091 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614a170-51e5-4f52-b54f-f20005bfe29e None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:16.649366 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614a170-51e5-4f52-b54f-f20005bfe29e None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:16.649992 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614a170-51e5-4f52-b54f-f20005bfe29e None admin] RBAC: Adding query filter params (type=network) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:16.650297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614a170-51e5-4f52-b54f-f20005bfe29e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:16.651658 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614a170-51e5-4f52-b54f-f20005bfe29e None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:16.656317 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 313/626] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Nov 2 20:18:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:16.657126 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614a170-51e5-4f52-b54f-f20005bfe29e None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:16.678326 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44277727-2306-4de1-ae96-da666b735049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:16.678936 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44277727-2306-4de1-ae96-da666b735049 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:16.679222 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44277727-2306-4de1-ae96-da666b735049 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:16.679502 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44277727-2306-4de1-ae96-da666b735049 None admin] PATH_INFO: `/v3/services` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:16.680668 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44277727-2306-4de1-ae96-da666b735049 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:16.680979 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44277727-2306-4de1-ae96-da666b735049 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:16.682354 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44277727-2306-4de1-ae96-da666b735049 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:16.687569 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 314/627] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Nov 2 20:18:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:16.688733 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98713036-ba65-4ab8-b555-bc82e12ac236 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:16.689099 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98713036-ba65-4ab8-b555-bc82e12ac236 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:16.689358 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98713036-ba65-4ab8-b555-bc82e12ac236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:16.706710 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-98713036-ba65-4ab8-b555-bc82e12ac236 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:16.707892 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-98713036-ba65-4ab8-b555-bc82e12ac236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:16.760934 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614a170-51e5-4f52-b54f-f20005bfe29e None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:16.762821 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:16.776238 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 315/628] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:18:16.777122 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98713036-ba65-4ab8-b555-bc82e12ac236 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:16.817320 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd91c9-cda5-4cd2-a21e-9b17d12e2cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:16.817950 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd91c9-cda5-4cd2-a21e-9b17d12e2cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:16.818231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd91c9-cda5-4cd2-a21e-9b17d12e2cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:16.818506 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd91c9-cda5-4cd2-a21e-9b17d12e2cb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:16.826693 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd91c9-cda5-4cd2-a21e-9b17d12e2cb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:16.828125 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd91c9-cda5-4cd2-a21e-9b17d12e2cb6 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:16.841211 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-d0fd91c9-cda5-4cd2-a21e-9b17d12e2cb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:18:16.841211 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:16.841211 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:16.841211 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:16.841211 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:16.841211 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:16.841211 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:16.841211 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:16.841211 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:16.841211 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:16.841211 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:16.841211 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:16.841211 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 20:18:16.841211 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 20:18:16.841211 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 20:18:16.842284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 20:18:16.842284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:16.842284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:16.842284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:16.842284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:16.842284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:16.842284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:16.842284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:16.842284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:16.842284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:16.842284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:16.842284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:16.842284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:16.842284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:16.842284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:16.842284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:16.842284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:16.843220 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 20:18:16.843220 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 20:18:16.843220 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 20:18:16.843220 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 20:18:16.843220 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 20:18:16.843220 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 20:18:16.843220 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:18:16.843220 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:16.843220 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 314/629] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:18:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:16.843220 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd91c9-cda5-4cd2-a21e-9b17d12e2cb6 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:16.855226 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:16.886147 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98713036-ba65-4ab8-b555-bc82e12ac236 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:16.919901 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1891c313-f4dd-4972-8d17-cff45bfb9d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:16.920460 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891c313-f4dd-4972-8d17-cff45bfb9d5b None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:16.920768 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891c313-f4dd-4972-8d17-cff45bfb9d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:16.921047 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891c313-f4dd-4972-8d17-cff45bfb9d5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:16.927564 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1891c313-f4dd-4972-8d17-cff45bfb9d5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:16.929062 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1891c313-f4dd-4972-8d17-cff45bfb9d5b None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:16.942353 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-1891c313-f4dd-4972-8d17-cff45bfb9d5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:18:16.942353 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:16.942353 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:16.942353 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:16.942353 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:16.942353 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:16.942353 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:16.942353 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:16.942353 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:16.942353 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:16.942353 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:16.942353 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:16.942353 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 20:18:16.942353 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 20:18:16.942353 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 20:18:16.943334 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 20:18:16.943334 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:16.943334 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:16.943334 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:16.943334 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:16.943334 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:16.943334 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:16.943334 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:16.943334 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:16.943334 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:16.943334 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:16.943334 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:16.943334 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:16.943334 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:16.943334 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:16.943334 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:16.943334 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:16.944233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 20:18:16.944233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 20:18:16.944233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 20:18:16.944233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 20:18:16.944233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 20:18:16.944233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 20:18:16.944233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:18:16.944233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:16.944233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 316/630] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:18:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:16.944769 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1891c313-f4dd-4972-8d17-cff45bfb9d5b None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:16.955698 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd91c9-cda5-4cd2-a21e-9b17d12e2cb6 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:16.990881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09581a59-de22-461d-b172-45b54ab2917e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:16.991472 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09581a59-de22-461d-b172-45b54ab2917e None admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:16.991755 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09581a59-de22-461d-b172-45b54ab2917e None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:16.992032 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09581a59-de22-461d-b172-45b54ab2917e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:16.993256 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09581a59-de22-461d-b172-45b54ab2917e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:16.994710 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09581a59-de22-461d-b172-45b54ab2917e None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:17.015946 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 315/631] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:18:16 2022] POST /identity/v3/endpoints => generated 337 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:18:17.016806 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09581a59-de22-461d-b172-45b54ab2917e None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:17.052335 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:17.075553 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1891c313-f4dd-4972-8d17-cff45bfb9d5b None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:17.109513 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:17.121517 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a175a9a-3fbe-4ac6-9ce6-c0fff695a6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:17.122147 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a175a9a-3fbe-4ac6-9ce6-c0fff695a6d1 None admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:17.122432 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a175a9a-3fbe-4ac6-9ce6-c0fff695a6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:17.122712 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a175a9a-3fbe-4ac6-9ce6-c0fff695a6d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:17.123395 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a175a9a-3fbe-4ac6-9ce6-c0fff695a6d1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:17.125090 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a175a9a-3fbe-4ac6-9ce6-c0fff695a6d1 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:17.160586 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 317/632] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:18:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:18:17.160586 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a175a9a-3fbe-4ac6-9ce6-c0fff695a6d1 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:17.167786 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09581a59-de22-461d-b172-45b54ab2917e None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:17.224667 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbcf14-f129-4bb0-9a82-4d8150005735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:17.225250 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbcf14-f129-4bb0-9a82-4d8150005735 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:17.225721 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbcf14-f129-4bb0-9a82-4d8150005735 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:17.226049 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbcf14-f129-4bb0-9a82-4d8150005735 None admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:17.227297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cbcf14-f129-4bb0-9a82-4d8150005735 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:17.227901 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cbcf14-f129-4bb0-9a82-4d8150005735 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:17.229677 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cbcf14-f129-4bb0-9a82-4d8150005735 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:17.246036 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 316/633] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Nov 2 20:18:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:17.247314 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbcf14-f129-4bb0-9a82-4d8150005735 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:17.301429 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a175a9a-3fbe-4ac6-9ce6-c0fff695a6d1 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:17.340845 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:17.341801 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74581d-c328-4603-b69e-18c53a48a2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:17.342603 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74581d-c328-4603-b69e-18c53a48a2a8 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:17.342879 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74581d-c328-4603-b69e-18c53a48a2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:17.343152 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74581d-c328-4603-b69e-18c53a48a2a8 None admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:17.343857 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74581d-c328-4603-b69e-18c53a48a2a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:17.344166 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74581d-c328-4603-b69e-18c53a48a2a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:17.345680 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74581d-c328-4603-b69e-18c53a48a2a8 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:17.359935 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 318/634] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Nov 2 20:18:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:17.360911 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74581d-c328-4603-b69e-18c53a48a2a8 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:17.372263 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbcf14-f129-4bb0-9a82-4d8150005735 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:17.411453 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be981d-3f39-4cb4-a3a9-9a061c6bacbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:17.412214 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be981d-3f39-4cb4-a3a9-9a061c6bacbb None admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:17.412497 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be981d-3f39-4cb4-a3a9-9a061c6bacbb None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:17.412802 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be981d-3f39-4cb4-a3a9-9a061c6bacbb None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:17.413457 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be981d-3f39-4cb4-a3a9-9a061c6bacbb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:17.413736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:17.414899 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be981d-3f39-4cb4-a3a9-9a061c6bacbb None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:17.434195 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 317/635] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Nov 2 20:18:17 2022] POST /identity/v3/services => generated 269 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:18:17.434834 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be981d-3f39-4cb4-a3a9-9a061c6bacbb None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:17.481554 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74581d-c328-4603-b69e-18c53a48a2a8 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:17.527679 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491eeca-1f02-47dd-a486-8a8726e0e8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:17.528728 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491eeca-1f02-47dd-a486-8a8726e0e8a8 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:17.529233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491eeca-1f02-47dd-a486-8a8726e0e8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:17.529721 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491eeca-1f02-47dd-a486-8a8726e0e8a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:17.530697 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491eeca-1f02-47dd-a486-8a8726e0e8a8 None admin] RBAC: Adding query filter params (role.id=bca2e686aa5e4fdc844fc679a4c41939, scope.project.id=a144e65ce44c44dc99c07a7f5be303b7, user.id=95f22f80ac694e9888c132af1e58e292) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:17.531100 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491eeca-1f02-47dd-a486-8a8726e0e8a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:17.532700 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491eeca-1f02-47dd-a486-8a8726e0e8a8 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:17.541108 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 319/636] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Nov 2 20:18:17 2022] GET /identity/v3/role_assignments?user.id=95f22f80ac694e9888c132af1e58e292&scope.project.id=a144e65ce44c44dc99c07a7f5be303b7&role.id=bca2e686aa5e4fdc844fc679a4c41939 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:17.561869 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be981d-3f39-4cb4-a3a9-9a061c6bacbb None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:17.602582 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2ab6e-4955-493f-a8e9-b1482eaa0f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:17.603509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2ab6e-4955-493f-a8e9-b1482eaa0f34 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:17.604002 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2ab6e-4955-493f-a8e9-b1482eaa0f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:17.604420 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2ab6e-4955-493f-a8e9-b1482eaa0f34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:17.605371 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2ab6e-4955-493f-a8e9-b1482eaa0f34 None admin] RBAC: Adding query filter params (role.id=59b45b6df1ee465bbbb8bdba4b4e281d, scope.project.id=a144e65ce44c44dc99c07a7f5be303b7, user.id=66937804f65147f392f4ddfc3e961d5d) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:17.605845 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2ab6e-4955-493f-a8e9-b1482eaa0f34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:17.607601 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2ab6e-4955-493f-a8e9-b1482eaa0f34 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:17.610077 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:17.616322 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 318/637] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Nov 2 20:18:17 2022] GET /identity/v3/role_assignments?user.id=66937804f65147f392f4ddfc3e961d5d&scope.project.id=a144e65ce44c44dc99c07a7f5be303b7&role.id=59b45b6df1ee465bbbb8bdba4b4e281d => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:19.395648 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572907c-7318-4365-8bfa-62598c0da6e2 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:19.396737 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572907c-7318-4365-8bfa-62598c0da6e2 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:19.397250 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572907c-7318-4365-8bfa-62598c0da6e2 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:19.399112 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 320/638] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:19.405039 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d6c17-a909-4cf9-9e34-b8c792cd9b1a None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:19.405876 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d6c17-a909-4cf9-9e34-b8c792cd9b1a None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:19.406360 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d6c17-a909-4cf9-9e34-b8c792cd9b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:19.425814 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-b30d6c17-a909-4cf9-9e34-b8c792cd9b1a None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:19.427326 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-b30d6c17-a909-4cf9-9e34-b8c792cd9b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:19.498470 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 319/639] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:19 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:18:19.673526 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a61e6-d5e8-458e-b314-f4f974f748f6 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:19.673709 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a61e6-d5e8-458e-b314-f4f974f748f6 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:19.673989 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a61e6-d5e8-458e-b314-f4f974f748f6 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:19.675744 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 321/640] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:19.682246 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f6830-88b2-451e-99c4-06672796097c None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:19.682550 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f6830-88b2-451e-99c4-06672796097c None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:19.682809 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f6830-88b2-451e-99c4-06672796097c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:19.702514 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-769f6830-88b2-451e-99c4-06672796097c None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:19.704028 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-769f6830-88b2-451e-99c4-06672796097c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:19.774643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a61e6-d5e8-458e-b314-f4f974f748f6 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:19.783178 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 320/641] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:19 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:18:19.785276 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a4664-5c0b-47a9-8a93-292572f536db None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:19.785276 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a4664-5c0b-47a9-8a93-292572f536db None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:19.785276 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a4664-5c0b-47a9-8a93-292572f536db None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:19.786639 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 321/642] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:19.793123 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c615b1-a9f1-4242-abc5-d127e3e66a54 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:19.793583 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c615b1-a9f1-4242-abc5-d127e3e66a54 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:19.794012 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c615b1-a9f1-4242-abc5-d127e3e66a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:19.814109 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-b2c615b1-a9f1-4242-abc5-d127e3e66a54 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:19.815533 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-b2c615b1-a9f1-4242-abc5-d127e3e66a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:19.872946 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:19.888338 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 322/643] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:19 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 20:18:19.889827 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f66e8-b716-41ae-9275-5e52e5348792 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:19.890180 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f66e8-b716-41ae-9275-5e52e5348792 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:19.890518 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f66e8-b716-41ae-9275-5e52e5348792 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:19.891943 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 323/644] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:19.897121 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddaa67b-d98f-4e14-80f5-77aca4b9fc6d None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:19.897258 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddaa67b-d98f-4e14-80f5-77aca4b9fc6d None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:19.897539 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddaa67b-d98f-4e14-80f5-77aca4b9fc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:19.901422 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a61e6-d5e8-458e-b314-f4f974f748f6 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:19.904605 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:19.917170 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-8ddaa67b-d98f-4e14-80f5-77aca4b9fc6d None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:19.918599 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-8ddaa67b-d98f-4e14-80f5-77aca4b9fc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:19.939806 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544e5bd-597e-449b-8159-35dab62a7122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:19.940764 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544e5bd-597e-449b-8159-35dab62a7122 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:19.941256 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544e5bd-597e-449b-8159-35dab62a7122 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:19.941741 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544e5bd-597e-449b-8159-35dab62a7122 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:19.942519 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f544e5bd-597e-449b-8159-35dab62a7122 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:19.944091 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f544e5bd-597e-449b-8159-35dab62a7122 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:19.953243 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-f544e5bd-597e-449b-8159-35dab62a7122 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 20:18:19.953243 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:19.953243 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 20:18:19.953243 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 20:18:19.953243 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 20:18:19.953243 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 20:18:19.953243 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 20:18:19.953243 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:19.953243 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 20:18:19.953243 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:19.953243 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 20:18:19.953243 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:19.953243 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:19.953243 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:19.953243 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:19.953243 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:19.953243 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:19.954226 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:19.954226 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:19.954226 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:19.954226 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:19.954226 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:19.954226 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:19.954226 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 20:18:19.954226 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 20:18:19.954226 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 20:18:19.954226 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 20:18:19.954226 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:19.954226 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:19.954226 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:19.954226 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:19.954226 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:19.954226 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:19.955161 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:19.955161 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:19.955161 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:19.955161 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:19.955161 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:19.955161 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:19.955161 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:19.955161 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:19.955161 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:19.955161 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:19.955161 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 20:18:19.955161 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:19.955161 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 20:18:19.955161 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:19.957830 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 322/645] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Nov 2 20:18:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 20:18:19.964228 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544e5bd-597e-449b-8159-35dab62a7122 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:20.000016 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 324/646] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:19 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 20:18:20.059908 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddaa67b-d98f-4e14-80f5-77aca4b9fc6d None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:20.076223 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544e5bd-597e-449b-8159-35dab62a7122 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:20.122023 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e6b22-af98-41dc-b7b9-3a19a463fa25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:20.122635 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e6b22-af98-41dc-b7b9-3a19a463fa25 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:20.122926 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e6b22-af98-41dc-b7b9-3a19a463fa25 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:20.123722 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e6b22-af98-41dc-b7b9-3a19a463fa25 None admin] PATH_INFO: `/v3/services` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:20.124365 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e6b22-af98-41dc-b7b9-3a19a463fa25 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:20.124991 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e6b22-af98-41dc-b7b9-3a19a463fa25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:20.127042 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e6b22-af98-41dc-b7b9-3a19a463fa25 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:20.134779 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 323/647] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Nov 2 20:18:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:20.142943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e6b22-af98-41dc-b7b9-3a19a463fa25 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:20.179625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:20.188575 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddaa67b-d98f-4e14-80f5-77aca4b9fc6d None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:20.214725 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:20.232970 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f0ede-88b1-45ba-ad00-f18dfd9d2fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:20.233601 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f0ede-88b1-45ba-ad00-f18dfd9d2fdf None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:20.233887 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f0ede-88b1-45ba-ad00-f18dfd9d2fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:20.234166 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f0ede-88b1-45ba-ad00-f18dfd9d2fdf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:20.234753 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f0ede-88b1-45ba-ad00-f18dfd9d2fdf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:20.236126 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f0ede-88b1-45ba-ad00-f18dfd9d2fdf None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:20.245192 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-c50f0ede-88b1-45ba-ad00-f18dfd9d2fdf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 20:18:20.245192 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:20.245192 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 20:18:20.245192 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 20:18:20.245192 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 20:18:20.245192 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 20:18:20.245192 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 20:18:20.245192 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:20.245192 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 20:18:20.245192 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:20.245192 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 20:18:20.245192 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:20.245192 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:20.245192 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:20.245192 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:20.245192 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:20.248660 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:20.248660 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:20.248660 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:20.248660 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:20.248660 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:20.248660 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:20.248660 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:20.248660 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 20:18:20.248660 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 20:18:20.248660 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 20:18:20.248660 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 20:18:20.248660 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:20.248660 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:20.248660 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:20.248660 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:20.248660 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:20.248660 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:20.249604 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:20.249604 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:20.249604 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:20.249604 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:20.249604 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:20.249604 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:20.249604 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:20.249604 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:20.249604 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:20.249604 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:20.249604 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 20:18:20.249604 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:20.249604 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 20:18:20.249604 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:20.249604 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 325/648] 10.222.0.23 () {56 vars in 1132 bytes} [Wed Nov 2 20:18:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 20:18:20.250391 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f0ede-88b1-45ba-ad00-f18dfd9d2fdf None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:20.268710 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e6b22-af98-41dc-b7b9-3a19a463fa25 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:20.302439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d00de-30dc-4158-98a0-688eb66f9832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:20.303039 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d00de-30dc-4158-98a0-688eb66f9832 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:20.303325 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d00de-30dc-4158-98a0-688eb66f9832 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:20.303602 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d00de-30dc-4158-98a0-688eb66f9832 None admin] PATH_INFO: `/v3/services` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:20.304229 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d00de-30dc-4158-98a0-688eb66f9832 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:20.304535 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d00de-30dc-4158-98a0-688eb66f9832 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:20.305937 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d00de-30dc-4158-98a0-688eb66f9832 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:20.322992 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 324/649] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Nov 2 20:18:20 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:18:20.322992 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d00de-30dc-4158-98a0-688eb66f9832 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:20.358134 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f0ede-88b1-45ba-ad00-f18dfd9d2fdf None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:20.397423 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d6a6b-b461-4c7a-b479-ffed4f497bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:20.398065 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d6a6b-b461-4c7a-b479-ffed4f497bbf None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:20.398349 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d6a6b-b461-4c7a-b479-ffed4f497bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:20.398703 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d6a6b-b461-4c7a-b479-ffed4f497bbf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:20.399791 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d6a6b-b461-4c7a-b479-ffed4f497bbf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:20.401251 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d6a6b-b461-4c7a-b479-ffed4f497bbf None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:20.410907 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-604d6a6b-b461-4c7a-b479-ffed4f497bbf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 20:18:20.410907 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:20.410907 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 20:18:20.410907 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 20:18:20.410907 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 20:18:20.410907 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 20:18:20.410907 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 20:18:20.410907 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:20.410907 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 20:18:20.410907 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:20.410907 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 20:18:20.410907 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:20.410907 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:20.410907 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:20.410907 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:20.410907 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:20.410907 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:20.412449 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:20.412449 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:20.412449 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:20.412449 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:20.412449 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:20.412449 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:20.412449 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 20:18:20.412449 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 20:18:20.412449 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 20:18:20.412449 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 20:18:20.412449 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:20.412449 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:20.412449 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:20.412449 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:20.412449 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:20.412449 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:20.413380 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:20.413380 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:20.413380 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:20.413380 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:20.413380 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:20.413380 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:20.413380 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:20.413380 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:20.413380 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:20.413380 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:20.413380 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 20:18:20.413380 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:20.413380 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 20:18:20.413380 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:20.413380 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 326/650] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Nov 2 20:18:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:20.414211 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d6a6b-b461-4c7a-b479-ffed4f497bbf None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:20.435161 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:20.441447 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d00de-30dc-4158-98a0-688eb66f9832 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:20.474903 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:20.479711 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286fa4f8-66f8-43ab-bbf8-1de4ac92623b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:20.480368 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fa4f8-66f8-43ab-bbf8-1de4ac92623b None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:20.480687 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fa4f8-66f8-43ab-bbf8-1de4ac92623b None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:20.481009 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fa4f8-66f8-43ab-bbf8-1de4ac92623b None admin] PATH_INFO: `/v3/services` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:20.481656 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286fa4f8-66f8-43ab-bbf8-1de4ac92623b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:20.481958 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286fa4f8-66f8-43ab-bbf8-1de4ac92623b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:20.483317 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286fa4f8-66f8-43ab-bbf8-1de4ac92623b None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:20.489218 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 325/651] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Nov 2 20:18:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:20.490005 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286fa4f8-66f8-43ab-bbf8-1de4ac92623b None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:20.543064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d6a6b-b461-4c7a-b479-ffed4f497bbf None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:20.578622 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036f53b-fd6e-436b-a17c-cfe1eff16cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:20.579257 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036f53b-fd6e-436b-a17c-cfe1eff16cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:20.579539 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036f53b-fd6e-436b-a17c-cfe1eff16cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:20.579818 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036f53b-fd6e-436b-a17c-cfe1eff16cd8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:20.590987 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036f53b-fd6e-436b-a17c-cfe1eff16cd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:18:20.596407 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-b036f53b-fd6e-436b-a17c-cfe1eff16cd8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 20:18:20.596407 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:20.596407 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:20.596407 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:20.596407 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:20.596407 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:20.596407 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:20.596407 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:20.596407 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:20.596407 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:20.596407 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:20.596407 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:20.596407 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:18:20.596407 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:18:20.596407 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:18:20.596407 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:18:20.597599 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:18:20.597599 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:18:20.597599 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:18:20.597599 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:18:20.597599 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:20.597599 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:20.597599 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:20.597599 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:20.597599 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:20.597599 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:20.597599 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:20.597599 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:20.597599 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:20.597599 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:20.597599 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:20.597599 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:20.598462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:20.598462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:20.598462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:20.598462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:20.598462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:18:20.598462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:18:20.598462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:18:20.598462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:18:20.598462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:18:20.598462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:18:20.598462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 20:18:20.598462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:20.598462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 327/652] 10.222.0.23 () {56 vars in 1120 bytes} [Wed Nov 2 20:18:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:20.598462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036f53b-fd6e-436b-a17c-cfe1eff16cd8 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:20.606931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286fa4f8-66f8-43ab-bbf8-1de4ac92623b None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:20.642035 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b220f-9d04-41ea-b4ad-bdbf299ec1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:20.642641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b220f-9d04-41ea-b4ad-bdbf299ec1c0 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:20.642925 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b220f-9d04-41ea-b4ad-bdbf299ec1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:20.643197 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b220f-9d04-41ea-b4ad-bdbf299ec1c0 None admin] PATH_INFO: `/v3/services` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:20.643823 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b220f-9d04-41ea-b4ad-bdbf299ec1c0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:20.644129 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b220f-9d04-41ea-b4ad-bdbf299ec1c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:20.645508 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b220f-9d04-41ea-b4ad-bdbf299ec1c0 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:20.655032 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 326/653] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Nov 2 20:18:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:20.655032 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b220f-9d04-41ea-b4ad-bdbf299ec1c0 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:20.678903 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:20.710920 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036f53b-fd6e-436b-a17c-cfe1eff16cd8 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:20.719636 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:20.748644 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d56c6c-2d8e-42a8-858c-fc3ca064db79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:20.749297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d56c6c-2d8e-42a8-858c-fc3ca064db79 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:20.749578 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d56c6c-2d8e-42a8-858c-fc3ca064db79 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:20.749851 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d56c6c-2d8e-42a8-858c-fc3ca064db79 None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:20.750477 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d56c6c-2d8e-42a8-858c-fc3ca064db79 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:20.750784 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d56c6c-2d8e-42a8-858c-fc3ca064db79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:20.752171 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d56c6c-2d8e-42a8-858c-fc3ca064db79 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:20.757628 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 328/654] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Nov 2 20:18:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:20.758839 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d56c6c-2d8e-42a8-858c-fc3ca064db79 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:20.764459 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b220f-9d04-41ea-b4ad-bdbf299ec1c0 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:20.801507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f669f0-4122-4dbe-84b2-599c256e114c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:20.802119 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f669f0-4122-4dbe-84b2-599c256e114c None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:20.802403 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f669f0-4122-4dbe-84b2-599c256e114c None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:20.802681 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f669f0-4122-4dbe-84b2-599c256e114c None admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:20.803350 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f669f0-4122-4dbe-84b2-599c256e114c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:20.803660 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f669f0-4122-4dbe-84b2-599c256e114c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:20.805124 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f669f0-4122-4dbe-84b2-599c256e114c None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:20.814279 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 327/655] 10.222.0.23 () {56 vars in 1115 bytes} [Wed Nov 2 20:18:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:20.815494 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f669f0-4122-4dbe-84b2-599c256e114c None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:20.868495 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d56c6c-2d8e-42a8-858c-fc3ca064db79 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:20.902170 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e947d50-d728-44fe-81a7-8c9d39b1fc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:20.902774 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e947d50-d728-44fe-81a7-8c9d39b1fc1a None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:20.903055 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e947d50-d728-44fe-81a7-8c9d39b1fc1a None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:20.903333 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e947d50-d728-44fe-81a7-8c9d39b1fc1a None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:20.903957 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e947d50-d728-44fe-81a7-8c9d39b1fc1a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:20.904260 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e947d50-d728-44fe-81a7-8c9d39b1fc1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:20.905656 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e947d50-d728-44fe-81a7-8c9d39b1fc1a None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:20.909897 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 329/656] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Nov 2 20:18:20 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:20.910651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e947d50-d728-44fe-81a7-8c9d39b1fc1a None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:20.919964 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:20.939600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f669f0-4122-4dbe-84b2-599c256e114c None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:20.962425 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:20.983463 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f22b59-4c8b-4357-8e05-b9f09468111a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:20.984443 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f22b59-4c8b-4357-8e05-b9f09468111a None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:20.984941 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f22b59-4c8b-4357-8e05-b9f09468111a None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:20.985363 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f22b59-4c8b-4357-8e05-b9f09468111a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:20.986238 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f22b59-4c8b-4357-8e05-b9f09468111a None admin] RBAC: Adding query filter params (interface=public, service_id=192c8b9f21734e4ba38e6d198a10b60b, region_id=RegionOne) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:20.986733 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f22b59-4c8b-4357-8e05-b9f09468111a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:20.988419 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f22b59-4c8b-4357-8e05-b9f09468111a None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:20.995485 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 328/657] 10.222.0.23 () {56 vars in 1251 bytes} [Wed Nov 2 20:18:20 2022] GET /identity/v3/endpoints?service_id=192c8b9f21734e4ba38e6d198a10b60b&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:21.005758 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f22b59-4c8b-4357-8e05-b9f09468111a None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:21.047100 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e947d50-d728-44fe-81a7-8c9d39b1fc1a None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:21.088158 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778dc9c-0576-4f17-abd0-7177d18e4440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:21.088933 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778dc9c-0576-4f17-abd0-7177d18e4440 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:21.089290 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778dc9c-0576-4f17-abd0-7177d18e4440 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:21.089663 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778dc9c-0576-4f17-abd0-7177d18e4440 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:21.102853 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5778dc9c-0576-4f17-abd0-7177d18e4440 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:21.104520 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5778dc9c-0576-4f17-abd0-7177d18e4440 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:21.117949 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f22b59-4c8b-4357-8e05-b9f09468111a None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:21.121379 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-5778dc9c-0576-4f17-abd0-7177d18e4440 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:21.121379 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:21.121379 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:21.121379 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:21.121379 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:21.121379 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:21.121379 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:21.121379 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:21.121379 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:21.121379 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:21.121379 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:21.121379 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:21.121379 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:18:21.121379 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:18:21.121379 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:18:21.121379 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:18:21.122299 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:21.122299 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:21.122299 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:21.122299 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:21.122299 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:21.122299 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:21.122299 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:21.122299 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:21.122299 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:21.122299 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:21.122299 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:21.122299 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:21.122299 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:21.122299 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:21.122299 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:21.122299 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:21.122299 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:18:21.123171 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:18:21.123171 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:21.123171 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:21.123350 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 330/658] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:18:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:21.131160 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778dc9c-0576-4f17-abd0-7177d18e4440 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:21.161806 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f560c-df44-48b6-9db7-b93cd9541421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:21.162822 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f560c-df44-48b6-9db7-b93cd9541421 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:21.163307 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f560c-df44-48b6-9db7-b93cd9541421 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:21.163847 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f560c-df44-48b6-9db7-b93cd9541421 None admin] PATH_INFO: `/v3/services` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:21.165051 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f560c-df44-48b6-9db7-b93cd9541421 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:21.167289 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f560c-df44-48b6-9db7-b93cd9541421 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:21.174794 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 329/659] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Nov 2 20:18:21 2022] GET /identity/v3/services => generated 1029 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:18:21.242925 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:21.262391 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778dc9c-0576-4f17-abd0-7177d18e4440 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:21.301555 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c7a78-7a42-4563-8812-78007edc4433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:21.302580 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c7a78-7a42-4563-8812-78007edc4433 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:21.303097 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c7a78-7a42-4563-8812-78007edc4433 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:21.303554 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c7a78-7a42-4563-8812-78007edc4433 None admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:21.304693 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c7a78-7a42-4563-8812-78007edc4433 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:21.305712 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c7a78-7a42-4563-8812-78007edc4433 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:21.307318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c7a78-7a42-4563-8812-78007edc4433 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:21.322446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 331/660] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:18:21.329714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f560c-df44-48b6-9db7-b93cd9541421 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:21.352935 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:21.446766 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f560c-df44-48b6-9db7-b93cd9541421 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:21.481829 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372fa5e-7166-4786-b83d-d8af9fc489fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:21.482469 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372fa5e-7166-4786-b83d-d8af9fc489fc None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:21.482751 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372fa5e-7166-4786-b83d-d8af9fc489fc None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:21.483027 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372fa5e-7166-4786-b83d-d8af9fc489fc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:21.490773 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372fa5e-7166-4786-b83d-d8af9fc489fc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:21.492210 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372fa5e-7166-4786-b83d-d8af9fc489fc None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:21.503866 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-7372fa5e-7166-4786-b83d-d8af9fc489fc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 20:18:21.503866 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:21.503866 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:21.503866 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:21.503866 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:21.503866 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:21.503866 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:21.503866 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:21.503866 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:21.503866 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:21.503866 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:21.503866 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:21.503866 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 20:18:21.503866 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 20:18:21.503866 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 20:18:21.503866 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 20:18:21.504886 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:21.504886 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:21.504886 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 20:18:21.504886 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:18:21.504886 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 20:18:21.504886 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:18:21.504886 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:21.504886 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:21.504886 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:21.504886 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:21.504886 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:21.504886 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:21.504886 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:21.504886 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:21.504886 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:21.504886 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:21.504886 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:21.504886 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:21.505848 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:21.505848 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:21.505848 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 20:18:21.505848 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 20:18:21.505848 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 20:18:21.505848 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 20:18:21.505848 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 20:18:21.505848 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 20:18:21.505848 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 20:18:21.505848 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:21.505848 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 330/661] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Nov 2 20:18:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:21.511445 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c7a78-7a42-4563-8812-78007edc4433 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:21.624225 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c7a78-7a42-4563-8812-78007edc4433 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:21.660562 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a3ea3-1ec8-4bac-abd0-ae2e63d360df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:21.661562 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a3ea3-1ec8-4bac-abd0-ae2e63d360df None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:21.662059 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a3ea3-1ec8-4bac-abd0-ae2e63d360df None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:21.662547 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a3ea3-1ec8-4bac-abd0-ae2e63d360df None admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:21.663461 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a3ea3-1ec8-4bac-abd0-ae2e63d360df None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:21.663957 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a3ea3-1ec8-4bac-abd0-ae2e63d360df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:21.666125 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a3ea3-1ec8-4bac-abd0-ae2e63d360df None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:21.685270 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 332/662] 10.222.0.23 () {56 vars in 1149 bytes} [Wed Nov 2 20:18:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:21.692717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372fa5e-7166-4786-b83d-d8af9fc489fc None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:21.772643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:21.804668 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372fa5e-7166-4786-b83d-d8af9fc489fc None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:21.839797 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca953b-4a4d-4061-afe0-85086f3650cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:21.840436 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca953b-4a4d-4061-afe0-85086f3650cd None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:21.840747 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca953b-4a4d-4061-afe0-85086f3650cd None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:21.841025 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca953b-4a4d-4061-afe0-85086f3650cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:21.852265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca953b-4a4d-4061-afe0-85086f3650cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:21.853753 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca953b-4a4d-4061-afe0-85086f3650cd None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:21.868248 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-8dca953b-4a4d-4061-afe0-85086f3650cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:21.868248 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:21.868248 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:21.868248 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:21.868248 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:21.868248 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:21.868248 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:21.868248 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:21.868248 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:21.868248 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:21.868248 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:21.868248 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:21.868248 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:18:21.868248 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:18:21.868248 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:18:21.868248 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:18:21.869244 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:21.869244 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:21.869244 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:21.869244 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:21.869244 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:21.869244 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:21.869244 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:21.869244 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:21.869244 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:21.869244 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:21.869244 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:21.869244 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:21.869244 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:21.869244 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:21.869244 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:21.869244 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:21.869244 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:18:21.870130 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:18:21.870130 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:21.870130 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:21.870130 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 331/663] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:18:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:21.876384 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a3ea3-1ec8-4bac-abd0-ae2e63d360df None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:21.880780 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:21.985865 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a3ea3-1ec8-4bac-abd0-ae2e63d360df None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:22.021483 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc4bc6-3c1b-4b0a-9a23-e2aae878e1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:22.022091 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc4bc6-3c1b-4b0a-9a23-e2aae878e1ef None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:22.022373 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc4bc6-3c1b-4b0a-9a23-e2aae878e1ef None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:22.022705 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc4bc6-3c1b-4b0a-9a23-e2aae878e1ef None admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:22.023278 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc4bc6-3c1b-4b0a-9a23-e2aae878e1ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:22.023580 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc4bc6-3c1b-4b0a-9a23-e2aae878e1ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:22.025505 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc4bc6-3c1b-4b0a-9a23-e2aae878e1ef None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:22.037489 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 333/664] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:22.043117 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca953b-4a4d-4061-afe0-85086f3650cd None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:22.153337 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca953b-4a4d-4061-afe0-85086f3650cd None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:22.179617 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:22.189921 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e38c7-bfd1-4f2b-b14d-fd9124d80131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:22.190635 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e38c7-bfd1-4f2b-b14d-fd9124d80131 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:22.190923 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e38c7-bfd1-4f2b-b14d-fd9124d80131 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:22.191200 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e38c7-bfd1-4f2b-b14d-fd9124d80131 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:22.199219 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e38c7-bfd1-4f2b-b14d-fd9124d80131 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:22.200798 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e38c7-bfd1-4f2b-b14d-fd9124d80131 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:22.214003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-971e38c7-bfd1-4f2b-b14d-fd9124d80131 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:18:22.214003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:22.214003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:22.214003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:22.214003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:22.214003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:22.214003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:22.214003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:22.214003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:22.214003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:22.214003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:22.214003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:22.214003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 20:18:22.214003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 20:18:22.214003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 20:18:22.214956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 20:18:22.214956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:22.214956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:22.214956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:22.214956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:22.214956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:22.214956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:22.214956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:22.214956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:22.214956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:22.214956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:22.214956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:22.214956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:22.214956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:22.214956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:22.214956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:22.214956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:22.215899 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 20:18:22.215899 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 20:18:22.215899 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 20:18:22.215899 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 20:18:22.215899 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 20:18:22.215899 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 20:18:22.215899 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:18:22.215899 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:22.215899 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 332/665] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:18:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:22.222838 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc4bc6-3c1b-4b0a-9a23-e2aae878e1ef None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:22.287932 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:22.333485 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc4bc6-3c1b-4b0a-9a23-e2aae878e1ef None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:22.367967 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d04df-f734-44f0-ac27-bb7ece29d74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:22.368585 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d04df-f734-44f0-ac27-bb7ece29d74f None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:22.368873 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d04df-f734-44f0-ac27-bb7ece29d74f None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:22.369141 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d04df-f734-44f0-ac27-bb7ece29d74f None admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:22.369819 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d04df-f734-44f0-ac27-bb7ece29d74f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:22.370122 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d04df-f734-44f0-ac27-bb7ece29d74f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:22.371542 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d04df-f734-44f0-ac27-bb7ece29d74f None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:22.384263 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 334/666] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Nov 2 20:18:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:22.390157 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e38c7-bfd1-4f2b-b14d-fd9124d80131 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:22.500304 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e38c7-bfd1-4f2b-b14d-fd9124d80131 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:22.538270 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161e3d7-805b-4153-9f80-f4e9fe37773a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:22.539791 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161e3d7-805b-4153-9f80-f4e9fe37773a None admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:22.540292 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161e3d7-805b-4153-9f80-f4e9fe37773a None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:22.540805 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161e3d7-805b-4153-9f80-f4e9fe37773a None admin] PATH_INFO: `/v3/projects/a144e65ce44c44dc99c07a7f5be303b7/users/66937804f65147f392f4ddfc3e961d5d/roles/4432662371b040ef946fb14e2326f333` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:22.543192 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161e3d7-805b-4153-9f80-f4e9fe37773a None admin] RBAC: Authorizing `identity:create_grant(project_id=a144e65ce44c44dc99c07a7f5be303b7, user_id=66937804f65147f392f4ddfc3e961d5d, role_id=4432662371b040ef946fb14e2326f333)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:22.545229 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ad3c8-4c75-4cc9-b99e-a417e6e27f02 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:22.545655 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161e3d7-805b-4153-9f80-f4e9fe37773a None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:22.545757 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ad3c8-4c75-4cc9-b99e-a417e6e27f02 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:22.545757 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ad3c8-4c75-4cc9-b99e-a417e6e27f02 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:22.547311 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 335/667] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:22.554295 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17614e-9c80-4e9a-bcf6-990abad80171 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:22.554583 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17614e-9c80-4e9a-bcf6-990abad80171 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:22.554883 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17614e-9c80-4e9a-bcf6-990abad80171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:22.566073 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 333/668] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Nov 2 20:18:22 2022] PUT /identity/v3/projects/a144e65ce44c44dc99c07a7f5be303b7/users/66937804f65147f392f4ddfc3e961d5d/roles/4432662371b040ef946fb14e2326f333 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:18:22.575596 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-dd17614e-9c80-4e9a-bcf6-990abad80171 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:22.576876 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-dd17614e-9c80-4e9a-bcf6-990abad80171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:22.660647 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 336/669] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:22 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:18:22.929256 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161e3d7-805b-4153-9f80-f4e9fe37773a None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:22.978402 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:23.035561 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161e3d7-805b-4153-9f80-f4e9fe37773a None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:23.073147 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46e038-e258-4ef6-a1f6-6c23c7cfe4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:23.073764 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46e038-e258-4ef6-a1f6-6c23c7cfe4db None admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:23.074048 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46e038-e258-4ef6-a1f6-6c23c7cfe4db None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:23.074323 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46e038-e258-4ef6-a1f6-6c23c7cfe4db None admin] PATH_INFO: `/v3/services` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:23.074976 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46e038-e258-4ef6-a1f6-6c23c7cfe4db None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:23.076331 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46e038-e258-4ef6-a1f6-6c23c7cfe4db None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:23.100733 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 334/670] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Nov 2 20:18:22 2022] POST /identity/v3/services => generated 251 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:18:23.239696 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d016d26-0bcd-414c-8415-85806b7c2013 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:23.239893 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d016d26-0bcd-414c-8415-85806b7c2013 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:23.240227 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d016d26-0bcd-414c-8415-85806b7c2013 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:23.241868 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 337/671] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:23.247822 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951f08d-bf17-4f8a-9094-197715d1c82f None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:23.248104 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951f08d-bf17-4f8a-9094-197715d1c82f None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:23.248379 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951f08d-bf17-4f8a-9094-197715d1c82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:23.269830 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-b951f08d-bf17-4f8a-9094-197715d1c82f None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:23.269830 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-b951f08d-bf17-4f8a-9094-197715d1c82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:23.346220 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 335/672] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:23 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:18:23.530576 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbf0ba-10e9-4fdc-b257-7eed33e24a54 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:23.530864 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbf0ba-10e9-4fdc-b257-7eed33e24a54 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:23.531147 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbf0ba-10e9-4fdc-b257-7eed33e24a54 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:23.532778 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 338/673] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:23.538014 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea28aa4-df57-4503-a1de-13f57aed6ab0 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:23.538438 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea28aa4-df57-4503-a1de-13f57aed6ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:23.538571 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea28aa4-df57-4503-a1de-13f57aed6ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:23.557359 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-4ea28aa4-df57-4503-a1de-13f57aed6ab0 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:23.558801 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-4ea28aa4-df57-4503-a1de-13f57aed6ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:23.584103 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:23.627399 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbf0ba-10e9-4fdc-b257-7eed33e24a54 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:23.627922 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 336/674] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:23 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:18:23.685706 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:23.731205 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbf0ba-10e9-4fdc-b257-7eed33e24a54 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:23.765676 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718dede-9518-470c-8a2c-1b4fbb1dab5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:23.766278 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718dede-9518-470c-8a2c-1b4fbb1dab5b None admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:23.766556 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718dede-9518-470c-8a2c-1b4fbb1dab5b None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:23.766830 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718dede-9518-470c-8a2c-1b4fbb1dab5b None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:23.767483 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8718dede-9518-470c-8a2c-1b4fbb1dab5b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:23.768878 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8718dede-9518-470c-8a2c-1b4fbb1dab5b None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:23.785443 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 339/675] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Nov 2 20:18:23 2022] POST /identity/v3/services => generated 241 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:18:23.905795 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea28aa4-df57-4503-a1de-13f57aed6ab0 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:24.014282 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea28aa4-df57-4503-a1de-13f57aed6ab0 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:24.054474 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964db3f-1976-478a-b1e9-55816333c9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:24.055601 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964db3f-1976-478a-b1e9-55816333c9df None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:24.055885 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964db3f-1976-478a-b1e9-55816333c9df None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:24.056157 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964db3f-1976-478a-b1e9-55816333c9df None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:24.056845 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964db3f-1976-478a-b1e9-55816333c9df None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:24.058467 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964db3f-1976-478a-b1e9-55816333c9df None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:24.067921 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-1964db3f-1976-478a-b1e9-55816333c9df None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 20:18:24.067921 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:24.067921 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 20:18:24.067921 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 20:18:24.067921 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 20:18:24.067921 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 20:18:24.067921 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 20:18:24.067921 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:24.067921 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 20:18:24.067921 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:24.067921 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 20:18:24.067921 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:24.067921 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:24.067921 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:24.067921 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:24.067921 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:24.068973 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:24.068973 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:24.068973 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:24.068973 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:24.068973 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:24.068973 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:24.068973 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:24.068973 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 20:18:24.068973 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 20:18:24.068973 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 20:18:24.068973 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 20:18:24.068973 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:24.068973 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:24.068973 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:24.068973 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:24.068973 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:24.068973 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:24.069843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:24.069843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:24.069843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:24.069843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:24.069843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:24.069843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:24.069843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:24.069843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:24.069843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:24.069843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:24.069843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 20:18:24.069843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:24.069843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 20:18:24.069843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:24.069843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 337/676] 10.222.0.23 () {56 vars in 1132 bytes} [Wed Nov 2 20:18:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:24.075791 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718dede-9518-470c-8a2c-1b4fbb1dab5b None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:24.177257 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718dede-9518-470c-8a2c-1b4fbb1dab5b None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:24.191555 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:24.212535 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b31c7-7056-4150-b2ba-756393aea5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:24.213222 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b31c7-7056-4150-b2ba-756393aea5f3 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:24.213509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b31c7-7056-4150-b2ba-756393aea5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:24.213784 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b31c7-7056-4150-b2ba-756393aea5f3 None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:24.214418 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b31c7-7056-4150-b2ba-756393aea5f3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:24.214724 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b31c7-7056-4150-b2ba-756393aea5f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:24.216084 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b31c7-7056-4150-b2ba-756393aea5f3 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:24.221188 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 340/677] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Nov 2 20:18:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:24.227442 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964db3f-1976-478a-b1e9-55816333c9df None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:24.253344 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:24.333600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964db3f-1976-478a-b1e9-55816333c9df None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:24.368951 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e21b0-8925-4d22-9a3a-df28d8b90d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:24.369927 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e21b0-8925-4d22-9a3a-df28d8b90d75 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:24.370452 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e21b0-8925-4d22-9a3a-df28d8b90d75 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:24.370933 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e21b0-8925-4d22-9a3a-df28d8b90d75 None admin] PATH_INFO: `/v3/services` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:24.371764 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e21b0-8925-4d22-9a3a-df28d8b90d75 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:24.372286 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e21b0-8925-4d22-9a3a-df28d8b90d75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:24.373879 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e21b0-8925-4d22-9a3a-df28d8b90d75 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:24.379369 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 338/678] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Nov 2 20:18:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:24.384831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b31c7-7056-4150-b2ba-756393aea5f3 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:24.490915 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b31c7-7056-4150-b2ba-756393aea5f3 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:24.537604 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57649fb0-65a0-4e67-9cde-13f54d0c2ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:24.538494 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57649fb0-65a0-4e67-9cde-13f54d0c2ef5 None admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:24.538941 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57649fb0-65a0-4e67-9cde-13f54d0c2ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:24.539901 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57649fb0-65a0-4e67-9cde-13f54d0c2ef5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:24.540781 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57649fb0-65a0-4e67-9cde-13f54d0c2ef5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:24.542308 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57649fb0-65a0-4e67-9cde-13f54d0c2ef5 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:24.565089 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 341/679] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:18:24 2022] POST /identity/v3/endpoints => generated 347 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:18:24.875534 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf10e9-1fe0-496f-ab53-307a14875e01 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:24.876067 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf10e9-1fe0-496f-ab53-307a14875e01 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:24.876067 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf10e9-1fe0-496f-ab53-307a14875e01 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:24.877649 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 339/680] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:24.883488 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3600e-145f-4af0-8bec-c661f794b727 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:24.883889 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3600e-145f-4af0-8bec-c661f794b727 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:24.884035 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3600e-145f-4af0-8bec-c661f794b727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:24.903242 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-32d3600e-145f-4af0-8bec-c661f794b727 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:24.904413 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-32d3600e-145f-4af0-8bec-c661f794b727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:24.932681 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:24.981662 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 342/681] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:18:25.253912 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf10e9-1fe0-496f-ab53-307a14875e01 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:25.347631 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:25.369234 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf10e9-1fe0-496f-ab53-307a14875e01 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:25.404054 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d710b-b68a-4e5a-b9de-93fc4f6d9ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:25.405110 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d710b-b68a-4e5a-b9de-93fc4f6d9ce4 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:25.405592 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d710b-b68a-4e5a-b9de-93fc4f6d9ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:25.406111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d710b-b68a-4e5a-b9de-93fc4f6d9ce4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:25.417750 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d710b-b68a-4e5a-b9de-93fc4f6d9ce4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:18:25.422680 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-9e5d710b-b68a-4e5a-b9de-93fc4f6d9ce4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 20:18:25.422680 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:25.422680 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:25.422680 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:25.422680 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:25.422680 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:25.422680 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:25.422680 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:25.422680 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:25.422680 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:25.422680 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:25.422680 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:25.422680 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:18:25.422680 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:18:25.422680 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:18:25.422680 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:18:25.423608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:18:25.423608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:18:25.423608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:18:25.423608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:18:25.423608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:25.423608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:25.423608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:25.423608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:25.423608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:25.423608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:25.423608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:25.423608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:25.423608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:25.423608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:25.423608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:25.423608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:25.424471 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:25.424471 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:25.424471 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:25.424471 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:25.424471 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:18:25.424471 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:18:25.424471 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:18:25.424471 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:18:25.424471 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:18:25.424471 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:18:25.424471 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 20:18:25.424471 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:25.427087 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 340/682] 10.222.0.23 () {56 vars in 1120 bytes} [Wed Nov 2 20:18:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:25.433764 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3600e-145f-4af0-8bec-c661f794b727 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:25.437784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9d497-30db-436a-8553-b67a49db188e None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:25.437784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9d497-30db-436a-8553-b67a49db188e None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:25.437784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9d497-30db-436a-8553-b67a49db188e None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:25.439170 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 341/683] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:25.446281 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7960b09-e31b-4d07-b264-8a74d5b857c2 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:25.446752 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7960b09-e31b-4d07-b264-8a74d5b857c2 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:25.447036 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7960b09-e31b-4d07-b264-8a74d5b857c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:25.466834 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-b7960b09-e31b-4d07-b264-8a74d5b857c2 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:25.468203 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-b7960b09-e31b-4d07-b264-8a74d5b857c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:25.549002 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 342/684] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 20:18:25.554718 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3600e-145f-4af0-8bec-c661f794b727 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:25.589928 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84610443-fb66-43a1-9b57-4aef59114070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:25.590801 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84610443-fb66-43a1-9b57-4aef59114070 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:25.591265 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84610443-fb66-43a1-9b57-4aef59114070 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:25.591736 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84610443-fb66-43a1-9b57-4aef59114070 None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:25.592593 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84610443-fb66-43a1-9b57-4aef59114070 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:25.593120 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84610443-fb66-43a1-9b57-4aef59114070 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:25.594706 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84610443-fb66-43a1-9b57-4aef59114070 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:25.603970 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 343/685] 10.222.0.23 () {56 vars in 1115 bytes} [Wed Nov 2 20:18:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:25.609449 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7960b09-e31b-4d07-b264-8a74d5b857c2 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:25.692665 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:25.717275 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7960b09-e31b-4d07-b264-8a74d5b857c2 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:25.752416 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2354d90-7c7f-404b-96e8-5feec68f542f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:25.753080 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2354d90-7c7f-404b-96e8-5feec68f542f None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:25.753366 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2354d90-7c7f-404b-96e8-5feec68f542f None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:25.753643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2354d90-7c7f-404b-96e8-5feec68f542f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:25.763959 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2354d90-7c7f-404b-96e8-5feec68f542f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:25.765499 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2354d90-7c7f-404b-96e8-5feec68f542f None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:25.780993 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-a2354d90-7c7f-404b-96e8-5feec68f542f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:25.780993 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:25.780993 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:25.780993 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:25.780993 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:25.780993 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:25.780993 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:25.780993 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:25.780993 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:25.780993 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:25.780993 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:25.780993 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:25.780993 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:18:25.780993 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:18:25.780993 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:18:25.780993 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:18:25.781937 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:25.781937 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:25.781937 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:25.781937 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:25.781937 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:25.781937 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:25.781937 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:25.781937 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:25.781937 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:25.781937 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:25.781937 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:25.781937 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:25.781937 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:25.781937 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:25.781937 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:25.781937 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:25.781937 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:18:25.782815 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:18:25.782815 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:25.782815 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:25.782815 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 343/686] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:18:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 20:18:25.788029 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84610443-fb66-43a1-9b57-4aef59114070 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:25.818320 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:25.856883 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2354d90-7c7f-404b-96e8-5feec68f542f None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:25.912203 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84610443-fb66-43a1-9b57-4aef59114070 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:25.956290 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d9c24-5905-4709-bf21-877787594d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:25.957519 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d9c24-5905-4709-bf21-877787594d1f None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:25.957988 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d9c24-5905-4709-bf21-877787594d1f None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:25.958561 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d9c24-5905-4709-bf21-877787594d1f None admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:25.959677 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d9c24-5905-4709-bf21-877787594d1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:25.960137 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d9c24-5905-4709-bf21-877787594d1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:25.962219 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d9c24-5905-4709-bf21-877787594d1f None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:25.977003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2354d90-7c7f-404b-96e8-5feec68f542f None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:25.983536 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 344/687] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:25.985044 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d9c24-5905-4709-bf21-877787594d1f None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:26.016234 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:26.027425 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f058bfb-ac85-40c3-bc00-e6c295efdecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:26.028059 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f058bfb-ac85-40c3-bc00-e6c295efdecd None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:26.028338 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f058bfb-ac85-40c3-bc00-e6c295efdecd None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:26.028670 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f058bfb-ac85-40c3-bc00-e6c295efdecd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:26.029382 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f058bfb-ac85-40c3-bc00-e6c295efdecd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:26.031439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f058bfb-ac85-40c3-bc00-e6c295efdecd None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:26.042105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-1f058bfb-ac85-40c3-bc00-e6c295efdecd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 20:18:26.042105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:26.042105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 20:18:26.042105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 20:18:26.042105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 20:18:26.042105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 20:18:26.042105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 20:18:26.042105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:26.042105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 20:18:26.042105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:26.042105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 20:18:26.042105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:26.042105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:26.042105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:26.042105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:26.042105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:26.042105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:26.043094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:26.043094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:26.043094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:26.043094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:26.043094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:26.043094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:26.043094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 20:18:26.043094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 20:18:26.043094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 20:18:26.043094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 20:18:26.043094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:26.043094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:26.043094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:26.043094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:26.043094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:26.043094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:26.043916 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:26.043916 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:26.043916 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:26.043916 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:26.043916 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:26.043916 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:26.043916 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:26.043916 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:26.043916 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:26.043916 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:26.043916 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 20:18:26.043916 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:26.043916 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 20:18:26.043916 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:26.043916 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 344/688] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Nov 2 20:18:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 20:18:26.050292 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f058bfb-ac85-40c3-bc00-e6c295efdecd None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:26.089724 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:26.110440 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d9c24-5905-4709-bf21-877787594d1f None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:26.147619 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e13cf4-b13e-4153-9e0a-fd8c41c9f2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:26.148251 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e13cf4-b13e-4153-9e0a-fd8c41c9f2df None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:26.148664 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e13cf4-b13e-4153-9e0a-fd8c41c9f2df None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:26.148954 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e13cf4-b13e-4153-9e0a-fd8c41c9f2df None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:26.156587 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e13cf4-b13e-4153-9e0a-fd8c41c9f2df None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:26.158375 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e13cf4-b13e-4153-9e0a-fd8c41c9f2df None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:26.160694 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f058bfb-ac85-40c3-bc00-e6c295efdecd None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:26.170935 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-46e13cf4-b13e-4153-9e0a-fd8c41c9f2df None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 20:18:26.170935 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:26.170935 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:26.170935 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:26.170935 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:26.170935 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:26.170935 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:26.170935 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:26.170935 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:26.170935 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:26.170935 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:26.170935 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:26.170935 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 20:18:26.170935 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 20:18:26.170935 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 20:18:26.170935 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 20:18:26.171881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:26.171881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:26.171881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 20:18:26.171881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:18:26.171881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 20:18:26.171881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:18:26.171881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:26.171881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:26.171881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:26.171881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:26.171881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:26.171881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:26.171881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:26.171881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:26.171881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:26.171881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:26.171881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:26.171881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:26.173459 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:26.173459 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:26.173459 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 20:18:26.173459 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 20:18:26.173459 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 20:18:26.173459 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 20:18:26.173459 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 20:18:26.173459 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 20:18:26.173459 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 20:18:26.173459 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:26.173459 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 345/689] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Nov 2 20:18:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:26.173459 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a369622-4008-4d27-b3e7-52285f0e666c None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:26.174108 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a369622-4008-4d27-b3e7-52285f0e666c None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:26.174108 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a369622-4008-4d27-b3e7-52285f0e666c None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:26.176577 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 346/690] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:26.178985 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a369622-4008-4d27-b3e7-52285f0e666c None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:26.205833 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1cd83-01e0-45ee-9b16-f6e527e13d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:26.206741 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1cd83-01e0-45ee-9b16-f6e527e13d7c None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:26.207174 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1cd83-01e0-45ee-9b16-f6e527e13d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:26.207602 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1cd83-01e0-45ee-9b16-f6e527e13d7c None admin] PATH_INFO: `/v3/services` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:26.208266 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1cd83-01e0-45ee-9b16-f6e527e13d7c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:26.208602 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1cd83-01e0-45ee-9b16-f6e527e13d7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:26.210007 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1cd83-01e0-45ee-9b16-f6e527e13d7c None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:26.219517 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 345/691] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Nov 2 20:18:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:18:26.219517 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ba6ac-e41e-40ea-bb57-86ac0e134373 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:26.219517 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ba6ac-e41e-40ea-bb57-86ac0e134373 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:26.219517 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ba6ac-e41e-40ea-bb57-86ac0e134373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:26.235322 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-a48ba6ac-e41e-40ea-bb57-86ac0e134373 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:26.236507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-a48ba6ac-e41e-40ea-bb57-86ac0e134373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:26.288149 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a369622-4008-4d27-b3e7-52285f0e666c None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:26.288328 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:26.307397 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 346/692] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:18:26.308851 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ba6ac-e41e-40ea-bb57-86ac0e134373 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:26.335348 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc803024-6b53-4059-96b4-c52d3b0a25c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:26.335957 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc803024-6b53-4059-96b4-c52d3b0a25c7 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:26.336859 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc803024-6b53-4059-96b4-c52d3b0a25c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:26.337136 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc803024-6b53-4059-96b4-c52d3b0a25c7 None admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:26.338136 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc803024-6b53-4059-96b4-c52d3b0a25c7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:26.338447 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc803024-6b53-4059-96b4-c52d3b0a25c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:26.340288 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc803024-6b53-4059-96b4-c52d3b0a25c7 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:26.360078 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:26.369294 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 347/693] 10.222.0.23 () {56 vars in 1149 bytes} [Wed Nov 2 20:18:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:18:26.372506 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc803024-6b53-4059-96b4-c52d3b0a25c7 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:26.444297 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ba6ac-e41e-40ea-bb57-86ac0e134373 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:26.478390 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc803024-6b53-4059-96b4-c52d3b0a25c7 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:26.489090 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ea53d-454d-49c8-9f5d-3bfe2515ae2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:26.490376 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ea53d-454d-49c8-9f5d-3bfe2515ae2e None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:26.491066 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ea53d-454d-49c8-9f5d-3bfe2515ae2e None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:26.491520 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ea53d-454d-49c8-9f5d-3bfe2515ae2e None admin] PATH_INFO: `/v3/services` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:26.492459 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ea53d-454d-49c8-9f5d-3bfe2515ae2e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:26.492932 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ea53d-454d-49c8-9f5d-3bfe2515ae2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:26.494571 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ea53d-454d-49c8-9f5d-3bfe2515ae2e None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:26.501334 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 347/694] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Nov 2 20:18:26 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:26.506802 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ea53d-454d-49c8-9f5d-3bfe2515ae2e None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:26.521616 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be62427-a378-4453-a27d-28db40f40682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:26.522670 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be62427-a378-4453-a27d-28db40f40682 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:26.524065 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be62427-a378-4453-a27d-28db40f40682 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:26.524496 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be62427-a378-4453-a27d-28db40f40682 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:26.560684 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:26.599685 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:26.602620 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be62427-a378-4453-a27d-28db40f40682 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:26.604281 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be62427-a378-4453-a27d-28db40f40682 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:26.613093 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ea53d-454d-49c8-9f5d-3bfe2515ae2e None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:26.654955 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ae4ee-6d12-4bbd-ad95-bdea02f250ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:26.655582 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ae4ee-6d12-4bbd-ad95-bdea02f250ed None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:26.655866 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ae4ee-6d12-4bbd-ad95-bdea02f250ed None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:26.656142 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ae4ee-6d12-4bbd-ad95-bdea02f250ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:26.656888 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ae4ee-6d12-4bbd-ad95-bdea02f250ed None admin] RBAC: Adding query filter params (interface=public, service_id=fa32891a239c4b6d9c98a620cd1dfb4e, region_id=RegionOne) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:26.657321 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ae4ee-6d12-4bbd-ad95-bdea02f250ed None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:26.658840 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ae4ee-6d12-4bbd-ad95-bdea02f250ed None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:26.665561 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 348/695] 10.222.0.23 () {56 vars in 1251 bytes} [Wed Nov 2 20:18:26 2022] GET /identity/v3/endpoints?service_id=fa32891a239c4b6d9c98a620cd1dfb4e&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:18:26.671348 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ae4ee-6d12-4bbd-ad95-bdea02f250ed None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:26.714111 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 348/696] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Nov 2 20:18:26 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 20:18:26.714111 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be62427-a378-4453-a27d-28db40f40682 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:26.776950 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ae4ee-6d12-4bbd-ad95-bdea02f250ed None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:26.791517 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:26.808481 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:26.811515 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be62427-a378-4453-a27d-28db40f40682 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:26.812272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37132bc-6815-4d93-ba59-7e5052ca3ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:26.812933 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37132bc-6815-4d93-ba59-7e5052ca3ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:26.813215 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37132bc-6815-4d93-ba59-7e5052ca3ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:26.813494 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37132bc-6815-4d93-ba59-7e5052ca3ab8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:26.814072 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37132bc-6815-4d93-ba59-7e5052ca3ab8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:26.815436 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37132bc-6815-4d93-ba59-7e5052ca3ab8 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:26.823968 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-e37132bc-6815-4d93-ba59-7e5052ca3ab8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 20:18:26.823968 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:26.823968 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 20:18:26.823968 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 20:18:26.823968 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 20:18:26.823968 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 20:18:26.823968 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 20:18:26.823968 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:26.823968 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 20:18:26.823968 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:26.823968 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 20:18:26.823968 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:26.823968 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:26.823968 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:26.823968 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:26.823968 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:26.823968 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:26.825067 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:26.825067 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:26.825067 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:26.825067 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:26.825067 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:26.825067 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:26.825067 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 20:18:26.825067 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 20:18:26.825067 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 20:18:26.825067 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 20:18:26.825067 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:26.825067 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:26.825067 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:26.825067 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:26.825067 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:26.825067 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:26.826317 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:26.826317 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:26.826317 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:26.826317 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:26.826317 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:26.826317 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:26.826317 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:26.826317 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:26.826317 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:26.826317 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:26.826317 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 20:18:26.826317 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:26.826317 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 20:18:26.826317 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:26.826317 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 349/697] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Nov 2 20:18:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:26.827118 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37132bc-6815-4d93-ba59-7e5052ca3ab8 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:26.849585 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826fac7-c4fb-4a56-a621-987f316aef2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:26.850187 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826fac7-c4fb-4a56-a621-987f316aef2f None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:26.850469 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826fac7-c4fb-4a56-a621-987f316aef2f None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:26.850745 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826fac7-c4fb-4a56-a621-987f316aef2f None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:26.851344 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826fac7-c4fb-4a56-a621-987f316aef2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:26.853297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826fac7-c4fb-4a56-a621-987f316aef2f None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:26.859404 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 349/698] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Nov 2 20:18:26 2022] GET /identity/v3/services => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:18:26.860636 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01202744-7e7a-437c-b8fd-0993454b2aa4 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:26.860925 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01202744-7e7a-437c-b8fd-0993454b2aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:26.861204 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01202744-7e7a-437c-b8fd-0993454b2aa4 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:26.862567 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 350/699] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:26.863212 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01202744-7e7a-437c-b8fd-0993454b2aa4 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:26.941395 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37132bc-6815-4d93-ba59-7e5052ca3ab8 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:26.980929 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b70331-d160-4382-8daf-a43f0cc3c4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:26.981620 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b70331-d160-4382-8daf-a43f0cc3c4a2 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:26.981850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b70331-d160-4382-8daf-a43f0cc3c4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:26.982163 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b70331-d160-4382-8daf-a43f0cc3c4a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:26.988585 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01202744-7e7a-437c-b8fd-0993454b2aa4 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:26.994535 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b70331-d160-4382-8daf-a43f0cc3c4a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:26.996035 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b70331-d160-4382-8daf-a43f0cc3c4a2 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:27.011533 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-d3b70331-d160-4382-8daf-a43f0cc3c4a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:27.011533 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:27.011533 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:27.011533 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:27.011533 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:27.011533 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:27.011533 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:27.011533 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:27.011533 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:27.011533 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:27.011533 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:27.011533 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:27.011533 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:18:27.011533 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:18:27.011533 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:18:27.011533 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:18:27.012598 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:27.012598 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:27.012598 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:27.012598 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:27.012598 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:27.012598 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:27.012598 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:27.012598 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:27.012598 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:27.012598 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:27.012598 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:27.012598 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:27.012598 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:27.012598 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:27.012598 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:27.012598 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:27.012598 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:18:27.013545 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:18:27.013545 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:27.013545 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:27.016875 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 350/700] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:18:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:27.018502 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f72f5-5ad8-4c0c-8e5c-b37ddc27dd53 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:27.018794 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f72f5-5ad8-4c0c-8e5c-b37ddc27dd53 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:27.019073 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f72f5-5ad8-4c0c-8e5c-b37ddc27dd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:27.034551 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3225a0-7bb8-430c-ac28-766aba5f9db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:27.035158 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3225a0-7bb8-430c-ac28-766aba5f9db9 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:27.035439 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3225a0-7bb8-430c-ac28-766aba5f9db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:27.035710 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3225a0-7bb8-430c-ac28-766aba5f9db9 None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:27.036343 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3225a0-7bb8-430c-ac28-766aba5f9db9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:27.036987 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3225a0-7bb8-430c-ac28-766aba5f9db9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:27.038038 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3225a0-7bb8-430c-ac28-766aba5f9db9 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:27.043192 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-2a5f72f5-5ad8-4c0c-8e5c-b37ddc27dd53 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:27.043520 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 351/701] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Nov 2 20:18:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:27.044294 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3225a0-7bb8-430c-ac28-766aba5f9db9 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:27.044399 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-2a5f72f5-5ad8-4c0c-8e5c-b37ddc27dd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:27.071583 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:27.075537 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:27.121965 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 351/702] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:18:27.122828 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f72f5-5ad8-4c0c-8e5c-b37ddc27dd53 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:27.167711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3225a0-7bb8-430c-ac28-766aba5f9db9 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:27.216914 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0127bb2-56d9-434f-ace7-b01e30660da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:27.218324 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0127bb2-56d9-434f-ace7-b01e30660da5 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:27.219112 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0127bb2-56d9-434f-ace7-b01e30660da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:27.219596 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0127bb2-56d9-434f-ace7-b01e30660da5 None admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:27.220733 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0127bb2-56d9-434f-ace7-b01e30660da5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:27.221765 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0127bb2-56d9-434f-ace7-b01e30660da5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:27.223915 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0127bb2-56d9-434f-ace7-b01e30660da5 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:27.240497 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 352/703] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:27.245065 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f72f5-5ad8-4c0c-8e5c-b37ddc27dd53 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:27.247494 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0127bb2-56d9-434f-ace7-b01e30660da5 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:27.283085 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8fbbf-5658-448c-b136-c2697b02caef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:27.283951 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8fbbf-5658-448c-b136-c2697b02caef None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:27.284411 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8fbbf-5658-448c-b136-c2697b02caef None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:27.284870 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8fbbf-5658-448c-b136-c2697b02caef None admin] PATH_INFO: `/v3/services` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:27.285647 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8fbbf-5658-448c-b136-c2697b02caef None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:27.286087 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8fbbf-5658-448c-b136-c2697b02caef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:27.287594 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8fbbf-5658-448c-b136-c2697b02caef None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:27.293162 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 352/704] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Nov 2 20:18:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:27.300633 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8fbbf-5658-448c-b136-c2697b02caef None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:27.332888 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:27.361825 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:27.378467 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0127bb2-56d9-434f-ace7-b01e30660da5 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:27.416475 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642ba20-8134-4b65-a492-71f4df827d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:27.417140 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642ba20-8134-4b65-a492-71f4df827d64 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:27.417428 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642ba20-8134-4b65-a492-71f4df827d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:27.417712 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642ba20-8134-4b65-a492-71f4df827d64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:27.419735 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8fbbf-5658-448c-b136-c2697b02caef None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:27.424433 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642ba20-8134-4b65-a492-71f4df827d64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:27.425911 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642ba20-8134-4b65-a492-71f4df827d64 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:27.437714 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-6642ba20-8134-4b65-a492-71f4df827d64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:18:27.437714 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:27.437714 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:27.437714 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:27.437714 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:27.437714 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:27.437714 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:27.437714 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:27.437714 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:27.437714 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:27.437714 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:27.437714 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:27.437714 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 20:18:27.437714 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 20:18:27.437714 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 20:18:27.438592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 20:18:27.438592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:27.438592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:27.438592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:27.438592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:27.438592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:27.438592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:27.438592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:27.438592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:27.438592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:27.438592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:27.438592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:27.438592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:27.438592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:27.438592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:27.438592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:27.438592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:27.439493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 20:18:27.439493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 20:18:27.439493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 20:18:27.439493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 20:18:27.439493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 20:18:27.439493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 20:18:27.439493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:18:27.439493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:27.443602 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 353/705] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:18:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:27.444316 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642ba20-8134-4b65-a492-71f4df827d64 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:27.455240 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658930b1-393a-4c48-9581-0a0dbe43393a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:27.455886 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658930b1-393a-4c48-9581-0a0dbe43393a None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:27.456168 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658930b1-393a-4c48-9581-0a0dbe43393a None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:27.456443 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658930b1-393a-4c48-9581-0a0dbe43393a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:27.457165 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658930b1-393a-4c48-9581-0a0dbe43393a None admin] RBAC: Adding query filter params (interface=public, service_id=2cec8a40cbf14f1c81e0b1944319c783, region_id=RegionOne) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:27.457471 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658930b1-393a-4c48-9581-0a0dbe43393a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:27.458812 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658930b1-393a-4c48-9581-0a0dbe43393a None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:27.464338 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 353/706] 10.222.0.23 () {56 vars in 1251 bytes} [Wed Nov 2 20:18:27 2022] GET /identity/v3/endpoints?service_id=2cec8a40cbf14f1c81e0b1944319c783&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:18:27.465128 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658930b1-393a-4c48-9581-0a0dbe43393a None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:27.556576 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642ba20-8134-4b65-a492-71f4df827d64 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:27.564241 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:27.577079 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658930b1-393a-4c48-9581-0a0dbe43393a None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:27.594752 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d0ff2-34fa-45ac-baa5-8dc161ff466b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:27.595393 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d0ff2-34fa-45ac-baa5-8dc161ff466b None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:27.595677 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d0ff2-34fa-45ac-baa5-8dc161ff466b None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:27.595957 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d0ff2-34fa-45ac-baa5-8dc161ff466b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:27.596568 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d0ff2-34fa-45ac-baa5-8dc161ff466b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:27.597943 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d0ff2-34fa-45ac-baa5-8dc161ff466b None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:27.607281 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-a68d0ff2-34fa-45ac-baa5-8dc161ff466b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 20:18:27.607281 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:27.607281 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 20:18:27.607281 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 20:18:27.607281 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 20:18:27.607281 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 20:18:27.607281 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 20:18:27.607281 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:27.607281 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 20:18:27.607281 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:27.607281 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 20:18:27.607281 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:27.607281 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:27.607281 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:27.607281 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:27.607281 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:27.607281 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:27.608268 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:27.608268 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:27.608268 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:27.608268 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:27.608268 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:27.608268 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:27.608268 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 20:18:27.608268 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 20:18:27.608268 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 20:18:27.608268 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 20:18:27.608268 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:27.608268 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:27.608268 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:27.608268 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:27.608268 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:27.608268 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:27.609153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:27.609153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:27.609153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:27.609153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:27.609153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:27.609153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:27.609153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:27.609153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:27.609153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:27.609153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:27.609153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 20:18:27.609153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:27.609153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 20:18:27.609153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:27.609153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 354/707] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:18:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:27.609959 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d0ff2-34fa-45ac-baa5-8dc161ff466b None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:27.618770 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e7f7b-b243-4d95-bca6-7948cab28738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:27.619799 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e7f7b-b243-4d95-bca6-7948cab28738 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:27.620083 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e7f7b-b243-4d95-bca6-7948cab28738 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:27.620378 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e7f7b-b243-4d95-bca6-7948cab28738 None admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:27.621432 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e7f7b-b243-4d95-bca6-7948cab28738 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:27.621743 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e7f7b-b243-4d95-bca6-7948cab28738 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:27.623480 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e7f7b-b243-4d95-bca6-7948cab28738 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:27.625251 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:27.636579 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 354/708] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Nov 2 20:18:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:27.637326 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e7f7b-b243-4d95-bca6-7948cab28738 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:27.720388 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d0ff2-34fa-45ac-baa5-8dc161ff466b None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:27.745934 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e7f7b-b243-4d95-bca6-7948cab28738 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:27.755783 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33283f9-83aa-46ae-aef7-e34977de31b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:27.756614 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33283f9-83aa-46ae-aef7-e34977de31b2 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:27.757328 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33283f9-83aa-46ae-aef7-e34977de31b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:27.757705 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33283f9-83aa-46ae-aef7-e34977de31b2 None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:27.759176 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33283f9-83aa-46ae-aef7-e34977de31b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:27.760759 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33283f9-83aa-46ae-aef7-e34977de31b2 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:27.767387 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 355/709] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Nov 2 20:18:27 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:18:27.768257 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33283f9-83aa-46ae-aef7-e34977de31b2 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:27.790724 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589254c-0604-4e7a-b2d9-b026778bc978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:27.791777 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589254c-0604-4e7a-b2d9-b026778bc978 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:27.792267 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589254c-0604-4e7a-b2d9-b026778bc978 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:27.793285 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589254c-0604-4e7a-b2d9-b026778bc978 None admin] PATH_INFO: `/v3/services` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:27.794253 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589254c-0604-4e7a-b2d9-b026778bc978 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:27.794888 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589254c-0604-4e7a-b2d9-b026778bc978 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:27.797151 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589254c-0604-4e7a-b2d9-b026778bc978 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:27.805167 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 355/710] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Nov 2 20:18:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:27.810988 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589254c-0604-4e7a-b2d9-b026778bc978 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:27.828250 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:27.880927 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:27.900598 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33283f9-83aa-46ae-aef7-e34977de31b2 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:27.925573 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589254c-0604-4e7a-b2d9-b026778bc978 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:27.940257 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd23de1-0a3e-4ee2-be63-d949dc3024c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:27.941217 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd23de1-0a3e-4ee2-be63-d949dc3024c1 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:27.941693 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd23de1-0a3e-4ee2-be63-d949dc3024c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:27.942153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd23de1-0a3e-4ee2-be63-d949dc3024c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:27.943046 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd23de1-0a3e-4ee2-be63-d949dc3024c1 None admin] RBAC: Adding query filter params (role.id=4432662371b040ef946fb14e2326f333, scope.project.id=a144e65ce44c44dc99c07a7f5be303b7, user.id=66937804f65147f392f4ddfc3e961d5d) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:27.943554 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd23de1-0a3e-4ee2-be63-d949dc3024c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:27.945237 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd23de1-0a3e-4ee2-be63-d949dc3024c1 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:27.951904 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 356/711] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Nov 2 20:18:27 2022] GET /identity/v3/role_assignments?user.id=66937804f65147f392f4ddfc3e961d5d&scope.project.id=a144e65ce44c44dc99c07a7f5be303b7&role.id=4432662371b040ef946fb14e2326f333 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:27.968441 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab2d91-45b0-4b77-ad85-cdab15031e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:27.969109 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab2d91-45b0-4b77-ad85-cdab15031e2b None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:27.969388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab2d91-45b0-4b77-ad85-cdab15031e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:27.969665 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab2d91-45b0-4b77-ad85-cdab15031e2b None admin] PATH_INFO: `/v3/services` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:27.970347 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab2d91-45b0-4b77-ad85-cdab15031e2b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:27.970654 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab2d91-45b0-4b77-ad85-cdab15031e2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:27.972073 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab2d91-45b0-4b77-ad85-cdab15031e2b None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:27.977783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 356/712] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Nov 2 20:18:27 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:18:29.061460 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a608e-31ce-4087-90f5-39984c6b96c8 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:29.062009 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a608e-31ce-4087-90f5-39984c6b96c8 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:29.062009 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a608e-31ce-4087-90f5-39984c6b96c8 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:29.063900 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 357/713] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:29.069360 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76163003-0e92-499e-8bb2-a1999c728bf9 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:29.069741 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76163003-0e92-499e-8bb2-a1999c728bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:29.069904 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76163003-0e92-499e-8bb2-a1999c728bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:29.089407 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-76163003-0e92-499e-8bb2-a1999c728bf9 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:29.090581 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-76163003-0e92-499e-8bb2-a1999c728bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:29.164747 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 357/714] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:18:29.431950 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a608e-31ce-4087-90f5-39984c6b96c8 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:29.549153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a608e-31ce-4087-90f5-39984c6b96c8 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:29.585167 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15a17b-8933-447a-914b-5b1dcfb8af6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:29.586696 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15a17b-8933-447a-914b-5b1dcfb8af6b None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:29.587175 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15a17b-8933-447a-914b-5b1dcfb8af6b None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:29.587641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15a17b-8933-447a-914b-5b1dcfb8af6b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:29.588445 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15a17b-8933-447a-914b-5b1dcfb8af6b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:29.590022 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15a17b-8933-447a-914b-5b1dcfb8af6b None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:29.599112 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-7a15a17b-8933-447a-914b-5b1dcfb8af6b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 20:18:29.599112 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:29.599112 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 20:18:29.599112 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 20:18:29.599112 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 20:18:29.599112 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 20:18:29.599112 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 20:18:29.599112 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:29.599112 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 20:18:29.599112 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:29.599112 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 20:18:29.599112 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:29.599112 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:29.599112 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:29.599112 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:29.599112 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:29.599112 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:29.600066 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:29.600066 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:29.600066 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:29.600066 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:29.600066 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:29.600066 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:29.600066 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 20:18:29.600066 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 20:18:29.600066 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 20:18:29.600066 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 20:18:29.600066 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:29.600066 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:29.600066 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:29.600066 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:29.600066 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:29.600066 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:29.600915 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:29.600915 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:29.600915 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:29.600915 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:29.600915 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:29.600915 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:29.600915 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:29.600915 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:29.600915 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:29.600915 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:29.600915 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 20:18:29.600915 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:29.600915 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 20:18:29.600915 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:29.603600 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 358/715] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Nov 2 20:18:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:29.609393 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76163003-0e92-499e-8bb2-a1999c728bf9 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:29.618814 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:29.718192 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76163003-0e92-499e-8bb2-a1999c728bf9 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:29.754195 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a504a55-0d1c-43db-b89b-b1f33016dff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:29.755163 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a504a55-0d1c-43db-b89b-b1f33016dff8 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:29.755659 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a504a55-0d1c-43db-b89b-b1f33016dff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:29.756124 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a504a55-0d1c-43db-b89b-b1f33016dff8 None admin] PATH_INFO: `/v3/services` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:29.756997 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a504a55-0d1c-43db-b89b-b1f33016dff8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:29.757515 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a504a55-0d1c-43db-b89b-b1f33016dff8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:29.759138 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a504a55-0d1c-43db-b89b-b1f33016dff8 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:29.764610 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 358/716] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Nov 2 20:18:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:29.770067 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15a17b-8933-447a-914b-5b1dcfb8af6b None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:29.776242 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:29.887946 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15a17b-8933-447a-914b-5b1dcfb8af6b None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:29.923556 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598cde92-7925-4ff0-bd07-a3f518d4f895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:29.924166 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cde92-7925-4ff0-bd07-a3f518d4f895 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:29.924445 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cde92-7925-4ff0-bd07-a3f518d4f895 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:29.924748 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cde92-7925-4ff0-bd07-a3f518d4f895 None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:29.925377 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598cde92-7925-4ff0-bd07-a3f518d4f895 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:29.925679 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598cde92-7925-4ff0-bd07-a3f518d4f895 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:29.927044 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598cde92-7925-4ff0-bd07-a3f518d4f895 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:29.932822 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 359/717] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Nov 2 20:18:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:29.938849 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a504a55-0d1c-43db-b89b-b1f33016dff8 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:29.988771 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb4566-cb77-42f2-9ae6-7d324eb390f2 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:29.989074 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb4566-cb77-42f2-9ae6-7d324eb390f2 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:29.989237 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb4566-cb77-42f2-9ae6-7d324eb390f2 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:29.991441 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 360/718] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:29.997023 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9effcfb-c908-4bf1-b533-b3b1e4ef63b5 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:29.997308 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9effcfb-c908-4bf1-b533-b3b1e4ef63b5 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:29.997586 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9effcfb-c908-4bf1-b533-b3b1e4ef63b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:30.015560 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-f9effcfb-c908-4bf1-b533-b3b1e4ef63b5 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:30.016841 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-f9effcfb-c908-4bf1-b533-b3b1e4ef63b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:30.016955 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:30.050525 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a504a55-0d1c-43db-b89b-b1f33016dff8 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:30.087677 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:30.091699 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d67df-30b0-475c-a2aa-79bad90c6f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:30.092436 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d67df-30b0-475c-a2aa-79bad90c6f2e None admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:30.092793 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d67df-30b0-475c-a2aa-79bad90c6f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:30.093141 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d67df-30b0-475c-a2aa-79bad90c6f2e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:30.094597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d67df-30b0-475c-a2aa-79bad90c6f2e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:30.096045 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d67df-30b0-475c-a2aa-79bad90c6f2e None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:30.100886 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 361/719] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 20:18:30.120870 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 359/720] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:18:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:18:30.172979 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd435bb-9c4b-4054-b2d4-9bb88f04a327 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:30.173388 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd435bb-9c4b-4054-b2d4-9bb88f04a327 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:30.173519 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd435bb-9c4b-4054-b2d4-9bb88f04a327 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:30.174888 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 362/721] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:30.181828 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1e85b-9431-4e1c-8a0e-bda15b2b96d5 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:30.182181 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1e85b-9431-4e1c-8a0e-bda15b2b96d5 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:30.182376 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1e85b-9431-4e1c-8a0e-bda15b2b96d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:30.202236 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-dfa1e85b-9431-4e1c-8a0e-bda15b2b96d5 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:30.203453 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-dfa1e85b-9431-4e1c-8a0e-bda15b2b96d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:30.258594 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3cead-12b9-4de8-8d88-ae0d50acd5e4 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:30.258769 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3cead-12b9-4de8-8d88-ae0d50acd5e4 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:30.259120 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3cead-12b9-4de8-8d88-ae0d50acd5e4 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:30.260938 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 363/722] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:30.266536 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c818fce-7426-4957-9992-a8019d150f51 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:30.266828 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c818fce-7426-4957-9992-a8019d150f51 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:30.267106 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c818fce-7426-4957-9992-a8019d150f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:30.285208 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 360/723] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:18:30.289773 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-8c818fce-7426-4957-9992-a8019d150f51 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:30.291039 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-8c818fce-7426-4957-9992-a8019d150f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:30.364099 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 364/724] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 20:18:30.387740 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1e85b-9431-4e1c-8a0e-bda15b2b96d5 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:30.444413 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:30.492785 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1e85b-9431-4e1c-8a0e-bda15b2b96d5 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:30.536947 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b9304-e891-42f6-bc16-3da4b552d52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:30.537582 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b9304-e891-42f6-bc16-3da4b552d52a None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:30.537864 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b9304-e891-42f6-bc16-3da4b552d52a None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:30.538136 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b9304-e891-42f6-bc16-3da4b552d52a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:30.538720 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b9304-e891-42f6-bc16-3da4b552d52a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:30.540683 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b9304-e891-42f6-bc16-3da4b552d52a None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:30.549558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-7f8b9304-e891-42f6-bc16-3da4b552d52a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 20:18:30.549558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:30.549558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 20:18:30.549558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 20:18:30.549558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 20:18:30.549558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 20:18:30.549558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 20:18:30.549558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:30.549558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 20:18:30.549558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:30.549558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 20:18:30.549558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:30.549558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:30.549558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:30.549558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:30.549558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:30.549558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:30.550540 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:30.550540 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:30.550540 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:30.550540 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:30.550540 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:30.550540 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:30.550540 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 20:18:30.550540 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 20:18:30.550540 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 20:18:30.550540 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 20:18:30.550540 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:30.550540 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:30.550540 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:30.550540 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:30.550540 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:30.550540 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:30.551755 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:30.551755 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:30.551755 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:30.551755 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:30.551755 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:30.551755 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:30.551755 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:30.551755 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:30.551755 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:30.551755 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:30.551755 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 20:18:30.551755 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:30.551755 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 20:18:30.551755 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:30.551755 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 361/725] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Nov 2 20:18:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:30.557654 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c818fce-7426-4957-9992-a8019d150f51 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:30.583628 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b9304-e891-42f6-bc16-3da4b552d52a None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:30.675257 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c818fce-7426-4957-9992-a8019d150f51 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:30.704103 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b9304-e891-42f6-bc16-3da4b552d52a None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:30.707936 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:30.717049 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86646cb-3a62-44fa-a8c8-f20a05ca85e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:30.717664 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86646cb-3a62-44fa-a8c8-f20a05ca85e7 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:30.717949 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86646cb-3a62-44fa-a8c8-f20a05ca85e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:30.718469 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86646cb-3a62-44fa-a8c8-f20a05ca85e7 None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:30.718947 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86646cb-3a62-44fa-a8c8-f20a05ca85e7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:30.719261 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86646cb-3a62-44fa-a8c8-f20a05ca85e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:30.720656 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86646cb-3a62-44fa-a8c8-f20a05ca85e7 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:30.721261 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:30.725726 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 365/726] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Nov 2 20:18:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:30.728742 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86646cb-3a62-44fa-a8c8-f20a05ca85e7 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:30.745837 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d855693-3fd7-4f1f-930b-f88571a3815b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:30.746481 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d855693-3fd7-4f1f-930b-f88571a3815b None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:30.746767 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d855693-3fd7-4f1f-930b-f88571a3815b None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:30.747046 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d855693-3fd7-4f1f-930b-f88571a3815b None admin] PATH_INFO: `/v3/services/image` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:30.747631 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d855693-3fd7-4f1f-930b-f88571a3815b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:30.749023 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d855693-3fd7-4f1f-930b-f88571a3815b None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:30.757746 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-4d855693-3fd7-4f1f-930b-f88571a3815b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 20:18:30.757746 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:30.757746 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 20:18:30.757746 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 20:18:30.757746 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 20:18:30.757746 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 20:18:30.757746 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 20:18:30.757746 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:30.757746 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 20:18:30.757746 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:30.757746 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 20:18:30.757746 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:30.757746 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:30.757746 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:30.757746 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:30.757746 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:30.757746 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:30.759329 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:30.759329 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:30.759329 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:30.759329 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:30.759329 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:30.759329 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:30.759329 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 20:18:30.759329 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 20:18:30.759329 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 20:18:30.759329 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 20:18:30.759329 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:30.759329 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:30.759329 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:30.759329 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:30.759329 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:30.759329 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:30.760176 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:30.760176 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:30.760176 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:30.760176 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:30.760176 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:30.760176 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:30.760176 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:30.760176 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:30.760176 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:30.760176 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:30.760176 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 20:18:30.760176 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:30.760176 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 20:18:30.760176 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:30.760176 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 362/727] 10.222.0.23 () {56 vars in 1105 bytes} [Wed Nov 2 20:18:30 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:30.761673 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d855693-3fd7-4f1f-930b-f88571a3815b None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:30.839575 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86646cb-3a62-44fa-a8c8-f20a05ca85e7 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:30.869304 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d855693-3fd7-4f1f-930b-f88571a3815b None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:30.876094 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e22410-efb3-4a37-b4cf-e041385c1e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:30.876976 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e22410-efb3-4a37-b4cf-e041385c1e26 None admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:30.876976 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e22410-efb3-4a37-b4cf-e041385c1e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:30.877270 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e22410-efb3-4a37-b4cf-e041385c1e26 None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:30.877917 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e22410-efb3-4a37-b4cf-e041385c1e26 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:30.879392 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e22410-efb3-4a37-b4cf-e041385c1e26 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:30.895237 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 366/728] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Nov 2 20:18:30 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:18:30.896462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e22410-efb3-4a37-b4cf-e041385c1e26 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:30.924699 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b75306-20de-4c60-95d8-65da329523cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:30.925816 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b75306-20de-4c60-95d8-65da329523cc None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:30.926166 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b75306-20de-4c60-95d8-65da329523cc None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:30.926541 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b75306-20de-4c60-95d8-65da329523cc None admin] PATH_INFO: `/v3/services` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:30.927795 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b75306-20de-4c60-95d8-65da329523cc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:30.928243 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b75306-20de-4c60-95d8-65da329523cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:30.930313 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b75306-20de-4c60-95d8-65da329523cc None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:30.940783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 363/729] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Nov 2 20:18:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:30.944297 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b75306-20de-4c60-95d8-65da329523cc None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:30.975932 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:31.012955 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:31.034167 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e22410-efb3-4a37-b4cf-e041385c1e26 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:31.059914 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b75306-20de-4c60-95d8-65da329523cc None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:31.075686 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2d995-9a92-44d7-bac1-733c8eca9dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:31.076724 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2d995-9a92-44d7-bac1-733c8eca9dac None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:31.077207 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2d995-9a92-44d7-bac1-733c8eca9dac None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:31.077680 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2d995-9a92-44d7-bac1-733c8eca9dac None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:31.078573 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c2d995-9a92-44d7-bac1-733c8eca9dac None admin] RBAC: Adding query filter params (name=image) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:31.079138 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c2d995-9a92-44d7-bac1-733c8eca9dac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:31.080831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c2d995-9a92-44d7-bac1-733c8eca9dac None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:31.087674 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 367/730] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:18:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:31.094122 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2d995-9a92-44d7-bac1-733c8eca9dac None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:31.105196 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633fe59-9012-4671-bbda-f261a6c2daeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:31.106380 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633fe59-9012-4671-bbda-f261a6c2daeb None admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:31.106729 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633fe59-9012-4671-bbda-f261a6c2daeb None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:31.107464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633fe59-9012-4671-bbda-f261a6c2daeb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:31.108180 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633fe59-9012-4671-bbda-f261a6c2daeb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:31.109962 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633fe59-9012-4671-bbda-f261a6c2daeb None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:31.138131 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 364/731] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:18:30 2022] POST /identity/v3/endpoints => generated 349 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:18:31.227348 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2d995-9a92-44d7-bac1-733c8eca9dac None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:31.246440 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:31.273829 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d3647-0d37-4ce9-808f-9f4a8246e2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:31.274448 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d3647-0d37-4ce9-808f-9f4a8246e2a4 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:31.274730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d3647-0d37-4ce9-808f-9f4a8246e2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:31.275007 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d3647-0d37-4ce9-808f-9f4a8246e2a4 None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:31.275651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d3647-0d37-4ce9-808f-9f4a8246e2a4 None admin] RBAC: Adding query filter params (type=image) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:31.275957 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d3647-0d37-4ce9-808f-9f4a8246e2a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:31.277536 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d3647-0d37-4ce9-808f-9f4a8246e2a4 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:31.283221 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 368/732] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:18:31 2022] GET /identity/v3/services?type=image => generated 122 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:32.370245 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f449e03-6715-4abe-af91-f99b416d91eb None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:32.370756 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f449e03-6715-4abe-af91-f99b416d91eb None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:32.370756 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f449e03-6715-4abe-af91-f99b416d91eb None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:32.372347 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 365/733] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:32.377698 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4271b5e-7123-4a9e-bbde-020999cef72b None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:32.378113 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4271b5e-7123-4a9e-bbde-020999cef72b None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:32.378322 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4271b5e-7123-4a9e-bbde-020999cef72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:32.397020 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-e4271b5e-7123-4a9e-bbde-020999cef72b None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:32.398183 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-e4271b5e-7123-4a9e-bbde-020999cef72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:32.471085 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 369/734] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 20:18:32.748640 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f449e03-6715-4abe-af91-f99b416d91eb None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:32.849066 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:32.858034 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f449e03-6715-4abe-af91-f99b416d91eb None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:32.893953 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdfcaf-aec3-4020-a0f3-45981e2ab2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:32.894970 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdfcaf-aec3-4020-a0f3-45981e2ab2a3 None admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:32.895509 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdfcaf-aec3-4020-a0f3-45981e2ab2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:32.895978 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdfcaf-aec3-4020-a0f3-45981e2ab2a3 None admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:32.896865 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cdfcaf-aec3-4020-a0f3-45981e2ab2a3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:32.898502 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cdfcaf-aec3-4020-a0f3-45981e2ab2a3 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:32.901403 dv-cinder-862365-5-smb devstack@keystone.service[81403]: WARNING keystone.server.flask.common [None req-f1cdfcaf-aec3-4020-a0f3-45981e2ab2a3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 02 20:18:32.921128 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.sql.core [None req-f1cdfcaf-aec3-4020-a0f3-45981e2ab2a3 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 02 20:18:32.921128 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 20:18:32.921128 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [parameters: {'id': 'f29c8f9bca0342d5b69b0aa7aacb5ce9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 02 20:18:32.921128 dv-cinder-862365-5-smb devstack@keystone.service[81403]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81403) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 20:18:32.929447 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-f1cdfcaf-aec3-4020-a0f3-45981e2ab2a3 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f29c8f9bca0342d5b69b0aa7aacb5ce9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f29c8f9bca0342d5b69b0aa7aacb5ce9. Nov 02 20:18:32.929447 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:32.929447 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 20:18:32.929447 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 20:18:32.929447 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 20:18:32.929447 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 20:18:32.929447 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 20:18:32.929447 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 20:18:32.929447 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 20:18:32.929447 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application conn.query(q) Nov 02 20:18:32.929447 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 20:18:32.929447 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 20:18:32.929447 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 20:18:32.931278 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application result.read() Nov 02 20:18:32.931278 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 20:18:32.931278 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 20:18:32.931278 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 20:18:32.931278 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 20:18:32.931278 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 20:18:32.931278 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 20:18:32.931278 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 20:18:32.931278 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 20:18:32.931278 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 02 20:18:32.931278 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:32.931278 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 20:18:32.931278 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:32.931278 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:32.931278 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 20:18:32.931278 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 20:18:32.931278 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Nov 02 20:18:32.931278 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return project_ref.to_dict() Nov 02 20:18:32.932239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 20:18:32.932239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application next(self.gen) Nov 02 20:18:32.932239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 20:18:32.932239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application yield resource Nov 02 20:18:32.932239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 20:18:32.932239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application next(self.gen) Nov 02 20:18:32.932239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 20:18:32.932239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 20:18:32.932239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 20:18:32.932239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 20:18:32.932239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 20:18:32.932239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise self.value Nov 02 20:18:32.932239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 20:18:32.932239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 20:18:32.932239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 20:18:32.932239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application session.commit() Nov 02 20:18:32.932239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 20:18:32.933143 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 20:18:32.933143 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 20:18:32.933143 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 20:18:32.933143 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 20:18:32.933143 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self.session.flush() Nov 02 20:18:32.933143 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 20:18:32.933143 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 20:18:32.933143 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 20:18:32.933143 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 20:18:32.933143 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 20:18:32.933143 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application compat.raise_( Nov 02 20:18:32.933143 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 20:18:32.933143 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception Nov 02 20:18:32.933143 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 20:18:32.933143 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 20:18:32.933143 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 20:18:32.933143 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 20:18:32.936008 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 20:18:32.936008 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 20:18:32.936008 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 20:18:32.936008 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 20:18:32.936008 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Nov 02 20:18:32.936008 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application c = connection._execute_20( Nov 02 20:18:32.936008 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 20:18:32.936008 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 20:18:32.936008 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 20:18:32.936008 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 20:18:32.936008 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 20:18:32.936008 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 20:18:32.936008 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 20:18:32.936008 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 20:18:32.936008 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 20:18:32.937926 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 20:18:32.937926 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 20:18:32.937926 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception Nov 02 20:18:32.937926 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 20:18:32.937926 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 20:18:32.937926 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 20:18:32.937926 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 20:18:32.937926 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 20:18:32.937926 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 20:18:32.937926 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 20:18:32.937926 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application conn.query(q) Nov 02 20:18:32.937926 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 20:18:32.937926 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 20:18:32.937926 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 20:18:32.937926 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application result.read() Nov 02 20:18:32.937926 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 20:18:32.937926 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 20:18:32.939986 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 20:18:32.939986 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 20:18:32.939986 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 20:18:32.939986 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 20:18:32.939986 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 20:18:32.939986 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 20:18:32.939986 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 02 20:18:32.939986 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 20:18:32.939986 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [parameters: {'id': 'f29c8f9bca0342d5b69b0aa7aacb5ce9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 02 20:18:32.939986 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 20:18:32.939986 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:32.939986 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 20:18:32.939986 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:32.939986 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:32.939986 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Nov 02 20:18:32.941908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Nov 02 20:18:32.941908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 20:18:32.941908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 20:18:32.941908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Nov 02 20:18:32.941908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:32.941908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 20:18:32.941908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:32.941908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:32.941908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:32.941908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:32.941908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:32.941908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:32.941908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:32.941908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:32.941908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:32.941908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:32.941908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:32.949513 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:32.949513 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Nov 02 20:18:32.949513 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Nov 02 20:18:32.949513 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:32.949513 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:32.949513 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Nov 02 20:18:32.949513 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.Conflict( Nov 02 20:18:32.949513 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f29c8f9bca0342d5b69b0aa7aacb5ce9. Nov 02 20:18:32.949513 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:32.951148 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 366/735] 10.222.0.23 () {60 vars in 1140 bytes} [Wed Nov 2 20:18:32 2022] POST /identity/v3/projects => generated 262 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:32.958680 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4271b5e-7123-4a9e-bbde-020999cef72b None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:33.065511 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4271b5e-7123-4a9e-bbde-020999cef72b None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:33.077954 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:33.108744 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac277aa2-ca01-408d-937e-57fad40c1d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:33.109432 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac277aa2-ca01-408d-937e-57fad40c1d2a None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:33.109721 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac277aa2-ca01-408d-937e-57fad40c1d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:33.110046 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac277aa2-ca01-408d-937e-57fad40c1d2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:33.117424 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac277aa2-ca01-408d-937e-57fad40c1d2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:33.118940 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac277aa2-ca01-408d-937e-57fad40c1d2a None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:33.130730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-ac277aa2-ca01-408d-937e-57fad40c1d2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:18:33.130730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:33.130730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:33.130730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:33.130730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:33.130730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:33.130730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:33.130730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:33.130730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:33.130730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:33.130730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:33.130730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:33.130730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 20:18:33.130730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 20:18:33.130730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 20:18:33.131627 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 20:18:33.131627 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:33.131627 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:33.131627 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:33.131627 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:33.131627 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:33.131627 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:33.131627 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:33.131627 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:33.131627 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:33.131627 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:33.131627 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:33.131627 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:33.131627 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:33.131627 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:33.131627 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:33.131627 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:33.132498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 20:18:33.132498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 20:18:33.132498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 20:18:33.132498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 20:18:33.132498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 20:18:33.132498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 20:18:33.132498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:18:33.132498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:33.132498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 370/736] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:18:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:33.139918 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdfcaf-aec3-4020-a0f3-45981e2ab2a3 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:33.175094 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cc526-76ae-496b-bb86-42aaf2aff6f2 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:33.175445 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cc526-76ae-496b-bb86-42aaf2aff6f2 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:33.175708 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cc526-76ae-496b-bb86-42aaf2aff6f2 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:33.177417 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 371/737] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:33.183779 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542368ca-beb4-4061-bf52-73df860cb55c None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:33.184060 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542368ca-beb4-4061-bf52-73df860cb55c None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:33.184376 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542368ca-beb4-4061-bf52-73df860cb55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:33.203393 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-542368ca-beb4-4061-bf52-73df860cb55c None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:33.204678 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-542368ca-beb4-4061-bf52-73df860cb55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:33.255106 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdfcaf-aec3-4020-a0f3-45981e2ab2a3 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:33.295841 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f4a16-1ead-469d-ad16-d01e798392e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:33.296572 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f4a16-1ead-469d-ad16-d01e798392e8 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:33.296929 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f4a16-1ead-469d-ad16-d01e798392e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:33.298298 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 372/738] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:33 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 20:18:33.302898 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f4a16-1ead-469d-ad16-d01e798392e8 None admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:33.302898 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f4a16-1ead-469d-ad16-d01e798392e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:33.302898 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f4a16-1ead-469d-ad16-d01e798392e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:33.302898 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f4a16-1ead-469d-ad16-d01e798392e8 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:33.323821 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 367/739] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Nov 2 20:18:33 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:33.339798 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393598cf-090f-4775-935c-d993618bba98 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:33.340181 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393598cf-090f-4775-935c-d993618bba98 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:33.340531 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393598cf-090f-4775-935c-d993618bba98 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:33.342239 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 373/740] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:33.348090 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34371afc-efab-4e91-a4a9-cec2ce45bb71 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:33.348635 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34371afc-efab-4e91-a4a9-cec2ce45bb71 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:33.349060 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34371afc-efab-4e91-a4a9-cec2ce45bb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:33.369963 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-34371afc-efab-4e91-a4a9-cec2ce45bb71 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:33.371792 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-34371afc-efab-4e91-a4a9-cec2ce45bb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:33.383954 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:33.453802 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 368/741] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:33 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:18:33.580387 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393598cf-090f-4775-935c-d993618bba98 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:33.595230 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8675ad6-3186-4581-8d48-fd543a06f8f0 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:33.595589 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8675ad6-3186-4581-8d48-fd543a06f8f0 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:33.595794 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8675ad6-3186-4581-8d48-fd543a06f8f0 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:33.597468 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 369/742] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:33.602996 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d0a9c-9371-4e5a-970d-21706e47de95 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:33.603343 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d0a9c-9371-4e5a-970d-21706e47de95 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:33.603546 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d0a9c-9371-4e5a-970d-21706e47de95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:33.622201 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-3c2d0a9c-9371-4e5a-970d-21706e47de95 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:33.623372 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-3c2d0a9c-9371-4e5a-970d-21706e47de95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:33.701172 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 370/743] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:33 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 20:18:33.701909 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:33.703370 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393598cf-090f-4775-935c-d993618bba98 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:33.723564 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d0a9c-9371-4e5a-970d-21706e47de95 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:33.750101 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cc167-1318-4a82-8d08-0e30898c8d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:33.751018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cc167-1318-4a82-8d08-0e30898c8d3d None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:33.751293 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cc167-1318-4a82-8d08-0e30898c8d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:33.751896 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cc167-1318-4a82-8d08-0e30898c8d3d None admin] PATH_INFO: `/v3/services/compute` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:33.753093 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cc167-1318-4a82-8d08-0e30898c8d3d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:33.755015 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cc167-1318-4a82-8d08-0e30898c8d3d None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:33.767077 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-f53cc167-1318-4a82-8d08-0e30898c8d3d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 20:18:33.767077 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:33.767077 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 20:18:33.767077 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 20:18:33.767077 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 20:18:33.767077 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 20:18:33.767077 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 20:18:33.767077 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:33.767077 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 20:18:33.767077 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:33.767077 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 20:18:33.767077 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:33.767077 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:33.767077 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:33.767077 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:33.767077 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:33.767077 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:33.768092 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:33.768092 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:33.768092 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:33.768092 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:33.768092 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:33.768092 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:33.768092 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 20:18:33.768092 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 20:18:33.768092 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 20:18:33.768092 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 20:18:33.768092 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:33.768092 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:33.768092 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:33.768092 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:33.768092 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:33.768092 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:33.768943 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:33.768943 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:33.768943 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:33.768943 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:33.768943 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:33.768943 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:33.768943 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:33.768943 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:33.768943 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:33.768943 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:33.768943 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 20:18:33.768943 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:33.768943 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 20:18:33.768943 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:33.768943 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 374/744] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:18:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:33.776098 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cc167-1318-4a82-8d08-0e30898c8d3d None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:33.813038 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:33.847805 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d0a9c-9371-4e5a-970d-21706e47de95 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:33.892272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e3292-c1bb-498c-98b1-526d40c3a113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:33.893423 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e3292-c1bb-498c-98b1-526d40c3a113 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:33.893907 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e3292-c1bb-498c-98b1-526d40c3a113 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:33.894380 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e3292-c1bb-498c-98b1-526d40c3a113 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:33.895163 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e3292-c1bb-498c-98b1-526d40c3a113 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:33.896880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e3292-c1bb-498c-98b1-526d40c3a113 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:33.906850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-d64e3292-c1bb-498c-98b1-526d40c3a113 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 20:18:33.906850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:33.906850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 20:18:33.906850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 20:18:33.906850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 20:18:33.906850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 20:18:33.906850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 20:18:33.906850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:33.906850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 20:18:33.906850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:33.906850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 20:18:33.906850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:33.906850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:33.906850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:33.906850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:33.906850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:33.906850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:33.907842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:33.907842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:33.907842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:33.907842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:33.907842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:33.907842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:33.907842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 20:18:33.907842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 20:18:33.907842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 20:18:33.907842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 20:18:33.907842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:33.907842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:33.907842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:33.907842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:33.907842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:33.907842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:33.908707 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:33.908707 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:33.908707 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:33.908707 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:33.908707 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:33.908707 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:33.908707 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:33.908707 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:33.908707 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:33.908707 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:33.908707 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 20:18:33.908707 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:33.908707 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 20:18:33.908707 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:33.909444 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cc167-1318-4a82-8d08-0e30898c8d3d None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:33.916452 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 371/745] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Nov 2 20:18:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 20:18:33.917703 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e3292-c1bb-498c-98b1-526d40c3a113 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:33.950603 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b4019-bb7a-41e5-97d8-74f7f08b334a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:33.951209 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b4019-bb7a-41e5-97d8-74f7f08b334a None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:33.951489 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b4019-bb7a-41e5-97d8-74f7f08b334a None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:33.951762 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b4019-bb7a-41e5-97d8-74f7f08b334a None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:33.952827 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b4019-bb7a-41e5-97d8-74f7f08b334a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:33.953134 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b4019-bb7a-41e5-97d8-74f7f08b334a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:33.954769 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b4019-bb7a-41e5-97d8-74f7f08b334a None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:33.965734 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 375/746] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Nov 2 20:18:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:33.967027 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b4019-bb7a-41e5-97d8-74f7f08b334a None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:33.995094 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:34.034356 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e3292-c1bb-498c-98b1-526d40c3a113 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:34.068216 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d420946-82f8-4121-9db6-a836e1639c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:34.068852 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d420946-82f8-4121-9db6-a836e1639c33 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:34.069133 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d420946-82f8-4121-9db6-a836e1639c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:34.069406 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d420946-82f8-4121-9db6-a836e1639c33 None admin] PATH_INFO: `/v3/services` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:34.070029 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d420946-82f8-4121-9db6-a836e1639c33 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:34.070354 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d420946-82f8-4121-9db6-a836e1639c33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:34.071712 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d420946-82f8-4121-9db6-a836e1639c33 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:34.073505 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:34.078519 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b4019-bb7a-41e5-97d8-74f7f08b334a None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:34.080478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 372/747] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Nov 2 20:18:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:34.081373 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d420946-82f8-4121-9db6-a836e1639c33 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:34.115699 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd24717-eb94-43a9-9948-0d6131d70120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:34.116730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd24717-eb94-43a9-9948-0d6131d70120 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:34.117135 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd24717-eb94-43a9-9948-0d6131d70120 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:34.118020 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd24717-eb94-43a9-9948-0d6131d70120 None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:34.118752 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd24717-eb94-43a9-9948-0d6131d70120 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:34.119155 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd24717-eb94-43a9-9948-0d6131d70120 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:34.120656 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd24717-eb94-43a9-9948-0d6131d70120 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:34.131009 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 376/748] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Nov 2 20:18:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:34.131777 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd24717-eb94-43a9-9948-0d6131d70120 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:34.187768 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d420946-82f8-4121-9db6-a836e1639c33 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:34.223562 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36345f-67a4-4b77-9a94-437d71fda53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:34.224202 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36345f-67a4-4b77-9a94-437d71fda53e None admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:34.224487 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36345f-67a4-4b77-9a94-437d71fda53e None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:34.224792 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36345f-67a4-4b77-9a94-437d71fda53e None admin] PATH_INFO: `/v3/services` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:34.225442 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36345f-67a4-4b77-9a94-437d71fda53e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:34.225899 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:34.227495 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36345f-67a4-4b77-9a94-437d71fda53e None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:34.238502 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd24717-eb94-43a9-9948-0d6131d70120 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:34.245486 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 373/749] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Nov 2 20:18:34 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:18:34.246676 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36345f-67a4-4b77-9a94-437d71fda53e None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:34.296773 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb295f-0a5a-4b16-ab64-c67565e3d509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:34.297714 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb295f-0a5a-4b16-ab64-c67565e3d509 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:34.298247 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb295f-0a5a-4b16-ab64-c67565e3d509 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:34.299367 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb295f-0a5a-4b16-ab64-c67565e3d509 None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:34.300233 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb295f-0a5a-4b16-ab64-c67565e3d509 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:34.300907 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb295f-0a5a-4b16-ab64-c67565e3d509 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:34.303389 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb295f-0a5a-4b16-ab64-c67565e3d509 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:34.316753 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 377/750] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Nov 2 20:18:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:34.318621 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb295f-0a5a-4b16-ab64-c67565e3d509 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:34.330391 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:34.390787 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36345f-67a4-4b77-9a94-437d71fda53e None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:34.445962 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e1bad-0a49-4ac3-9388-2cca5ffdeceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:34.446588 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e1bad-0a49-4ac3-9388-2cca5ffdeceb None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:34.446878 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e1bad-0a49-4ac3-9388-2cca5ffdeceb None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:34.447142 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e1bad-0a49-4ac3-9388-2cca5ffdeceb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:34.447848 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e1bad-0a49-4ac3-9388-2cca5ffdeceb None admin] RBAC: Adding query filter params (interface=public, service_id=85cd1d811d724719ba9fcdb75a27032b, region_id=RegionOne) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:34.448384 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e1bad-0a49-4ac3-9388-2cca5ffdeceb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:34.450117 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e1bad-0a49-4ac3-9388-2cca5ffdeceb None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:34.456761 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 374/751] 10.222.0.23 () {56 vars in 1251 bytes} [Wed Nov 2 20:18:34 2022] GET /identity/v3/endpoints?service_id=85cd1d811d724719ba9fcdb75a27032b&interface=public®ion_id=RegionOne => generated 194 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:34.464908 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb295f-0a5a-4b16-ab64-c67565e3d509 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:34.465066 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e1bad-0a49-4ac3-9388-2cca5ffdeceb None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:34.501293 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c2bb2-bc87-4726-9ea8-80392608db1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:34.502167 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c2bb2-bc87-4726-9ea8-80392608db1e None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:34.502588 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c2bb2-bc87-4726-9ea8-80392608db1e None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:34.503001 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c2bb2-bc87-4726-9ea8-80392608db1e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:34.503960 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c2bb2-bc87-4726-9ea8-80392608db1e None admin] RBAC: Adding query filter params (interface=admin, service_id=2cec8a40cbf14f1c81e0b1944319c783, region_id=RegionOne) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:34.504401 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c2bb2-bc87-4726-9ea8-80392608db1e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:34.506107 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c2bb2-bc87-4726-9ea8-80392608db1e None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:34.512514 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 378/752] 10.222.0.23 () {56 vars in 1249 bytes} [Wed Nov 2 20:18:34 2022] GET /identity/v3/endpoints?service_id=2cec8a40cbf14f1c81e0b1944319c783&interface=admin®ion_id=RegionOne => generated 193 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:34.529138 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c2bb2-bc87-4726-9ea8-80392608db1e None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:34.550788 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:34.585782 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e1bad-0a49-4ac3-9388-2cca5ffdeceb None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:34.617705 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:34.631987 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f53004-e3c3-4a2a-a30e-c7de3f5ddff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:34.632643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f53004-e3c3-4a2a-a30e-c7de3f5ddff9 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:34.633466 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f53004-e3c3-4a2a-a30e-c7de3f5ddff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:34.633750 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f53004-e3c3-4a2a-a30e-c7de3f5ddff9 None admin] PATH_INFO: `/v3/services` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:34.634363 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f53004-e3c3-4a2a-a30e-c7de3f5ddff9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:34.635791 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f53004-e3c3-4a2a-a30e-c7de3f5ddff9 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:34.652668 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 375/753] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Nov 2 20:18:34 2022] GET /identity/v3/services => generated 1957 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:18:34.654215 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c2bb2-bc87-4726-9ea8-80392608db1e None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:34.694066 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb67586-b0a6-47f8-8863-8540f40ac536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:34.694690 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb67586-b0a6-47f8-8863-8540f40ac536 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:34.694972 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb67586-b0a6-47f8-8863-8540f40ac536 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:34.695250 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb67586-b0a6-47f8-8863-8540f40ac536 None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:34.695946 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb67586-b0a6-47f8-8863-8540f40ac536 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:34.697451 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb67586-b0a6-47f8-8863-8540f40ac536 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:34.705297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 379/754] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Nov 2 20:18:34 2022] GET /identity/v3/services => generated 1957 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:18:35.635604 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfa7c9-2c67-459d-835c-ba758080ed3e None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:35.636111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfa7c9-2c67-459d-835c-ba758080ed3e None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:35.636188 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfa7c9-2c67-459d-835c-ba758080ed3e None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:35.637751 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 376/755] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:35.643171 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b1b9b-e10e-41b6-b82a-c454556a45ae None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:35.643463 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b1b9b-e10e-41b6-b82a-c454556a45ae None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:35.643745 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b1b9b-e10e-41b6-b82a-c454556a45ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:35.662534 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-194b1b9b-e10e-41b6-b82a-c454556a45ae None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:35.663705 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-194b1b9b-e10e-41b6-b82a-c454556a45ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:35.733360 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 380/756] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:35 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:18:36.001832 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cfa7c9-2c67-459d-835c-ba758080ed3e None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:36.107367 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cfa7c9-2c67-459d-835c-ba758080ed3e None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:36.141488 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162d1f3-7cf0-4ac1-ab4d-d8fff7033f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:36.142102 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162d1f3-7cf0-4ac1-ab4d-d8fff7033f0a None admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:36.142386 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162d1f3-7cf0-4ac1-ab4d-d8fff7033f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:36.142662 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162d1f3-7cf0-4ac1-ab4d-d8fff7033f0a None admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:36.143368 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162d1f3-7cf0-4ac1-ab4d-d8fff7033f0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:36.144809 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162d1f3-7cf0-4ac1-ab4d-d8fff7033f0a None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:36.160137 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.sql.core [None req-0162d1f3-7cf0-4ac1-ab4d-d8fff7033f0a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 02 20:18:36.160137 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Nov 02 20:18:36.160137 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [parameters: {'user_id': '790c31448b2e462597f9c5ade166dc27', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Nov 02 20:18:36.160137 dv-cinder-862365-5-smb devstack@keystone.service[81403]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81403) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 20:18:36.167543 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-0162d1f3-7cf0-4ac1-ab4d-d8fff7033f0a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Nov 02 20:18:36.167543 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:36.167543 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 20:18:36.167543 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 20:18:36.167543 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 20:18:36.167543 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 20:18:36.167543 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 20:18:36.167543 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 20:18:36.167543 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 20:18:36.167543 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application conn.query(q) Nov 02 20:18:36.167543 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 20:18:36.167543 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 20:18:36.167543 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 20:18:36.167543 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application result.read() Nov 02 20:18:36.167543 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 20:18:36.168389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 20:18:36.168389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 20:18:36.168389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 20:18:36.168389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 20:18:36.168389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 20:18:36.168389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 20:18:36.168389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 20:18:36.168389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 02 20:18:36.168389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:36.168389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 20:18:36.168389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:36.168389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:36.168389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 20:18:36.168389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 20:18:36.168389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Nov 02 20:18:36.168389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Nov 02 20:18:36.168389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 20:18:36.168389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application next(self.gen) Nov 02 20:18:36.169339 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 20:18:36.169339 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application yield resource Nov 02 20:18:36.169339 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 20:18:36.169339 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application next(self.gen) Nov 02 20:18:36.169339 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 20:18:36.169339 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 20:18:36.169339 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 20:18:36.169339 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 20:18:36.169339 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 20:18:36.169339 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise self.value Nov 02 20:18:36.169339 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 20:18:36.169339 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 20:18:36.169339 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 20:18:36.169339 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application session.commit() Nov 02 20:18:36.169339 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 20:18:36.169339 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 20:18:36.169339 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 20:18:36.170208 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 20:18:36.170208 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 20:18:36.170208 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self.session.flush() Nov 02 20:18:36.170208 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 20:18:36.170208 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 20:18:36.170208 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 20:18:36.170208 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 20:18:36.170208 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 20:18:36.170208 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application compat.raise_( Nov 02 20:18:36.170208 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 20:18:36.170208 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception Nov 02 20:18:36.170208 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 20:18:36.170208 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 20:18:36.170208 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 20:18:36.170208 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 20:18:36.170208 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 20:18:36.170208 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 20:18:36.171087 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 20:18:36.171087 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 20:18:36.171087 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 02 20:18:36.171087 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application result = connection._execute_20( Nov 02 20:18:36.171087 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 20:18:36.171087 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 20:18:36.171087 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 20:18:36.171087 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 20:18:36.171087 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 20:18:36.171087 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 20:18:36.171087 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 20:18:36.171087 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 20:18:36.171087 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 20:18:36.171087 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 20:18:36.171087 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 20:18:36.171087 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception Nov 02 20:18:36.171912 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 20:18:36.171912 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 20:18:36.171912 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 20:18:36.171912 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 20:18:36.171912 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 20:18:36.171912 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 20:18:36.171912 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 20:18:36.171912 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application conn.query(q) Nov 02 20:18:36.171912 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 20:18:36.171912 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 20:18:36.171912 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 20:18:36.171912 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application result.read() Nov 02 20:18:36.171912 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 20:18:36.171912 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 20:18:36.171912 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 20:18:36.171912 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 20:18:36.174421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 20:18:36.174421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 20:18:36.174421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 20:18:36.174421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 20:18:36.174421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 02 20:18:36.174421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Nov 02 20:18:36.174421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [parameters: {'user_id': '790c31448b2e462597f9c5ade166dc27', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Nov 02 20:18:36.174421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 20:18:36.174421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:36.174421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 20:18:36.174421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:36.174421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:36.174421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:36.174421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:36.174421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:36.176233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:36.176233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:36.176233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:36.176233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:36.176233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:36.176233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:36.176233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:36.176233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Nov 02 20:18:36.176233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Nov 02 20:18:36.176233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:36.176233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:36.176233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 20:18:36.176233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:18:36.176233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 20:18:36.176233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:18:36.176233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Nov 02 20:18:36.176233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Nov 02 20:18:36.178413 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Nov 02 20:18:36.178413 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Nov 02 20:18:36.178413 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 20:18:36.178413 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 20:18:36.178413 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Nov 02 20:18:36.178413 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:36.178413 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 377/757] 10.222.0.23 () {60 vars in 1131 bytes} [Wed Nov 2 20:18:36 2022] POST /identity/v3/users => generated 160 bytes in 168 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:36.184832 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b1b9b-e10e-41b6-b82a-c454556a45ae None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:36.184832 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:36.280236 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b1b9b-e10e-41b6-b82a-c454556a45ae None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:36.316056 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4480004-eae6-4cb5-b2f6-56cd9d913368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:36.316727 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4480004-eae6-4cb5-b2f6-56cd9d913368 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:36.317010 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4480004-eae6-4cb5-b2f6-56cd9d913368 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:36.317341 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4480004-eae6-4cb5-b2f6-56cd9d913368 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:36.325054 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4480004-eae6-4cb5-b2f6-56cd9d913368 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:36.326517 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4480004-eae6-4cb5-b2f6-56cd9d913368 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:36.339161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-e4480004-eae6-4cb5-b2f6-56cd9d913368 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 20:18:36.339161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:36.339161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:36.339161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:36.339161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:36.339161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:36.339161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:36.339161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:36.339161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:36.339161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:36.339161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:36.339161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:36.339161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 20:18:36.339161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 20:18:36.339161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 20:18:36.339161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 20:18:36.341064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:36.341064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:36.341064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 20:18:36.341064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:18:36.341064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 20:18:36.341064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:18:36.341064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:36.341064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:36.341064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:36.341064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:36.341064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:36.341064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:36.341064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:36.341064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:36.341064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:36.341064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:36.341064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:36.341064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:36.343029 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:36.343029 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:36.343029 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 20:18:36.343029 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 20:18:36.343029 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 20:18:36.343029 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 20:18:36.343029 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 20:18:36.343029 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 20:18:36.343029 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 20:18:36.343029 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:36.343029 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 381/758] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:18:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:36.346779 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162d1f3-7cf0-4ac1-ab4d-d8fff7033f0a None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:36.401615 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:36.456448 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162d1f3-7cf0-4ac1-ab4d-d8fff7033f0a None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:36.494851 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0c024-02f6-4a81-bc0e-d86a430dda8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:36.495470 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0c024-02f6-4a81-bc0e-d86a430dda8a None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:36.495752 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0c024-02f6-4a81-bc0e-d86a430dda8a None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:36.496026 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0c024-02f6-4a81-bc0e-d86a430dda8a None admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:36.496754 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0c024-02f6-4a81-bc0e-d86a430dda8a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:36.497063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0c024-02f6-4a81-bc0e-d86a430dda8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:36.498756 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0c024-02f6-4a81-bc0e-d86a430dda8a None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:36.515993 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef486f-23e5-48f9-b2a7-7af8d7a9e38c None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:36.516316 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef486f-23e5-48f9-b2a7-7af8d7a9e38c None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:36.516575 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef486f-23e5-48f9-b2a7-7af8d7a9e38c None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:36.518458 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 382/759] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:36.531150 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e93eed-2629-4fe4-a9ad-783b5da8ed13 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:36.531408 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e93eed-2629-4fe4-a9ad-783b5da8ed13 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:36.531638 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e93eed-2629-4fe4-a9ad-783b5da8ed13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:36.545993 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 378/760] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Nov 2 20:18:36 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:36.550479 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-c8e93eed-2629-4fe4-a9ad-783b5da8ed13 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:36.551698 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-c8e93eed-2629-4fe4-a9ad-783b5da8ed13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:36.621231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:36.630803 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 383/761] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:36 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:18:36.891163 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba94f54-6f33-4b11-ac01-9fc1ff5e9cc8 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:36.891713 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba94f54-6f33-4b11-ac01-9fc1ff5e9cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:36.891713 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba94f54-6f33-4b11-ac01-9fc1ff5e9cc8 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:36.893357 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 379/762] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:36.899270 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb76409-4bbc-4352-80bf-3ecc930dc6a9 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:36.899744 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb76409-4bbc-4352-80bf-3ecc930dc6a9 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:36.899844 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb76409-4bbc-4352-80bf-3ecc930dc6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:36.904773 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba94f54-6f33-4b11-ac01-9fc1ff5e9cc8 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:36.918383 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-fbb76409-4bbc-4352-80bf-3ecc930dc6a9 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:36.920055 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-fbb76409-4bbc-4352-80bf-3ecc930dc6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:36.993381 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 384/763] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:36 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:18:36.994641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adde644-d7b5-41d0-93bd-a0ca70279c85 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:36.994933 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adde644-d7b5-41d0-93bd-a0ca70279c85 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:36.995214 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adde644-d7b5-41d0-93bd-a0ca70279c85 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:36.996482 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 385/764] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:37.001345 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e766dd-956a-427b-a329-054a1386333b None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:37.001639 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e766dd-956a-427b-a329-054a1386333b None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:37.001920 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e766dd-956a-427b-a329-054a1386333b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:37.020326 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-a8e766dd-956a-427b-a329-054a1386333b None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:37.021324 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba94f54-6f33-4b11-ac01-9fc1ff5e9cc8 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:37.021559 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-a8e766dd-956a-427b-a329-054a1386333b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:37.031320 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:37.056934 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68cdfc-d575-4073-b161-0a56486758c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:37.057566 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68cdfc-d575-4073-b161-0a56486758c0 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:37.057847 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68cdfc-d575-4073-b161-0a56486758c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:37.058124 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68cdfc-d575-4073-b161-0a56486758c0 None admin] PATH_INFO: `/v3/services/image` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:37.058958 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68cdfc-d575-4073-b161-0a56486758c0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:37.061307 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68cdfc-d575-4073-b161-0a56486758c0 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:37.071209 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-3d68cdfc-d575-4073-b161-0a56486758c0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 20:18:37.071209 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:37.071209 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 20:18:37.071209 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 20:18:37.071209 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 20:18:37.071209 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 20:18:37.071209 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 20:18:37.071209 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:37.071209 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 20:18:37.071209 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:37.071209 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 20:18:37.071209 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:37.071209 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:37.071209 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:37.071209 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:37.071209 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:37.071209 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:37.072162 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:37.072162 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:37.072162 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:37.072162 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:37.072162 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:37.072162 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:37.072162 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 20:18:37.072162 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 20:18:37.072162 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 20:18:37.072162 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 20:18:37.072162 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:37.072162 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:37.072162 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:37.072162 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:37.072162 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:37.072162 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:37.073608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:37.073608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:37.073608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:37.073608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:37.073608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:37.073608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:37.073608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:37.073608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:37.073608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:37.073608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:37.073608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 20:18:37.073608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:37.073608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 20:18:37.073608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:37.073608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 380/765] 10.222.0.23 () {56 vars in 1105 bytes} [Wed Nov 2 20:18:36 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 20:18:37.078236 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68cdfc-d575-4073-b161-0a56486758c0 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:37.096589 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 386/766] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:37 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 20:18:37.188213 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68cdfc-d575-4073-b161-0a56486758c0 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:37.225011 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a0c02-c700-4e83-be10-f5695149c09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:37.225626 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a0c02-c700-4e83-be10-f5695149c09b None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:37.225912 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a0c02-c700-4e83-be10-f5695149c09b None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:37.226191 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a0c02-c700-4e83-be10-f5695149c09b None admin] PATH_INFO: `/v3/services` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:37.226850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a0c02-c700-4e83-be10-f5695149c09b None admin] RBAC: Adding query filter params (name=image) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:37.227160 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a0c02-c700-4e83-be10-f5695149c09b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:37.228575 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a0c02-c700-4e83-be10-f5695149c09b None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:37.238169 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 381/767] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:18:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:37.239162 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e766dd-956a-427b-a329-054a1386333b None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:37.264804 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a0c02-c700-4e83-be10-f5695149c09b None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:37.300620 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:37.303407 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:37.347279 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e766dd-956a-427b-a329-054a1386333b None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:37.375076 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a0c02-c700-4e83-be10-f5695149c09b None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:37.385314 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e8cb9-0213-448f-9587-79629fda506e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:37.385917 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e8cb9-0213-448f-9587-79629fda506e None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:37.386192 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e8cb9-0213-448f-9587-79629fda506e None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:37.386488 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e8cb9-0213-448f-9587-79629fda506e None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:37.387116 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e8cb9-0213-448f-9587-79629fda506e None admin] RBAC: Adding query filter params (type=image) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:37.387415 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e8cb9-0213-448f-9587-79629fda506e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:37.388802 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e8cb9-0213-448f-9587-79629fda506e None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:37.393546 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 387/768] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:18:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:18:37.394306 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e8cb9-0213-448f-9587-79629fda506e None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:37.412963 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424937ef-3412-4824-93d5-0602c5f4f04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:37.413593 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424937ef-3412-4824-93d5-0602c5f4f04e None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:37.413877 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424937ef-3412-4824-93d5-0602c5f4f04e None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:37.414187 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424937ef-3412-4824-93d5-0602c5f4f04e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:37.414777 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424937ef-3412-4824-93d5-0602c5f4f04e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:37.416137 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424937ef-3412-4824-93d5-0602c5f4f04e None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:37.424762 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-424937ef-3412-4824-93d5-0602c5f4f04e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 20:18:37.424762 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:37.424762 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 20:18:37.424762 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 20:18:37.424762 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 20:18:37.424762 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 20:18:37.424762 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 20:18:37.424762 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:37.424762 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 20:18:37.424762 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:37.424762 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 20:18:37.424762 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:37.424762 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:37.424762 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:37.424762 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:37.424762 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:37.424762 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:37.425764 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:37.425764 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:37.425764 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:37.425764 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:37.425764 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:37.425764 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:37.425764 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 20:18:37.425764 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 20:18:37.425764 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 20:18:37.425764 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 20:18:37.425764 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:37.425764 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:37.425764 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:37.425764 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:37.425764 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:37.425764 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:37.426593 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:37.426593 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:37.426593 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:37.426593 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:37.426593 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:37.426593 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:37.426593 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:37.426593 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:37.426593 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:37.426593 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:37.426593 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 20:18:37.426593 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:37.426593 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 20:18:37.426593 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:37.426593 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 382/769] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:18:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 20:18:37.427473 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424937ef-3412-4824-93d5-0602c5f4f04e None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:37.494480 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e8cb9-0213-448f-9587-79629fda506e None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:37.518160 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:37.524372 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:37.527163 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424937ef-3412-4824-93d5-0602c5f4f04e None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:37.532048 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed416ca3-8110-4398-9e2f-f9d0d402bb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:37.532715 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed416ca3-8110-4398-9e2f-f9d0d402bb22 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:37.533003 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed416ca3-8110-4398-9e2f-f9d0d402bb22 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:37.533281 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed416ca3-8110-4398-9e2f-f9d0d402bb22 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:37.533868 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed416ca3-8110-4398-9e2f-f9d0d402bb22 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:37.535246 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed416ca3-8110-4398-9e2f-f9d0d402bb22 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:37.544686 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-ed416ca3-8110-4398-9e2f-f9d0d402bb22 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 20:18:37.544686 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:37.544686 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 20:18:37.544686 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 20:18:37.544686 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 20:18:37.544686 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 20:18:37.544686 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 20:18:37.544686 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:37.544686 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 20:18:37.544686 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:37.544686 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 20:18:37.544686 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:37.544686 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:37.544686 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:37.544686 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:37.544686 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:37.544686 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:37.545831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:37.545831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:37.545831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:37.545831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:37.545831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:37.545831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:37.545831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 20:18:37.545831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 20:18:37.545831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 20:18:37.545831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 20:18:37.545831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:37.545831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:37.545831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:37.545831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:37.545831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:37.545831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:37.546666 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:37.546666 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:37.546666 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:37.546666 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:37.546666 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:37.546666 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:37.546666 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:37.546666 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:37.546666 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:37.546666 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:37.546666 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 20:18:37.546666 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:37.546666 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 20:18:37.546666 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:37.546666 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 388/770] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Nov 2 20:18:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:37.547487 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed416ca3-8110-4398-9e2f-f9d0d402bb22 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:37.564708 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4a081-e2a6-4e3e-972c-f048507f7cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:37.565319 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4a081-e2a6-4e3e-972c-f048507f7cc8 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:37.565604 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4a081-e2a6-4e3e-972c-f048507f7cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:37.565883 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4a081-e2a6-4e3e-972c-f048507f7cc8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:37.566581 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4a081-e2a6-4e3e-972c-f048507f7cc8 None admin] RBAC: Adding query filter params (interface=public, service_id=14b3a17c171e4b49b963ed8cbf21e184, region_id=RegionOne) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:37.566895 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4a081-e2a6-4e3e-972c-f048507f7cc8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:37.568261 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4a081-e2a6-4e3e-972c-f048507f7cc8 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:37.573775 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 383/771] 10.222.0.23 () {56 vars in 1251 bytes} [Wed Nov 2 20:18:37 2022] GET /identity/v3/endpoints?service_id=14b3a17c171e4b49b963ed8cbf21e184&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:37.574479 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4a081-e2a6-4e3e-972c-f048507f7cc8 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:37.649425 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed416ca3-8110-4398-9e2f-f9d0d402bb22 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:37.671944 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4a081-e2a6-4e3e-972c-f048507f7cc8 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:37.682152 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67e956-e9c0-45c7-8e2d-0286324e9f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:37.682757 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67e956-e9c0-45c7-8e2d-0286324e9f84 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:37.683038 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67e956-e9c0-45c7-8e2d-0286324e9f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:37.683316 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67e956-e9c0-45c7-8e2d-0286324e9f84 None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:37.684208 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67e956-e9c0-45c7-8e2d-0286324e9f84 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:37.684520 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67e956-e9c0-45c7-8e2d-0286324e9f84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:37.685911 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67e956-e9c0-45c7-8e2d-0286324e9f84 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:37.690745 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 389/772] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Nov 2 20:18:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:37.691548 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67e956-e9c0-45c7-8e2d-0286324e9f84 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:37.709408 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08cf2d4-cfb1-4141-99d4-3db4ad7f0a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:37.710020 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cf2d4-cfb1-4141-99d4-3db4ad7f0a02 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:37.710302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cf2d4-cfb1-4141-99d4-3db4ad7f0a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:37.710581 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cf2d4-cfb1-4141-99d4-3db4ad7f0a02 None admin] PATH_INFO: `/v3/services` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:37.711729 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08cf2d4-cfb1-4141-99d4-3db4ad7f0a02 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:37.712040 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08cf2d4-cfb1-4141-99d4-3db4ad7f0a02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:37.713421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08cf2d4-cfb1-4141-99d4-3db4ad7f0a02 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:37.718307 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 384/773] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Nov 2 20:18:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:37.719076 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08cf2d4-cfb1-4141-99d4-3db4ad7f0a02 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:37.744843 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:37.746124 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:37.795895 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67e956-e9c0-45c7-8e2d-0286324e9f84 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:37.818927 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08cf2d4-cfb1-4141-99d4-3db4ad7f0a02 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:37.832186 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba6582-607f-44b2-963f-be9a887ede01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:37.832823 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba6582-607f-44b2-963f-be9a887ede01 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:37.833114 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba6582-607f-44b2-963f-be9a887ede01 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:37.833398 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba6582-607f-44b2-963f-be9a887ede01 None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:37.834002 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba6582-607f-44b2-963f-be9a887ede01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:37.835502 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba6582-607f-44b2-963f-be9a887ede01 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:37.841784 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 390/774] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Nov 2 20:18:37 2022] GET /identity/v3/services => generated 1957 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:18:37.842565 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba6582-607f-44b2-963f-be9a887ede01 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:37.853564 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ca16d-9e1b-4f3c-b882-93a38a452471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:37.854199 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ca16d-9e1b-4f3c-b882-93a38a452471 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:37.854486 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ca16d-9e1b-4f3c-b882-93a38a452471 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:37.854762 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ca16d-9e1b-4f3c-b882-93a38a452471 None admin] PATH_INFO: `/v3/services` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:37.855417 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ca16d-9e1b-4f3c-b882-93a38a452471 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:37.855728 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ca16d-9e1b-4f3c-b882-93a38a452471 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:37.857624 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ca16d-9e1b-4f3c-b882-93a38a452471 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:37.863256 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 385/775] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Nov 2 20:18:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:37.869974 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ca16d-9e1b-4f3c-b882-93a38a452471 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:37.973796 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:37.975047 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba6582-607f-44b2-963f-be9a887ede01 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:37.987515 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ca16d-9e1b-4f3c-b882-93a38a452471 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:37.991137 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:38.017040 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a565a38-f01b-4b24-982b-2decc2da03a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:38.017568 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a565a38-f01b-4b24-982b-2decc2da03a2 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:38.017855 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a565a38-f01b-4b24-982b-2decc2da03a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:38.018129 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a565a38-f01b-4b24-982b-2decc2da03a2 None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:38.018769 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a565a38-f01b-4b24-982b-2decc2da03a2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:38.019075 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a565a38-f01b-4b24-982b-2decc2da03a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:38.020478 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a565a38-f01b-4b24-982b-2decc2da03a2 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:38.028071 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 391/776] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Nov 2 20:18:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:38.029103 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c2571f-b52f-4f14-a373-4a9015de74b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:38.029713 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2571f-b52f-4f14-a373-4a9015de74b1 None admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:38.029995 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2571f-b52f-4f14-a373-4a9015de74b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:38.030275 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c2571f-b52f-4f14-a373-4a9015de74b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:38.030943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c2571f-b52f-4f14-a373-4a9015de74b1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:38.032311 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c2571f-b52f-4f14-a373-4a9015de74b1 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:38.033328 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a565a38-f01b-4b24-982b-2decc2da03a2 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:38.055415 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 386/777] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:18:37 2022] POST /identity/v3/endpoints => generated 334 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:18:38.150762 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a565a38-f01b-4b24-982b-2decc2da03a2 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:38.200067 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ffee7-cb2f-4bb2-ba12-5fa6802e833e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:38.200733 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ffee7-cb2f-4bb2-ba12-5fa6802e833e None admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:38.201017 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ffee7-cb2f-4bb2-ba12-5fa6802e833e None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:38.201289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ffee7-cb2f-4bb2-ba12-5fa6802e833e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:38.201951 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ffee7-cb2f-4bb2-ba12-5fa6802e833e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:38.203330 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ffee7-cb2f-4bb2-ba12-5fa6802e833e None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:38.221100 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 392/778] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:18:38 2022] POST /identity/v3/endpoints => generated 325 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:18:40.045414 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd3f82-68fe-43ce-9335-4aa734c81f1a None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:40.045942 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd3f82-68fe-43ce-9335-4aa734c81f1a None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:40.045942 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd3f82-68fe-43ce-9335-4aa734c81f1a None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:40.047330 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 387/779] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:40.052518 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f103bfc-9ea1-40dc-a7dd-7ae3ac9b4439 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:40.052931 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f103bfc-9ea1-40dc-a7dd-7ae3ac9b4439 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:40.053092 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f103bfc-9ea1-40dc-a7dd-7ae3ac9b4439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:40.071847 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-8f103bfc-9ea1-40dc-a7dd-7ae3ac9b4439 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:40.073345 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-8f103bfc-9ea1-40dc-a7dd-7ae3ac9b4439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:40.104333 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:40.154093 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 393/780] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:18:40.386662 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7caf4-5c1d-4d53-b4e0-d026a2b42417 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:40.387033 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7caf4-5c1d-4d53-b4e0-d026a2b42417 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:40.387228 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7caf4-5c1d-4d53-b4e0-d026a2b42417 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:40.388726 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 388/781] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:40.393576 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8bc75-acae-44e0-a64d-d4cde58a0c4e None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:40.393865 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8bc75-acae-44e0-a64d-d4cde58a0c4e None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:40.394141 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8bc75-acae-44e0-a64d-d4cde58a0c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:40.402688 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d977e-0b46-4474-8340-46229c8fdbef None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:40.402972 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d977e-0b46-4474-8340-46229c8fdbef None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:40.403246 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d977e-0b46-4474-8340-46229c8fdbef None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:40.404815 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 389/782] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 20:18:40.409571 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c42524-c4aa-456b-91e0-a55b71b1533e None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:40.409850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c42524-c4aa-456b-91e0-a55b71b1533e None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:40.410119 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c42524-c4aa-456b-91e0-a55b71b1533e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:40.412700 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-39b8bc75-acae-44e0-a64d-d4cde58a0c4e None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:40.413878 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-39b8bc75-acae-44e0-a64d-d4cde58a0c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:40.428456 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-98c42524-c4aa-456b-91e0-a55b71b1533e None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:40.430611 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-98c42524-c4aa-456b-91e0-a55b71b1533e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:40.481115 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 394/783] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:18:40.481951 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8bc75-acae-44e0-a64d-d4cde58a0c4e None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:40.505562 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 390/784] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 20:18:40.575341 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:40.588613 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8bc75-acae-44e0-a64d-d4cde58a0c4e None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:40.623153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a38111-b994-4d10-a37c-72f33a8b36a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:40.623779 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a38111-b994-4d10-a37c-72f33a8b36a0 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:40.624060 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a38111-b994-4d10-a37c-72f33a8b36a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:40.624333 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a38111-b994-4d10-a37c-72f33a8b36a0 None admin] PATH_INFO: `/v3/services/image` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:40.624939 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a38111-b994-4d10-a37c-72f33a8b36a0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:40.626302 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a38111-b994-4d10-a37c-72f33a8b36a0 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:40.635540 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-d2a38111-b994-4d10-a37c-72f33a8b36a0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 20:18:40.635540 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:40.635540 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 20:18:40.635540 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 20:18:40.635540 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 20:18:40.635540 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 20:18:40.635540 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 20:18:40.635540 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:40.635540 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 20:18:40.635540 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:40.635540 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 20:18:40.635540 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:40.635540 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:40.635540 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:40.635540 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:40.635540 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:40.635540 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:40.636471 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:40.636471 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:40.636471 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:40.636471 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:40.636471 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:40.636471 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:40.636471 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 20:18:40.636471 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 20:18:40.636471 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 20:18:40.636471 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 20:18:40.636471 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:40.636471 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:40.636471 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:40.636471 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:40.636471 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:40.636471 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:40.637670 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:40.637670 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:40.637670 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:40.637670 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:40.637670 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:40.637670 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:40.637670 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:40.637670 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:40.637670 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:40.637670 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:40.637670 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 20:18:40.637670 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:18:40.637670 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 20:18:40.637670 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:40.637670 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 395/785] 10.222.0.23 () {56 vars in 1105 bytes} [Wed Nov 2 20:18:40 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:40.642605 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c42524-c4aa-456b-91e0-a55b71b1533e None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:40.721336 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:40.744868 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c42524-c4aa-456b-91e0-a55b71b1533e None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:40.748615 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a38111-b994-4d10-a37c-72f33a8b36a0 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:40.782124 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de7f0c-9007-4012-85ca-1fb7d75ccf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:40.782737 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de7f0c-9007-4012-85ca-1fb7d75ccf04 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:40.783020 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de7f0c-9007-4012-85ca-1fb7d75ccf04 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:40.783296 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de7f0c-9007-4012-85ca-1fb7d75ccf04 None admin] PATH_INFO: `/v3/services` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:40.783931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de7f0c-9007-4012-85ca-1fb7d75ccf04 None admin] RBAC: Adding query filter params (name=image) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:40.784239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de7f0c-9007-4012-85ca-1fb7d75ccf04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:40.785628 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de7f0c-9007-4012-85ca-1fb7d75ccf04 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:40.790462 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 391/786] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:18:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:40.791235 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de7f0c-9007-4012-85ca-1fb7d75ccf04 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:40.851180 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a38111-b994-4d10-a37c-72f33a8b36a0 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:40.884987 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b3559-5096-40b0-af02-59b5f9474216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:40.885613 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b3559-5096-40b0-af02-59b5f9474216 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:40.885900 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b3559-5096-40b0-af02-59b5f9474216 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:40.886180 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b3559-5096-40b0-af02-59b5f9474216 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:40.889570 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de7f0c-9007-4012-85ca-1fb7d75ccf04 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:40.896675 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b3559-5096-40b0-af02-59b5f9474216 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:18:40.901446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-a91b3559-5096-40b0-af02-59b5f9474216 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 20:18:40.901446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:40.901446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:40.901446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:40.901446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:40.901446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:40.901446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:40.901446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:40.901446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:40.901446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:40.901446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:40.901446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:40.901446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:18:40.901446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:18:40.901446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:18:40.901446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:18:40.902479 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:18:40.902479 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:18:40.902479 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:18:40.902479 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:18:40.902479 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:40.902479 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:40.902479 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:40.902479 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:40.902479 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:40.902479 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:40.902479 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:40.902479 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:40.902479 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:40.902479 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:40.902479 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:40.902479 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:40.903304 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:40.903304 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:40.903304 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:40.903304 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:40.903304 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:18:40.903304 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:18:40.903304 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:18:40.903304 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:18:40.903304 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:18:40.903304 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:18:40.903304 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 20:18:40.903304 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:40.903304 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 396/787] 10.222.0.23 () {56 vars in 1120 bytes} [Wed Nov 2 20:18:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 20:18:40.903304 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b3559-5096-40b0-af02-59b5f9474216 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:40.917435 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:40.927408 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8a831-9029-4b36-a072-e633d264177a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:40.928040 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8a831-9029-4b36-a072-e633d264177a None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:40.928328 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8a831-9029-4b36-a072-e633d264177a None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:40.928642 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8a831-9029-4b36-a072-e633d264177a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:40.930273 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8a831-9029-4b36-a072-e633d264177a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:40.931692 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8a831-9029-4b36-a072-e633d264177a None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:40.933291 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 392/788] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:18:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:40.934314 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8a831-9029-4b36-a072-e633d264177a None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:40.945773 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:41.006735 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b3559-5096-40b0-af02-59b5f9474216 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:41.031657 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8a831-9029-4b36-a072-e633d264177a None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:41.040372 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e427d-63cf-42bf-b22a-821d27cb6f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:41.041009 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e427d-63cf-42bf-b22a-821d27cb6f4e None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:41.041302 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e427d-63cf-42bf-b22a-821d27cb6f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:41.041573 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e427d-63cf-42bf-b22a-821d27cb6f4e None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:41.042200 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e427d-63cf-42bf-b22a-821d27cb6f4e None admin] RBAC: Adding query filter params (type=image) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:41.042506 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e427d-63cf-42bf-b22a-821d27cb6f4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:41.043867 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e427d-63cf-42bf-b22a-821d27cb6f4e None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:41.053361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 397/789] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:18:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:41.053361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e427d-63cf-42bf-b22a-821d27cb6f4e None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:41.066593 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b2f8b-f0c3-4b9d-b307-c62983b984fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:41.067192 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b2f8b-f0c3-4b9d-b307-c62983b984fa None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:41.067478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b2f8b-f0c3-4b9d-b307-c62983b984fa None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:41.067750 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b2f8b-f0c3-4b9d-b307-c62983b984fa None admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:41.068417 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b2f8b-f0c3-4b9d-b307-c62983b984fa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:41.068742 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b2f8b-f0c3-4b9d-b307-c62983b984fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:41.070088 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b2f8b-f0c3-4b9d-b307-c62983b984fa None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:41.082943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 393/790] 10.222.0.23 () {56 vars in 1115 bytes} [Wed Nov 2 20:18:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:41.082943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b2f8b-f0c3-4b9d-b307-c62983b984fa None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:41.127870 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:41.149560 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:41.149877 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e427d-63cf-42bf-b22a-821d27cb6f4e None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:41.181068 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b2f8b-f0c3-4b9d-b307-c62983b984fa None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:41.183076 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ebfdc-3be3-44d8-bd36-791ce96fd83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:41.183936 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ebfdc-3be3-44d8-bd36-791ce96fd83f None admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:41.184217 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ebfdc-3be3-44d8-bd36-791ce96fd83f None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:41.184496 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ebfdc-3be3-44d8-bd36-791ce96fd83f None admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:41.185168 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ebfdc-3be3-44d8-bd36-791ce96fd83f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:41.186591 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ebfdc-3be3-44d8-bd36-791ce96fd83f None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:41.212460 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 398/791] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Nov 2 20:18:41 2022] POST /identity/v3/projects => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:18:41.213293 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ebfdc-3be3-44d8-bd36-791ce96fd83f None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:41.222264 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458e4b2-68a1-4375-9281-3b939a171473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:41.222960 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458e4b2-68a1-4375-9281-3b939a171473 None admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:41.223249 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458e4b2-68a1-4375-9281-3b939a171473 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:41.223526 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458e4b2-68a1-4375-9281-3b939a171473 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:41.224405 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458e4b2-68a1-4375-9281-3b939a171473 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:41.225703 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458e4b2-68a1-4375-9281-3b939a171473 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:41.250430 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 394/792] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:18:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:18:41.335223 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ebfdc-3be3-44d8-bd36-791ce96fd83f None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:41.368024 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:41.385557 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6990c-cb5c-4d35-97b6-e25b6084d555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:41.386305 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6990c-cb5c-4d35-97b6-e25b6084d555 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:41.386653 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6990c-cb5c-4d35-97b6-e25b6084d555 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:41.386995 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6990c-cb5c-4d35-97b6-e25b6084d555 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:41.399348 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c6990c-cb5c-4d35-97b6-e25b6084d555 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:41.401047 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c6990c-cb5c-4d35-97b6-e25b6084d555 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:41.419311 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-19c6990c-cb5c-4d35-97b6-e25b6084d555 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:41.419311 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:41.419311 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:41.419311 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:41.419311 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:41.419311 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:41.419311 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:41.419311 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:41.419311 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:41.419311 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:41.419311 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:41.419311 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:41.419311 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:18:41.419311 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:18:41.419311 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:18:41.419311 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:18:41.420505 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:41.420505 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:41.420505 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:41.420505 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:41.420505 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:41.420505 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:41.420505 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:41.420505 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:41.420505 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:41.420505 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:41.420505 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:41.420505 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:41.420505 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:41.420505 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:41.420505 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:41.420505 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:41.420505 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:18:41.421643 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:18:41.421643 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:41.421643 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:41.421643 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 399/793] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:18:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:41.426682 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458e4b2-68a1-4375-9281-3b939a171473 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:41.535851 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458e4b2-68a1-4375-9281-3b939a171473 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:41.563819 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:41.573802 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae009c-a3da-43b5-b539-85fc6da02d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:41.574425 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae009c-a3da-43b5-b539-85fc6da02d0c None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:41.574711 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae009c-a3da-43b5-b539-85fc6da02d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:41.574992 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae009c-a3da-43b5-b539-85fc6da02d0c None admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:41.575670 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae009c-a3da-43b5-b539-85fc6da02d0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:41.575980 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae009c-a3da-43b5-b539-85fc6da02d0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:41.577396 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae009c-a3da-43b5-b539-85fc6da02d0c None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:41.589946 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 395/794] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:41.595427 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6990c-cb5c-4d35-97b6-e25b6084d555 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:41.698767 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6990c-cb5c-4d35-97b6-e25b6084d555 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:41.732048 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d168a-ee43-44ec-b1e1-c0f35f4895fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:41.732704 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d168a-ee43-44ec-b1e1-c0f35f4895fe None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:41.732986 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d168a-ee43-44ec-b1e1-c0f35f4895fe None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:41.733258 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d168a-ee43-44ec-b1e1-c0f35f4895fe None admin] PATH_INFO: `/v3/users/nova` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:41.740799 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d168a-ee43-44ec-b1e1-c0f35f4895fe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:41.742828 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d168a-ee43-44ec-b1e1-c0f35f4895fe None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:41.754282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-6d1d168a-ee43-44ec-b1e1-c0f35f4895fe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 20:18:41.754282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:41.754282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:41.754282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:41.754282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:41.754282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:41.754282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:41.754282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:41.754282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:41.754282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:41.754282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:41.754282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:41.754282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 20:18:41.754282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 20:18:41.754282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 20:18:41.754282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 20:18:41.755255 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:41.755255 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:41.755255 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 20:18:41.755255 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:18:41.755255 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 20:18:41.755255 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:18:41.755255 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:41.755255 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:41.755255 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:41.755255 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:41.755255 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:41.755255 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:41.755255 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:41.755255 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:41.755255 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:41.755255 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:41.755255 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:41.755255 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:41.756217 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:41.756217 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:41.756217 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 20:18:41.756217 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 20:18:41.756217 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 20:18:41.756217 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 20:18:41.756217 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 20:18:41.756217 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 20:18:41.756217 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 20:18:41.756217 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:41.756217 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 400/795] 10.222.0.23 () {56 vars in 1093 bytes} [Wed Nov 2 20:18:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:41.763192 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae009c-a3da-43b5-b539-85fc6da02d0c None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:41.870182 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae009c-a3da-43b5-b539-85fc6da02d0c None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:42.020741 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a774579-a564-40fa-abc1-790258e43bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:42.021275 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a774579-a564-40fa-abc1-790258e43bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:42.021551 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a774579-a564-40fa-abc1-790258e43bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:42.021822 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a774579-a564-40fa-abc1-790258e43bb9 None admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:42.022539 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a774579-a564-40fa-abc1-790258e43bb9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:42.022843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a774579-a564-40fa-abc1-790258e43bb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:42.024304 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a774579-a564-40fa-abc1-790258e43bb9 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:42.046882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 396/796] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Nov 2 20:18:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:18:42.047818 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d168a-ee43-44ec-b1e1-c0f35f4895fe None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:42.083083 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:42.150277 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d168a-ee43-44ec-b1e1-c0f35f4895fe None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:42.190941 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c2ba5-d5f8-448f-a64d-b0c90801de68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:42.191633 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c2ba5-d5f8-448f-a64d-b0c90801de68 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:42.191917 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c2ba5-d5f8-448f-a64d-b0c90801de68 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:42.192188 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c2ba5-d5f8-448f-a64d-b0c90801de68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:42.203302 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c2ba5-d5f8-448f-a64d-b0c90801de68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:42.204763 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c2ba5-d5f8-448f-a64d-b0c90801de68 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:42.219318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-9d4c2ba5-d5f8-448f-a64d-b0c90801de68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:42.219318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:42.219318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:42.219318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:42.219318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:42.219318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:42.219318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:42.219318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:42.219318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:42.219318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:42.219318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:42.219318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:42.219318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:18:42.219318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:18:42.219318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:18:42.219318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:18:42.220231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:42.220231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:42.220231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:42.220231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:42.220231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:42.220231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:42.220231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:42.220231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:42.220231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:42.220231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:42.220231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:42.220231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:42.220231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:42.220231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:42.220231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:42.220231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:42.220231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:18:42.225879 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:18:42.225879 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:42.225879 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:42.225879 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 401/797] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:18:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 20:18:42.226375 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a774579-a564-40fa-abc1-790258e43bb9 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:42.272600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:42.326288 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a774579-a564-40fa-abc1-790258e43bb9 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:42.359512 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229dc7c2-21f1-4f5c-91c5-91c08f4e5b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:42.360167 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229dc7c2-21f1-4f5c-91c5-91c08f4e5b7f None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:42.360445 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229dc7c2-21f1-4f5c-91c5-91c08f4e5b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:42.360782 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229dc7c2-21f1-4f5c-91c5-91c08f4e5b7f None admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:42.361420 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229dc7c2-21f1-4f5c-91c5-91c08f4e5b7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:42.361723 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229dc7c2-21f1-4f5c-91c5-91c08f4e5b7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:42.363063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229dc7c2-21f1-4f5c-91c5-91c08f4e5b7f None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:42.379504 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 397/798] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:42.380627 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c2ba5-d5f8-448f-a64d-b0c90801de68 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:42.469369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:42.482929 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c2ba5-d5f8-448f-a64d-b0c90801de68 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:42.524019 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89203f2a-8190-444d-8286-059824907331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:42.524596 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89203f2a-8190-444d-8286-059824907331 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:42.524886 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89203f2a-8190-444d-8286-059824907331 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:42.525507 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89203f2a-8190-444d-8286-059824907331 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:42.532431 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89203f2a-8190-444d-8286-059824907331 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:42.533908 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89203f2a-8190-444d-8286-059824907331 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:42.545625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-89203f2a-8190-444d-8286-059824907331 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:18:42.545625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:42.545625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:42.545625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:42.545625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:42.545625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:42.545625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:42.545625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:42.545625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:42.545625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:42.545625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:42.545625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:42.545625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 20:18:42.545625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 20:18:42.545625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 20:18:42.546493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 20:18:42.546493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:42.546493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:42.546493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:42.546493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:42.546493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:42.546493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:42.546493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:42.546493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:42.546493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:42.546493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:42.546493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:42.546493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:42.546493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:42.546493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:42.546493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:42.546493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:42.547362 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 20:18:42.547362 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 20:18:42.547362 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 20:18:42.547362 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 20:18:42.547362 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 20:18:42.547362 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 20:18:42.547362 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:18:42.547362 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:42.547362 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 402/799] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:18:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:42.552470 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229dc7c2-21f1-4f5c-91c5-91c08f4e5b7f None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:42.651938 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229dc7c2-21f1-4f5c-91c5-91c08f4e5b7f None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:42.658673 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:42.687061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9c20a-c684-4112-bca6-859927b06af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:42.687662 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9c20a-c684-4112-bca6-859927b06af7 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:42.687943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9c20a-c684-4112-bca6-859927b06af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:42.688215 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9c20a-c684-4112-bca6-859927b06af7 None admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:42.688966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9c20a-c684-4112-bca6-859927b06af7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:42.689279 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9c20a-c684-4112-bca6-859927b06af7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:42.690749 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9c20a-c684-4112-bca6-859927b06af7 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:42.702101 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 398/800] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Nov 2 20:18:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:18:42.707803 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89203f2a-8190-444d-8286-059824907331 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:42.806171 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89203f2a-8190-444d-8286-059824907331 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:42.840176 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1e9c6-6fcc-4d8f-9ebc-03ccd93ebc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:42.840859 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1e9c6-6fcc-4d8f-9ebc-03ccd93ebc59 None admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:42.841144 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1e9c6-6fcc-4d8f-9ebc-03ccd93ebc59 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:42.841421 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1e9c6-6fcc-4d8f-9ebc-03ccd93ebc59 None admin] PATH_INFO: `/v3/projects/a144e65ce44c44dc99c07a7f5be303b7/users/f906fd11db004026a78eb3d69fa5b298/roles/4432662371b040ef946fb14e2326f333` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:42.843524 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1e9c6-6fcc-4d8f-9ebc-03ccd93ebc59 None admin] RBAC: Authorizing `identity:create_grant(project_id=a144e65ce44c44dc99c07a7f5be303b7, user_id=f906fd11db004026a78eb3d69fa5b298, role_id=4432662371b040ef946fb14e2326f333)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:42.844991 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1e9c6-6fcc-4d8f-9ebc-03ccd93ebc59 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:42.861753 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 403/801] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Nov 2 20:18:42 2022] PUT /identity/v3/projects/a144e65ce44c44dc99c07a7f5be303b7/users/f906fd11db004026a78eb3d69fa5b298/roles/4432662371b040ef946fb14e2326f333 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:18:43.439700 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c3259-3946-4651-a9f5-1c6444d7fd1f None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:43.440240 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c3259-3946-4651-a9f5-1c6444d7fd1f None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:43.440240 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c3259-3946-4651-a9f5-1c6444d7fd1f None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:43.441768 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 399/802] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:43.447344 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dbf4d3-144c-4c2d-8692-b83dd9340b76 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:43.447718 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dbf4d3-144c-4c2d-8692-b83dd9340b76 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:43.447916 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dbf4d3-144c-4c2d-8692-b83dd9340b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:43.466562 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-b5dbf4d3-144c-4c2d-8692-b83dd9340b76 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:43.467755 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-b5dbf4d3-144c-4c2d-8692-b83dd9340b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:43.468907 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285931c1-1838-4c58-8660-e378f07ac160 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:43.469199 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285931c1-1838-4c58-8660-e378f07ac160 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:43.469472 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285931c1-1838-4c58-8660-e378f07ac160 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:43.469912 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:43.470800 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 400/803] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:43.476114 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e809740-b375-4eed-ae36-96a32657ea1b None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:43.476399 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e809740-b375-4eed-ae36-96a32657ea1b None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:43.477255 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e809740-b375-4eed-ae36-96a32657ea1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:43.497168 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-8e809740-b375-4eed-ae36-96a32657ea1b None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:43.498954 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-8e809740-b375-4eed-ae36-96a32657ea1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:43.546675 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 404/804] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:18:43.574800 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 401/805] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 20:18:43.814719 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dbf4d3-144c-4c2d-8692-b83dd9340b76 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:43.843272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e809740-b375-4eed-ae36-96a32657ea1b None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:43.926182 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dbf4d3-144c-4c2d-8692-b83dd9340b76 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:43.952633 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:43.959759 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e809740-b375-4eed-ae36-96a32657ea1b None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:43.964473 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b1d80-3cfd-4ac1-9215-aa4656719b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:43.965139 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b1d80-3cfd-4ac1-9215-aa4656719b67 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:43.965420 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b1d80-3cfd-4ac1-9215-aa4656719b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:43.965695 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b1d80-3cfd-4ac1-9215-aa4656719b67 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:43.966782 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b1d80-3cfd-4ac1-9215-aa4656719b67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:43.968777 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b1d80-3cfd-4ac1-9215-aa4656719b67 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:43.970911 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 405/806] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:18:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:43.976285 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b1d80-3cfd-4ac1-9215-aa4656719b67 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:43.985671 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:43.998570 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10830470-fb0a-4a0f-99db-fc8e5a6f7b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:43.999180 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10830470-fb0a-4a0f-99db-fc8e5a6f7b9c None admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:43.999459 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10830470-fb0a-4a0f-99db-fc8e5a6f7b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:43.999724 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10830470-fb0a-4a0f-99db-fc8e5a6f7b9c None admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:44.000404 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10830470-fb0a-4a0f-99db-fc8e5a6f7b9c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:44.001879 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10830470-fb0a-4a0f-99db-fc8e5a6f7b9c None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:44.009871 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.sql.core [None req-10830470-fb0a-4a0f-99db-fc8e5a6f7b9c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 20:18:44.009871 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 20:18:44.009871 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [parameters: {'id': 'fed4846a8a2f424ea0f0e312f1809bc7', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 02 20:18:44.009871 dv-cinder-862365-5-smb devstack@keystone.service[81403]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81403) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 20:18:44.019759 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-10830470-fb0a-4a0f-99db-fc8e5a6f7b9c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Nov 02 20:18:44.019759 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:44.019759 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 20:18:44.019759 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 20:18:44.019759 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 20:18:44.019759 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 20:18:44.019759 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 20:18:44.019759 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 20:18:44.019759 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 20:18:44.019759 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application conn.query(q) Nov 02 20:18:44.019759 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 20:18:44.019759 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 20:18:44.019759 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 20:18:44.019759 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application result.read() Nov 02 20:18:44.020930 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 20:18:44.020930 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 20:18:44.020930 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 20:18:44.020930 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 20:18:44.020930 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 20:18:44.020930 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 20:18:44.020930 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 20:18:44.020930 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 20:18:44.020930 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 20:18:44.020930 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:44.020930 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 20:18:44.020930 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:44.020930 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:44.020930 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 20:18:44.020930 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 20:18:44.020930 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Nov 02 20:18:44.020930 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return project_ref.to_dict() Nov 02 20:18:44.020930 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 20:18:44.021880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application next(self.gen) Nov 02 20:18:44.021880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 20:18:44.021880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application yield resource Nov 02 20:18:44.021880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 20:18:44.021880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application next(self.gen) Nov 02 20:18:44.021880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 20:18:44.021880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 20:18:44.021880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 20:18:44.021880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 20:18:44.021880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 20:18:44.021880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise self.value Nov 02 20:18:44.021880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 20:18:44.021880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 20:18:44.021880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 20:18:44.021880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application session.commit() Nov 02 20:18:44.021880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 20:18:44.021880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 20:18:44.022745 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 20:18:44.022745 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 20:18:44.022745 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 20:18:44.022745 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self.session.flush() Nov 02 20:18:44.022745 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 20:18:44.022745 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 20:18:44.022745 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 20:18:44.022745 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 20:18:44.022745 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 20:18:44.022745 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application compat.raise_( Nov 02 20:18:44.022745 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 20:18:44.022745 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception Nov 02 20:18:44.022745 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 20:18:44.022745 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 20:18:44.022745 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 20:18:44.022745 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 20:18:44.022745 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 20:18:44.023667 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 20:18:44.023667 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 20:18:44.023667 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 20:18:44.023667 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Nov 02 20:18:44.023667 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application c = connection._execute_20( Nov 02 20:18:44.023667 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 20:18:44.023667 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 20:18:44.023667 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 20:18:44.023667 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 20:18:44.023667 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 20:18:44.023667 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 20:18:44.023667 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 20:18:44.023667 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 20:18:44.023667 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 20:18:44.023667 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 20:18:44.024491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 20:18:44.024491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception Nov 02 20:18:44.024491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 20:18:44.024491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 20:18:44.024491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 20:18:44.024491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 20:18:44.024491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 20:18:44.024491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 20:18:44.024491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 20:18:44.024491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application conn.query(q) Nov 02 20:18:44.024491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 20:18:44.024491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 20:18:44.024491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 20:18:44.024491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application result.read() Nov 02 20:18:44.024491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 20:18:44.024491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 20:18:44.024491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 20:18:44.026750 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 20:18:44.026750 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 20:18:44.026750 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 20:18:44.026750 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 20:18:44.026750 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 20:18:44.026750 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 20:18:44.026750 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 20:18:44.026750 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [parameters: {'id': 'fed4846a8a2f424ea0f0e312f1809bc7', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 02 20:18:44.026750 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 20:18:44.026750 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:44.026750 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 20:18:44.026750 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:44.026750 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:44.026750 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Nov 02 20:18:44.026750 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Nov 02 20:18:44.028619 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 20:18:44.028619 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 20:18:44.028619 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Nov 02 20:18:44.028619 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:44.028619 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 20:18:44.028619 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:44.028619 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:44.028619 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:44.028619 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:44.028619 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:44.028619 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:44.028619 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:44.028619 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:44.028619 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:44.028619 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:44.028619 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:44.028619 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:44.031351 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Nov 02 20:18:44.031351 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Nov 02 20:18:44.031351 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:44.031351 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:44.031351 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Nov 02 20:18:44.031351 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Nov 02 20:18:44.031351 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:44.031351 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:44.031351 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Nov 02 20:18:44.031351 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.Conflict( Nov 02 20:18:44.031351 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Nov 02 20:18:44.031351 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:44.031351 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 402/807] 10.222.0.23 () {60 vars in 1137 bytes} [Wed Nov 2 20:18:43 2022] POST /identity/v3/domains => generated 190 bytes in 179 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Nov 02 20:18:44.031351 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10830470-fb0a-4a0f-99db-fc8e5a6f7b9c None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:44.087526 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b1d80-3cfd-4ac1-9215-aa4656719b67 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:44.124622 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca24ea6-297b-496f-9d46-c8b4a857bf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:44.125231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca24ea6-297b-496f-9d46-c8b4a857bf62 None admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:44.125513 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca24ea6-297b-496f-9d46-c8b4a857bf62 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:44.125784 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca24ea6-297b-496f-9d46-c8b4a857bf62 None admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:44.126421 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca24ea6-297b-496f-9d46-c8b4a857bf62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:44.127844 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca24ea6-297b-496f-9d46-c8b4a857bf62 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:44.137400 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10830470-fb0a-4a0f-99db-fc8e5a6f7b9c None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:44.151331 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 406/808] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Nov 2 20:18:43 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:18:44.175494 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fbe5a-8501-461b-861d-01c53eaa40ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:44.176156 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fbe5a-8501-461b-861d-01c53eaa40ce None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:44.176504 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fbe5a-8501-461b-861d-01c53eaa40ce None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:44.176817 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fbe5a-8501-461b-861d-01c53eaa40ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:44.189885 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54fbe5a-8501-461b-861d-01c53eaa40ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:44.191414 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54fbe5a-8501-461b-861d-01c53eaa40ce None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:44.207641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-f54fbe5a-8501-461b-861d-01c53eaa40ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:44.207641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:44.207641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:44.207641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:44.207641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:44.207641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:44.207641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:44.207641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:44.207641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:44.207641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:44.207641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:44.207641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:44.207641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:18:44.207641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:18:44.207641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:18:44.207641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:18:44.209006 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:44.209006 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:44.209006 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:44.209006 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:44.209006 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:44.209006 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:44.209006 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:44.209006 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:44.209006 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:44.209006 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:44.209006 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:44.209006 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:44.209006 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:44.209006 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:44.209006 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:44.209006 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:44.209006 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:18:44.210085 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:18:44.210085 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:44.210085 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:44.210085 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 403/809] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:18:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:44.216989 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca24ea6-297b-496f-9d46-c8b4a857bf62 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:44.286610 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:44.332401 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca24ea6-297b-496f-9d46-c8b4a857bf62 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:44.369493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194bed7-8e31-42d2-a107-54fb7f90503d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:44.370124 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194bed7-8e31-42d2-a107-54fb7f90503d None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:44.370477 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194bed7-8e31-42d2-a107-54fb7f90503d None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:44.370822 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194bed7-8e31-42d2-a107-54fb7f90503d None admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:44.371546 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194bed7-8e31-42d2-a107-54fb7f90503d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:44.371924 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194bed7-8e31-42d2-a107-54fb7f90503d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:44.373400 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194bed7-8e31-42d2-a107-54fb7f90503d None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:44.386177 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 407/810] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:44.991578 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19a109-bd79-4725-9da5-870a3d0f8fe6 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:44.992138 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19a109-bd79-4725-9da5-870a3d0f8fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:44.992138 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19a109-bd79-4725-9da5-870a3d0f8fe6 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:44.993561 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 404/811] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:44.998617 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c5838-0418-4ea5-b277-851ab1afd39f None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:44.998999 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c5838-0418-4ea5-b277-851ab1afd39f None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:44.999171 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c5838-0418-4ea5-b277-851ab1afd39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:45.017310 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-3b6c5838-0418-4ea5-b277-851ab1afd39f None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:45.018485 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-3b6c5838-0418-4ea5-b277-851ab1afd39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:45.086763 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 408/812] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:18:45.351598 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19a109-bd79-4725-9da5-870a3d0f8fe6 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:45.366671 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:45.462914 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19a109-bd79-4725-9da5-870a3d0f8fe6 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:45.510228 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b5bda-f670-4395-946e-3cf9281aaf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:45.510869 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b5bda-f670-4395-946e-3cf9281aaf5a None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:45.511146 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b5bda-f670-4395-946e-3cf9281aaf5a None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:45.511425 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b5bda-f670-4395-946e-3cf9281aaf5a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:45.522348 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b5bda-f670-4395-946e-3cf9281aaf5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:18:45.527426 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-0e4b5bda-f670-4395-946e-3cf9281aaf5a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 20:18:45.527426 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:45.527426 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:45.527426 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:45.527426 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:45.527426 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:45.527426 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:45.527426 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:45.527426 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:45.527426 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:45.527426 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:45.527426 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:45.527426 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:18:45.527426 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:18:45.527426 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:18:45.527426 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:18:45.528486 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:18:45.528486 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:18:45.528486 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:18:45.528486 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:18:45.528486 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:45.528486 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:45.528486 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:45.528486 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:45.528486 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:45.528486 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:45.528486 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:45.528486 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:45.528486 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:45.528486 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:45.528486 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:45.528486 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:45.529767 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:45.529767 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:45.529767 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:45.529767 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:45.529767 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:18:45.529767 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:18:45.529767 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:18:45.529767 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:18:45.529767 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:18:45.529767 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:18:45.529767 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 20:18:45.529767 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:45.529767 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 405/813] 10.222.0.23 () {56 vars in 1120 bytes} [Wed Nov 2 20:18:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:45.534527 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c5838-0418-4ea5-b277-851ab1afd39f None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:45.588668 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:45.634767 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c5838-0418-4ea5-b277-851ab1afd39f None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:45.668335 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155b9f4-15fb-4aec-aea9-98e3a470e799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:45.668961 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155b9f4-15fb-4aec-aea9-98e3a470e799 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:45.669244 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155b9f4-15fb-4aec-aea9-98e3a470e799 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:45.669514 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155b9f4-15fb-4aec-aea9-98e3a470e799 None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:45.670170 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155b9f4-15fb-4aec-aea9-98e3a470e799 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:45.670471 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155b9f4-15fb-4aec-aea9-98e3a470e799 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:45.671828 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155b9f4-15fb-4aec-aea9-98e3a470e799 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:45.679669 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 409/814] 10.222.0.23 () {56 vars in 1115 bytes} [Wed Nov 2 20:18:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:45.685588 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b5bda-f670-4395-946e-3cf9281aaf5a None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:45.754088 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:45.783809 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b5bda-f670-4395-946e-3cf9281aaf5a None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:45.817401 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e77bd-6920-4e8b-9671-cf14d0e56bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:45.818057 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e77bd-6920-4e8b-9671-cf14d0e56bdf None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:45.818342 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e77bd-6920-4e8b-9671-cf14d0e56bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:45.818617 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e77bd-6920-4e8b-9671-cf14d0e56bdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:45.828784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e77bd-6920-4e8b-9671-cf14d0e56bdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:45.830225 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e77bd-6920-4e8b-9671-cf14d0e56bdf None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:45.844943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-842e77bd-6920-4e8b-9671-cf14d0e56bdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:45.844943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:45.844943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:45.844943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:45.844943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:45.844943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:45.844943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:45.844943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:45.844943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:45.844943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:45.844943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:45.844943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:45.844943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:18:45.844943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:18:45.844943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:18:45.844943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:18:45.846126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:45.846126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:45.846126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:45.846126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:45.846126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:45.846126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:45.846126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:45.846126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:45.846126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:45.846126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:45.846126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:45.846126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:45.846126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:45.846126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:45.846126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:45.846126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:45.846126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:18:45.847574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:18:45.847574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:45.847574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:45.847574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 406/815] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:18:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 20:18:45.851873 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155b9f4-15fb-4aec-aea9-98e3a470e799 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:45.950758 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155b9f4-15fb-4aec-aea9-98e3a470e799 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:45.964634 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:45.985824 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3779b0b-bef6-4cf5-a341-399b1c3fde3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:45.986427 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3779b0b-bef6-4cf5-a341-399b1c3fde3d None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:45.986712 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3779b0b-bef6-4cf5-a341-399b1c3fde3d None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:45.986991 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3779b0b-bef6-4cf5-a341-399b1c3fde3d None admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:45.987639 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3779b0b-bef6-4cf5-a341-399b1c3fde3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:45.987950 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3779b0b-bef6-4cf5-a341-399b1c3fde3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:45.989352 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3779b0b-bef6-4cf5-a341-399b1c3fde3d None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:46.000916 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 410/816] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:46.006573 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e77bd-6920-4e8b-9671-cf14d0e56bdf None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:46.103475 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e77bd-6920-4e8b-9671-cf14d0e56bdf None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:46.125753 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:46.137626 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869b1d1-cffe-43fd-9bb8-e51ba507a2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:46.138257 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869b1d1-cffe-43fd-9bb8-e51ba507a2b7 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:46.138542 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869b1d1-cffe-43fd-9bb8-e51ba507a2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:46.138820 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869b1d1-cffe-43fd-9bb8-e51ba507a2b7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:46.146207 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869b1d1-cffe-43fd-9bb8-e51ba507a2b7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:46.147623 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869b1d1-cffe-43fd-9bb8-e51ba507a2b7 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:46.158501 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-c869b1d1-cffe-43fd-9bb8-e51ba507a2b7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 20:18:46.158501 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:46.158501 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:46.158501 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:46.158501 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:46.158501 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:46.158501 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:46.158501 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:46.158501 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:46.158501 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:46.158501 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:46.158501 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:46.158501 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 20:18:46.158501 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 20:18:46.158501 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 20:18:46.158501 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 20:18:46.159507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:46.159507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:46.159507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 20:18:46.159507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:18:46.159507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 20:18:46.159507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:18:46.159507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:46.159507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:46.159507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:46.159507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:46.159507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:46.159507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:46.159507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:46.159507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:46.159507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:46.159507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:46.159507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:46.159507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:46.160439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:46.160439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:46.160439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 20:18:46.160439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 20:18:46.160439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 20:18:46.160439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 20:18:46.160439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 20:18:46.160439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 20:18:46.160439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 20:18:46.160439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:46.160439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 407/817] 10.222.0.23 () {56 vars in 1093 bytes} [Wed Nov 2 20:18:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:46.165382 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3779b0b-bef6-4cf5-a341-399b1c3fde3d None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:46.266140 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3779b0b-bef6-4cf5-a341-399b1c3fde3d None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:46.301159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966ca49-0fc4-4471-b490-a103641815aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:46.301762 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966ca49-0fc4-4471-b490-a103641815aa None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:46.302041 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966ca49-0fc4-4471-b490-a103641815aa None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:46.302331 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966ca49-0fc4-4471-b490-a103641815aa None admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:46.303034 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966ca49-0fc4-4471-b490-a103641815aa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:46.303339 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966ca49-0fc4-4471-b490-a103641815aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:46.305339 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966ca49-0fc4-4471-b490-a103641815aa None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:46.322142 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 411/818] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Nov 2 20:18:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:46.327854 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869b1d1-cffe-43fd-9bb8-e51ba507a2b7 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:46.367787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a11560-7d21-4688-96d9-d1c7bfaebd15 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:46.368072 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a11560-7d21-4688-96d9-d1c7bfaebd15 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:46.368345 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a11560-7d21-4688-96d9-d1c7bfaebd15 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:46.369693 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 412/819] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:46.374519 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b8ae1-fd8a-43e6-b72b-a575dcac33f5 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:46.374797 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b8ae1-fd8a-43e6-b72b-a575dcac33f5 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:46.375069 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b8ae1-fd8a-43e6-b72b-a575dcac33f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:46.393084 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-853b8ae1-fd8a-43e6-b72b-a575dcac33f5 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:46.394306 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-853b8ae1-fd8a-43e6-b72b-a575dcac33f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:46.420443 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:46.425318 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869b1d1-cffe-43fd-9bb8-e51ba507a2b7 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:46.458703 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337aa677-0c7b-4175-a2c4-b461b539ae52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:46.459300 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337aa677-0c7b-4175-a2c4-b461b539ae52 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:46.459576 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337aa677-0c7b-4175-a2c4-b461b539ae52 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:46.459848 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337aa677-0c7b-4175-a2c4-b461b539ae52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:46.461999 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 413/820] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 20:18:46.509766 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:46.525723 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337aa677-0c7b-4175-a2c4-b461b539ae52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:46.527165 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337aa677-0c7b-4175-a2c4-b461b539ae52 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:46.621796 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 408/821] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Nov 2 20:18:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Nov 02 20:18:46.627464 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b8ae1-fd8a-43e6-b72b-a575dcac33f5 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:46.723873 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b8ae1-fd8a-43e6-b72b-a575dcac33f5 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:46.731837 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337aa677-0c7b-4175-a2c4-b461b539ae52 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:46.757201 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925d9a0-4335-4577-a983-f631b8b299d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:46.757855 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925d9a0-4335-4577-a983-f631b8b299d9 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:46.758132 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925d9a0-4335-4577-a983-f631b8b299d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:46.758412 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925d9a0-4335-4577-a983-f631b8b299d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:46.768433 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925d9a0-4335-4577-a983-f631b8b299d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:46.769970 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925d9a0-4335-4577-a983-f631b8b299d9 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:46.784728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-2925d9a0-4335-4577-a983-f631b8b299d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:46.784728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:46.784728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:46.784728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:46.784728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:46.784728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:46.784728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:46.784728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:46.784728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:46.784728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:46.784728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:46.784728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:46.784728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:18:46.784728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:18:46.784728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:18:46.784728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:18:46.785651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:46.785651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:46.785651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:46.785651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:46.785651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:46.785651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:46.785651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:46.785651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:46.785651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:46.785651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:46.785651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:46.785651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:46.785651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:46.785651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:46.785651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:46.785651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:46.785651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:18:46.786705 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:18:46.786705 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:18:46.786705 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:46.786705 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 414/822] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:18:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:46.791858 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925d9a0-4335-4577-a983-f631b8b299d9 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:46.808351 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:46.815723 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:46.831887 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337aa677-0c7b-4175-a2c4-b461b539ae52 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:46.865680 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92b087-a496-44f1-8651-272586538e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:46.866338 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92b087-a496-44f1-8651-272586538e76 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:46.866616 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92b087-a496-44f1-8651-272586538e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:46.866890 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92b087-a496-44f1-8651-272586538e76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:46.877122 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92b087-a496-44f1-8651-272586538e76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:18:46.881842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-8e92b087-a496-44f1-8651-272586538e76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:18:46.881842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:46.881842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:46.881842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:46.881842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:46.881842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:46.881842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:46.881842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:46.881842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:46.881842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:46.881842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:46.881842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:46.881842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:18:46.881842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:18:46.881842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:18:46.881842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:18:46.882882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:18:46.882882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:18:46.882882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:18:46.882882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:18:46.882882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:46.882882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:46.882882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:46.882882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:46.882882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:46.882882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:46.882882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:46.882882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:46.882882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:46.882882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:46.882882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:46.882882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:46.883730 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:46.883730 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:46.883730 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:46.883730 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:46.883730 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:18:46.883730 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:18:46.883730 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:18:46.883730 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:18:46.883730 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:18:46.883730 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:18:46.883730 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:18:46.883730 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:18:46.883730 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 409/823] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Nov 2 20:18:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 20:18:46.888975 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92b087-a496-44f1-8651-272586538e76 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:46.893728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925d9a0-4335-4577-a983-f631b8b299d9 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:46.927354 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0fb0f-3100-453e-a047-7e5f9a67e945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:46.928371 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0fb0f-3100-453e-a047-7e5f9a67e945 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:46.928698 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0fb0f-3100-453e-a047-7e5f9a67e945 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:46.928980 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0fb0f-3100-453e-a047-7e5f9a67e945 None admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:46.930486 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0fb0f-3100-453e-a047-7e5f9a67e945 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:46.930805 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0fb0f-3100-453e-a047-7e5f9a67e945 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:46.932485 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0fb0f-3100-453e-a047-7e5f9a67e945 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:46.944266 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 415/824] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:18:46.949877 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0fb0f-3100-453e-a047-7e5f9a67e945 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:46.988877 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92b087-a496-44f1-8651-272586538e76 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:47.021840 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c3a22-f1b2-447b-a648-f678ae03537f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:47.022429 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c3a22-f1b2-447b-a648-f678ae03537f None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:47.022956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c3a22-f1b2-447b-a648-f678ae03537f None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:47.023082 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:47.023457 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c3a22-f1b2-447b-a648-f678ae03537f None admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:47.023543 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c3a22-f1b2-447b-a648-f678ae03537f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:47.023903 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c3a22-f1b2-447b-a648-f678ae03537f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:47.025387 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c3a22-f1b2-447b-a648-f678ae03537f None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:47.033383 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 410/825] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:18:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:47.039667 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c3a22-f1b2-447b-a648-f678ae03537f None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:47.049545 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:47.049677 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0fb0f-3100-453e-a047-7e5f9a67e945 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:47.083797 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6553097-1fc8-46e8-97dd-b0282a95a9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:47.084421 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6553097-1fc8-46e8-97dd-b0282a95a9f9 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:47.084731 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6553097-1fc8-46e8-97dd-b0282a95a9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:47.085009 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6553097-1fc8-46e8-97dd-b0282a95a9f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:47.091695 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6553097-1fc8-46e8-97dd-b0282a95a9f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:47.093170 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6553097-1fc8-46e8-97dd-b0282a95a9f9 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:47.104430 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-c6553097-1fc8-46e8-97dd-b0282a95a9f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:18:47.104430 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:47.104430 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:47.104430 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:47.104430 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:47.104430 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:47.104430 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:47.104430 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:47.104430 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:47.104430 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:47.104430 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:47.104430 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:47.104430 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 20:18:47.104430 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 20:18:47.104430 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 20:18:47.105592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 20:18:47.105592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:47.105592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:47.105592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:47.105592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:47.105592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:47.105592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:47.105592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:47.105592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:47.105592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:47.105592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:47.105592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:47.105592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:47.105592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:47.105592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:47.105592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:47.105592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:47.106499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 20:18:47.106499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 20:18:47.106499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 20:18:47.106499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 20:18:47.106499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 20:18:47.106499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 20:18:47.106499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:18:47.106499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:47.110501 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 416/826] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:18:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 20:18:47.111310 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6553097-1fc8-46e8-97dd-b0282a95a9f9 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:47.141247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c3a22-f1b2-447b-a648-f678ae03537f None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:47.174853 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d962cbe-bc45-4f0f-8214-bb962ded299a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:47.175479 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d962cbe-bc45-4f0f-8214-bb962ded299a None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:47.175762 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d962cbe-bc45-4f0f-8214-bb962ded299a None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:47.176040 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d962cbe-bc45-4f0f-8214-bb962ded299a None admin] PATH_INFO: `/v3/users/9e0dadcb460c4362a331a939ddd2125e` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:47.190922 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d962cbe-bc45-4f0f-8214-bb962ded299a None admin] RBAC: Authorizing `identity:get_user(user_id=9e0dadcb460c4362a331a939ddd2125e)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:47.192332 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d962cbe-bc45-4f0f-8214-bb962ded299a None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:47.194138 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 411/827] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:18:47 2022] GET /identity/v3/users/9e0dadcb460c4362a331a939ddd2125e => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:18:47.199633 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d962cbe-bc45-4f0f-8214-bb962ded299a None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:47.213198 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6553097-1fc8-46e8-97dd-b0282a95a9f9 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:47.246575 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d62678-3e8d-4b3c-9131-1af7c9389035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:47.247181 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d62678-3e8d-4b3c-9131-1af7c9389035 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:47.247464 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d62678-3e8d-4b3c-9131-1af7c9389035 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:47.247741 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d62678-3e8d-4b3c-9131-1af7c9389035 None admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:47.248427 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d62678-3e8d-4b3c-9131-1af7c9389035 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:47.248765 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d62678-3e8d-4b3c-9131-1af7c9389035 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:47.250194 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d62678-3e8d-4b3c-9131-1af7c9389035 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:47.251748 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:47.263188 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:47.263492 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 417/828] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Nov 2 20:18:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:18:47.269350 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d62678-3e8d-4b3c-9131-1af7c9389035 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:47.300960 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d962cbe-bc45-4f0f-8214-bb962ded299a None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:47.334494 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64b5c0-98de-47b4-8be6-9ce65218be2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:47.335122 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64b5c0-98de-47b4-8be6-9ce65218be2f None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:47.335403 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64b5c0-98de-47b4-8be6-9ce65218be2f None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:47.335679 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64b5c0-98de-47b4-8be6-9ce65218be2f None admin] PATH_INFO: `/v3/projects/5a162c81446140359b2daacbb6921882` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:47.336885 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64b5c0-98de-47b4-8be6-9ce65218be2f None admin] RBAC: Authorizing `identity:get_project(project_id=5a162c81446140359b2daacbb6921882)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:47.338345 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64b5c0-98de-47b4-8be6-9ce65218be2f None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:47.339962 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 412/829] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Nov 2 20:18:47 2022] GET /identity/v3/projects/5a162c81446140359b2daacbb6921882 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:18:47.345772 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64b5c0-98de-47b4-8be6-9ce65218be2f None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:47.371254 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d62678-3e8d-4b3c-9131-1af7c9389035 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:47.404320 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f92e9-5af7-4c86-9de4-a3362904f460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:47.404944 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f92e9-5af7-4c86-9de4-a3362904f460 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:47.405226 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f92e9-5af7-4c86-9de4-a3362904f460 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:47.405499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f92e9-5af7-4c86-9de4-a3362904f460 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:47.406216 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f92e9-5af7-4c86-9de4-a3362904f460 None admin] RBAC: Adding query filter params (role.id=4432662371b040ef946fb14e2326f333, scope.project.id=a144e65ce44c44dc99c07a7f5be303b7, user.id=f906fd11db004026a78eb3d69fa5b298) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:47.406528 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f92e9-5af7-4c86-9de4-a3362904f460 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:47.407954 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f92e9-5af7-4c86-9de4-a3362904f460 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:47.413539 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 418/830] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Nov 2 20:18:47 2022] GET /identity/v3/role_assignments?user.id=f906fd11db004026a78eb3d69fa5b298&scope.project.id=a144e65ce44c44dc99c07a7f5be303b7&role.id=4432662371b040ef946fb14e2326f333 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:18:47.449275 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64b5c0-98de-47b4-8be6-9ce65218be2f None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:47.480444 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:47.486385 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d2add-7789-41c1-80d8-7a0aaee9813d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:47.487072 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d2add-7789-41c1-80d8-7a0aaee9813d None admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:47.487359 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d2add-7789-41c1-80d8-7a0aaee9813d None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:47.487639 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d2add-7789-41c1-80d8-7a0aaee9813d None admin] PATH_INFO: `/v3/projects/5a162c81446140359b2daacbb6921882/users/9e0dadcb460c4362a331a939ddd2125e/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:47.489647 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d2add-7789-41c1-80d8-7a0aaee9813d None admin] RBAC: Authorizing `identity:create_grant(project_id=5a162c81446140359b2daacbb6921882, user_id=9e0dadcb460c4362a331a939ddd2125e, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:47.491110 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d2add-7789-41c1-80d8-7a0aaee9813d None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:47.505893 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 413/831] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Nov 2 20:18:47 2022] PUT /identity/v3/projects/5a162c81446140359b2daacbb6921882/users/9e0dadcb460c4362a331a939ddd2125e/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:18:49.623324 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698d1a0-7bc4-4f2f-b69c-64ff4976c0a6 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:49.623849 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698d1a0-7bc4-4f2f-b69c-64ff4976c0a6 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:49.623849 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698d1a0-7bc4-4f2f-b69c-64ff4976c0a6 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:49.625225 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 419/832] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:49.630467 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950ebf0-8dff-4be5-8f1f-f158b9f63da8 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:49.630866 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950ebf0-8dff-4be5-8f1f-f158b9f63da8 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:49.631027 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950ebf0-8dff-4be5-8f1f-f158b9f63da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:49.649962 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-b950ebf0-8dff-4be5-8f1f-f158b9f63da8 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:49.651124 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-b950ebf0-8dff-4be5-8f1f-f158b9f63da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:49.714551 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 414/833] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:18:49.980686 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698d1a0-7bc4-4f2f-b69c-64ff4976c0a6 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:50.038586 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:50.080502 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698d1a0-7bc4-4f2f-b69c-64ff4976c0a6 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:50.114075 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad49dc0-3056-45f3-a249-0756dbf96c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:50.114677 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad49dc0-3056-45f3-a249-0756dbf96c37 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:50.114956 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad49dc0-3056-45f3-a249-0756dbf96c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:50.115226 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad49dc0-3056-45f3-a249-0756dbf96c37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:50.125546 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad49dc0-3056-45f3-a249-0756dbf96c37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:18:50.130240 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-aad49dc0-3056-45f3-a249-0756dbf96c37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:18:50.130240 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:18:50.130240 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:18:50.130240 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:18:50.130240 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:18:50.130240 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:18:50.130240 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:18:50.130240 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:18:50.130240 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:18:50.130240 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:18:50.130240 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:18:50.130240 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:18:50.130240 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:18:50.130240 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:18:50.130240 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:18:50.130240 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:18:50.131297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:18:50.131297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:18:50.131297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:18:50.131297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:18:50.131297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:18:50.131297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:18:50.131297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:18:50.131297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:18:50.131297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:18:50.131297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:18:50.131297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:18:50.131297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:18:50.131297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:18:50.131297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:18:50.131297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:18:50.131297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:18:50.132364 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:18:50.132364 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:18:50.132364 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:18:50.132364 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:18:50.132364 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:18:50.132364 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:18:50.132364 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:18:50.132364 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:18:50.132364 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:18:50.132364 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:18:50.132364 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:18:50.132364 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:18:50.132364 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 420/834] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Nov 2 20:18:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:18:50.137514 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950ebf0-8dff-4be5-8f1f-f158b9f63da8 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:50.233838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950ebf0-8dff-4be5-8f1f-f158b9f63da8 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:50.255127 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:50.269663 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b962c62-1571-435f-9aba-bfa07415cc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:50.270273 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b962c62-1571-435f-9aba-bfa07415cc19 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:50.270557 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b962c62-1571-435f-9aba-bfa07415cc19 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:50.270833 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b962c62-1571-435f-9aba-bfa07415cc19 None admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:50.271499 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b962c62-1571-435f-9aba-bfa07415cc19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:50.271809 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b962c62-1571-435f-9aba-bfa07415cc19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:50.273361 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b962c62-1571-435f-9aba-bfa07415cc19 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:50.281865 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 415/835] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:18:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:50.287777 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad49dc0-3056-45f3-a249-0756dbf96c37 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:50.383371 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad49dc0-3056-45f3-a249-0756dbf96c37 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:50.400164 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:50.417009 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ea0b4-fbc2-4b1a-b4b1-39d4037959ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:50.417660 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ea0b4-fbc2-4b1a-b4b1-39d4037959ab None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:50.417946 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ea0b4-fbc2-4b1a-b4b1-39d4037959ab None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:50.418218 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ea0b4-fbc2-4b1a-b4b1-39d4037959ab None admin] PATH_INFO: `/v3/users/9e0dadcb460c4362a331a939ddd2125e` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:50.419330 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ea0b4-fbc2-4b1a-b4b1-39d4037959ab None admin] RBAC: Authorizing `identity:get_user(user_id=9e0dadcb460c4362a331a939ddd2125e)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:50.420812 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ea0b4-fbc2-4b1a-b4b1-39d4037959ab None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:50.422393 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 421/836] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:18:50 2022] GET /identity/v3/users/9e0dadcb460c4362a331a939ddd2125e => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:50.428053 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b962c62-1571-435f-9aba-bfa07415cc19 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:50.525455 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b962c62-1571-435f-9aba-bfa07415cc19 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:50.557941 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f3a5f-c8f7-4c6c-a0b5-bb989e8d60ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:50.558539 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f3a5f-c8f7-4c6c-a0b5-bb989e8d60ae None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:50.559072 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f3a5f-c8f7-4c6c-a0b5-bb989e8d60ae None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:50.559347 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f3a5f-c8f7-4c6c-a0b5-bb989e8d60ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:50.608510 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:50.623748 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f3a5f-c8f7-4c6c-a0b5-bb989e8d60ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:50.625316 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f3a5f-c8f7-4c6c-a0b5-bb989e8d60ae None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:50.718931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 416/837] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Nov 2 20:18:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 20:18:50.724844 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ea0b4-fbc2-4b1a-b4b1-39d4037959ab None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:50.821822 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ea0b4-fbc2-4b1a-b4b1-39d4037959ab None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:50.854162 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb018782-b460-48f8-93bf-c355f9453472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:50.854773 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb018782-b460-48f8-93bf-c355f9453472 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:50.855052 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb018782-b460-48f8-93bf-c355f9453472 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:50.855328 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb018782-b460-48f8-93bf-c355f9453472 None admin] PATH_INFO: `/v3/projects/5a162c81446140359b2daacbb6921882` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:50.856422 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb018782-b460-48f8-93bf-c355f9453472 None admin] RBAC: Authorizing `identity:get_project(project_id=5a162c81446140359b2daacbb6921882)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:50.857884 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb018782-b460-48f8-93bf-c355f9453472 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:50.859463 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 422/838] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Nov 2 20:18:50 2022] GET /identity/v3/projects/5a162c81446140359b2daacbb6921882 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:50.865413 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f3a5f-c8f7-4c6c-a0b5-bb989e8d60ae None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:50.945839 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:50.961384 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f3a5f-c8f7-4c6c-a0b5-bb989e8d60ae None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:50.993822 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27717dc2-8bd3-402f-9210-04a4ef3cde9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:50.994415 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27717dc2-8bd3-402f-9210-04a4ef3cde9d None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:50.994698 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27717dc2-8bd3-402f-9210-04a4ef3cde9d None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:50.994975 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27717dc2-8bd3-402f-9210-04a4ef3cde9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:50.995690 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27717dc2-8bd3-402f-9210-04a4ef3cde9d None admin] RBAC: Adding query filter params (role.id=bca2e686aa5e4fdc844fc679a4c41939, scope.project.id=5a162c81446140359b2daacbb6921882, user.id=9e0dadcb460c4362a331a939ddd2125e) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:18:50.996002 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27717dc2-8bd3-402f-9210-04a4ef3cde9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:50.997443 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27717dc2-8bd3-402f-9210-04a4ef3cde9d None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:51.002959 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 417/839] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Nov 2 20:18:50 2022] GET /identity/v3/role_assignments?user.id=9e0dadcb460c4362a331a939ddd2125e&scope.project.id=5a162c81446140359b2daacbb6921882&role.id=bca2e686aa5e4fdc844fc679a4c41939 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:53.116098 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a91fc-a27a-4e73-8676-d3fddc396c7d None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:53.116673 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a91fc-a27a-4e73-8676-d3fddc396c7d None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:53.116673 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a91fc-a27a-4e73-8676-d3fddc396c7d None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:53.118564 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 423/840] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:53.123854 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc0c07-a577-4981-8093-41dc26eecc30 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:53.124268 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc0c07-a577-4981-8093-41dc26eecc30 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:53.124378 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc0c07-a577-4981-8093-41dc26eecc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:53.142063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-6edc0c07-a577-4981-8093-41dc26eecc30 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:53.143227 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-6edc0c07-a577-4981-8093-41dc26eecc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:53.206663 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 418/841] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:18:53.474219 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a91fc-a27a-4e73-8676-d3fddc396c7d None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:53.529579 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:53.574529 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a91fc-a27a-4e73-8676-d3fddc396c7d None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:53.607567 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb698ea-41e5-4541-94b4-683025ff21bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:53.608176 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb698ea-41e5-4541-94b4-683025ff21bb None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:53.608456 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb698ea-41e5-4541-94b4-683025ff21bb None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:53.608754 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb698ea-41e5-4541-94b4-683025ff21bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:53.609840 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb698ea-41e5-4541-94b4-683025ff21bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:53.611263 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb698ea-41e5-4541-94b4-683025ff21bb None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:53.612833 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 424/842] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:18:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:53.618612 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc0c07-a577-4981-8093-41dc26eecc30 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:53.691928 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:53.713588 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc0c07-a577-4981-8093-41dc26eecc30 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:53.745610 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e75881-3523-4b57-b71d-f9a80a2c87da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:53.746150 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e75881-3523-4b57-b71d-f9a80a2c87da None admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:53.746426 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e75881-3523-4b57-b71d-f9a80a2c87da None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:53.746695 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e75881-3523-4b57-b71d-f9a80a2c87da None admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:53.747344 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e75881-3523-4b57-b71d-f9a80a2c87da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:53.748770 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e75881-3523-4b57-b71d-f9a80a2c87da None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:53.769521 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 419/843] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Nov 2 20:18:53 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:18:55.895547 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd11a8-dda5-45d9-aab7-177a042a6a1a None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:55.896089 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd11a8-dda5-45d9-aab7-177a042a6a1a None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:55.896089 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd11a8-dda5-45d9-aab7-177a042a6a1a None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:55.897441 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 425/844] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:55.903102 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac062219-b03c-42ca-b652-cd68e08e07c6 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:55.903524 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac062219-b03c-42ca-b652-cd68e08e07c6 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:55.903650 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac062219-b03c-42ca-b652-cd68e08e07c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:55.921962 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-ac062219-b03c-42ca-b652-cd68e08e07c6 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:55.923128 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-ac062219-b03c-42ca-b652-cd68e08e07c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:55.986945 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 420/845] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:18:56.253200 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd11a8-dda5-45d9-aab7-177a042a6a1a None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:56.350814 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd11a8-dda5-45d9-aab7-177a042a6a1a None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:56.372187 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:56.384178 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b49b4-198b-465f-abbb-bb5de7341bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:56.384823 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b49b4-198b-465f-abbb-bb5de7341bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:56.385101 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b49b4-198b-465f-abbb-bb5de7341bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:56.385370 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b49b4-198b-465f-abbb-bb5de7341bb1 None admin] PATH_INFO: `/v3/roles/c415cff16e364aa9a9d40b79936ab4a9` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:56.386727 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b49b4-198b-465f-abbb-bb5de7341bb1 None admin] RBAC: Authorizing `identity:get_role(role_id=c415cff16e364aa9a9d40b79936ab4a9)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:56.388080 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b49b4-198b-465f-abbb-bb5de7341bb1 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:56.389402 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 426/846] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:18:56 2022] GET /identity/v3/roles/c415cff16e364aa9a9d40b79936ab4a9 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:56.395248 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac062219-b03c-42ca-b652-cd68e08e07c6 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:56.455342 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:56.491183 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac062219-b03c-42ca-b652-cd68e08e07c6 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:56.524120 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367f6a8-33d9-4a79-b722-e3ca55073ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:56.524808 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367f6a8-33d9-4a79-b722-e3ca55073ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:56.525087 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367f6a8-33d9-4a79-b722-e3ca55073ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:56.525439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367f6a8-33d9-4a79-b722-e3ca55073ae9 None admin] PATH_INFO: `/v3/users/acf33b20c0eb4fcc91c36d2f324374ac` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:56.538146 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e367f6a8-33d9-4a79-b722-e3ca55073ae9 None admin] RBAC: Authorizing `identity:get_user(user_id=acf33b20c0eb4fcc91c36d2f324374ac)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:56.539572 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e367f6a8-33d9-4a79-b722-e3ca55073ae9 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:56.541168 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 421/847] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:18:56 2022] GET /identity/v3/users/acf33b20c0eb4fcc91c36d2f324374ac => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:56.546961 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b49b4-198b-465f-abbb-bb5de7341bb1 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:56.643775 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b49b4-198b-465f-abbb-bb5de7341bb1 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:56.675801 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c242a5-8165-4389-b5ea-21e68c3c6080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:56.676418 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c242a5-8165-4389-b5ea-21e68c3c6080 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:56.676730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c242a5-8165-4389-b5ea-21e68c3c6080 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:56.677008 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c242a5-8165-4389-b5ea-21e68c3c6080 None admin] PATH_INFO: `/v3/projects/5a162c81446140359b2daacbb6921882` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:56.678104 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c242a5-8165-4389-b5ea-21e68c3c6080 None admin] RBAC: Authorizing `identity:get_project(project_id=5a162c81446140359b2daacbb6921882)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:56.679533 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c242a5-8165-4389-b5ea-21e68c3c6080 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:56.681674 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 427/848] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Nov 2 20:18:56 2022] GET /identity/v3/projects/5a162c81446140359b2daacbb6921882 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:56.687893 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367f6a8-33d9-4a79-b722-e3ca55073ae9 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:56.782154 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367f6a8-33d9-4a79-b722-e3ca55073ae9 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:56.803603 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:56.815790 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1a005-e730-4d88-933f-729cc1b9b540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:56.816428 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1a005-e730-4d88-933f-729cc1b9b540 None admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:56.816745 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1a005-e730-4d88-933f-729cc1b9b540 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:56.817017 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1a005-e730-4d88-933f-729cc1b9b540 None admin] PATH_INFO: `/v3/projects/5a162c81446140359b2daacbb6921882/users/acf33b20c0eb4fcc91c36d2f324374ac/roles/c415cff16e364aa9a9d40b79936ab4a9` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:56.819089 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b1a005-e730-4d88-933f-729cc1b9b540 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a162c81446140359b2daacbb6921882, user_id=acf33b20c0eb4fcc91c36d2f324374ac, role_id=c415cff16e364aa9a9d40b79936ab4a9)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:56.820527 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b1a005-e730-4d88-933f-729cc1b9b540 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:56.832968 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 422/849] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Nov 2 20:18:56 2022] PUT /identity/v3/projects/5a162c81446140359b2daacbb6921882/users/acf33b20c0eb4fcc91c36d2f324374ac/roles/c415cff16e364aa9a9d40b79936ab4a9 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:18:58.916583 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f920694-2869-43e5-99bb-c4832617e532 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:58.917124 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f920694-2869-43e5-99bb-c4832617e532 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:58.917217 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f920694-2869-43e5-99bb-c4832617e532 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:58.918555 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 428/850] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:18:58.923865 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed41160-8e74-4c9a-81cb-aaa7621d1d6d None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:58.924280 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed41160-8e74-4c9a-81cb-aaa7621d1d6d None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:58.924410 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed41160-8e74-4c9a-81cb-aaa7621d1d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:58.942820 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-aed41160-8e74-4c9a-81cb-aaa7621d1d6d None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:18:58.943985 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-aed41160-8e74-4c9a-81cb-aaa7621d1d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:18:59.006927 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 423/851] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:18:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:18:59.274242 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f920694-2869-43e5-99bb-c4832617e532 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:59.332256 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:59.374491 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f920694-2869-43e5-99bb-c4832617e532 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:59.407507 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d73f1b-d1b7-4585-9d13-7813baafb9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:59.408117 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d73f1b-d1b7-4585-9d13-7813baafb9fc None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:59.408394 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d73f1b-d1b7-4585-9d13-7813baafb9fc None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:59.408698 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d73f1b-d1b7-4585-9d13-7813baafb9fc None admin] PATH_INFO: `/v3/roles/c415cff16e364aa9a9d40b79936ab4a9` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:59.410069 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d73f1b-d1b7-4585-9d13-7813baafb9fc None admin] RBAC: Authorizing `identity:get_role(role_id=c415cff16e364aa9a9d40b79936ab4a9)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:59.411442 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d73f1b-d1b7-4585-9d13-7813baafb9fc None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:59.412752 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 429/852] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:18:59 2022] GET /identity/v3/roles/c415cff16e364aa9a9d40b79936ab4a9 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:59.419063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed41160-8e74-4c9a-81cb-aaa7621d1d6d None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:59.513291 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed41160-8e74-4c9a-81cb-aaa7621d1d6d None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:59.526080 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:59.546811 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803938f4-b803-4072-9172-f8f132bbd1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:59.547439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803938f4-b803-4072-9172-f8f132bbd1dd None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:59.547719 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803938f4-b803-4072-9172-f8f132bbd1dd None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:59.547996 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803938f4-b803-4072-9172-f8f132bbd1dd None admin] PATH_INFO: `/v3/users/acf33b20c0eb4fcc91c36d2f324374ac` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:59.549136 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803938f4-b803-4072-9172-f8f132bbd1dd None admin] RBAC: Authorizing `identity:get_user(user_id=acf33b20c0eb4fcc91c36d2f324374ac)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:59.550562 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803938f4-b803-4072-9172-f8f132bbd1dd None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:59.552122 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 424/853] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:18:59 2022] GET /identity/v3/users/acf33b20c0eb4fcc91c36d2f324374ac => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:59.558387 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d73f1b-d1b7-4585-9d13-7813baafb9fc None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:59.655626 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d73f1b-d1b7-4585-9d13-7813baafb9fc None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:59.680010 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:18:59.689057 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e057a-35fe-49f6-9641-c2422610714f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:59.689649 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e057a-35fe-49f6-9641-c2422610714f None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:59.689931 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e057a-35fe-49f6-9641-c2422610714f None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:59.690206 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e057a-35fe-49f6-9641-c2422610714f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:59.754186 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e057a-35fe-49f6-9641-c2422610714f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:59.755616 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e057a-35fe-49f6-9641-c2422610714f None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:59.849309 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 430/854] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Nov 2 20:18:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 20:18:59.855204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803938f4-b803-4072-9172-f8f132bbd1dd None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:18:59.949919 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803938f4-b803-4072-9172-f8f132bbd1dd None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:18:59.981997 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae80e68-236f-4278-91e5-3a75ff58f7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:18:59.982610 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae80e68-236f-4278-91e5-3a75ff58f7c8 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:18:59.982893 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae80e68-236f-4278-91e5-3a75ff58f7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:18:59.983168 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae80e68-236f-4278-91e5-3a75ff58f7c8 None admin] PATH_INFO: `/v3/projects/5a162c81446140359b2daacbb6921882` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:18:59.984270 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae80e68-236f-4278-91e5-3a75ff58f7c8 None admin] RBAC: Authorizing `identity:get_project(project_id=5a162c81446140359b2daacbb6921882)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:18:59.985707 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae80e68-236f-4278-91e5-3a75ff58f7c8 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:18:59.987286 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 425/855] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Nov 2 20:18:59 2022] GET /identity/v3/projects/5a162c81446140359b2daacbb6921882 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:18:59.993441 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e057a-35fe-49f6-9641-c2422610714f None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:19:00.019583 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:19:00.093240 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e057a-35fe-49f6-9641-c2422610714f None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:19:00.125499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc90eba-789b-4ac4-963c-31c8be60d31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:19:00.126035 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc90eba-789b-4ac4-963c-31c8be60d31a None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:00.126318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc90eba-789b-4ac4-963c-31c8be60d31a None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:00.126590 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc90eba-789b-4ac4-963c-31c8be60d31a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:00.127303 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc90eba-789b-4ac4-963c-31c8be60d31a None admin] RBAC: Adding query filter params (role.id=c415cff16e364aa9a9d40b79936ab4a9, scope.project.id=5a162c81446140359b2daacbb6921882, user.id=acf33b20c0eb4fcc91c36d2f324374ac) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:19:00.127613 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc90eba-789b-4ac4-963c-31c8be60d31a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:19:00.129099 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc90eba-789b-4ac4-963c-31c8be60d31a None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:19:00.135134 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 431/856] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Nov 2 20:18:59 2022] GET /identity/v3/role_assignments?user.id=acf33b20c0eb4fcc91c36d2f324374ac&scope.project.id=5a162c81446140359b2daacbb6921882&role.id=c415cff16e364aa9a9d40b79936ab4a9 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:19:02.234276 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0260a-957b-4216-abe8-e30a25ae74ec None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:02.234805 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0260a-957b-4216-abe8-e30a25ae74ec None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:02.234805 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0260a-957b-4216-abe8-e30a25ae74ec None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:02.236154 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 426/857] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:19:02.241244 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3ce99-f008-47bc-bc79-97293b81996f None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:02.241634 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3ce99-f008-47bc-bc79-97293b81996f None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:02.241804 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3ce99-f008-47bc-bc79-97293b81996f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:02.260175 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-30f3ce99-f008-47bc-bc79-97293b81996f None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:19:02.261359 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-30f3ce99-f008-47bc-bc79-97293b81996f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:19:02.324795 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 432/858] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:19:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:19:02.588537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0260a-957b-4216-abe8-e30a25ae74ec None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:19:02.637208 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:19:02.688947 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0260a-957b-4216-abe8-e30a25ae74ec None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:19:02.721761 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81c4b1-8f82-44c1-bfa8-7373ced52241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:19:02.722376 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81c4b1-8f82-44c1-bfa8-7373ced52241 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:02.722658 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81c4b1-8f82-44c1-bfa8-7373ced52241 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:02.722934 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81c4b1-8f82-44c1-bfa8-7373ced52241 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:02.724025 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81c4b1-8f82-44c1-bfa8-7373ced52241 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:19:02.725464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81c4b1-8f82-44c1-bfa8-7373ced52241 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:19:02.727545 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 427/859] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:19:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:19:02.733346 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3ce99-f008-47bc-bc79-97293b81996f None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:19:02.753606 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:19:02.828993 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3ce99-f008-47bc-bc79-97293b81996f None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:19:02.861360 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbac806-5e9f-40aa-82c7-b4c0497d87c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:19:02.861950 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbac806-5e9f-40aa-82c7-b4c0497d87c7 None admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:02.862233 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbac806-5e9f-40aa-82c7-b4c0497d87c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:02.862509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbac806-5e9f-40aa-82c7-b4c0497d87c7 None admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:02.863162 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbac806-5e9f-40aa-82c7-b4c0497d87c7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:19:02.864616 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbac806-5e9f-40aa-82c7-b4c0497d87c7 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:19:02.889898 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 433/860] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Nov 2 20:19:02 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:19:05.037091 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5b0e8-4600-41bb-ba05-e35f7bf86a5f None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:05.037674 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5b0e8-4600-41bb-ba05-e35f7bf86a5f None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:05.037674 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5b0e8-4600-41bb-ba05-e35f7bf86a5f None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:05.039506 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 428/861] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:19:05.044659 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf716ec-bd80-4b9e-a9a0-a92b9e133de3 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:05.045097 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf716ec-bd80-4b9e-a9a0-a92b9e133de3 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:05.045198 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf716ec-bd80-4b9e-a9a0-a92b9e133de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:05.064616 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-eaf716ec-bd80-4b9e-a9a0-a92b9e133de3 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:19:05.065793 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-eaf716ec-bd80-4b9e-a9a0-a92b9e133de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:19:05.129614 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 434/862] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:19:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:19:05.395751 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5b0e8-4600-41bb-ba05-e35f7bf86a5f None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:19:05.493821 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5b0e8-4600-41bb-ba05-e35f7bf86a5f None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:19:05.509853 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:19:05.527104 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b3431-9fd9-44e1-bbd1-435800627903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:19:05.527734 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b3431-9fd9-44e1-bbd1-435800627903 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:05.528009 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b3431-9fd9-44e1-bbd1-435800627903 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:05.528281 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b3431-9fd9-44e1-bbd1-435800627903 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:05.529393 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b3431-9fd9-44e1-bbd1-435800627903 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:19:05.530811 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b3431-9fd9-44e1-bbd1-435800627903 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:19:05.532356 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 429/863] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:19:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:19:05.538037 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf716ec-bd80-4b9e-a9a0-a92b9e133de3 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:19:05.540178 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:19:05.635531 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf716ec-bd80-4b9e-a9a0-a92b9e133de3 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:19:05.667691 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfe54a-75d2-49c7-982e-4c87954d45e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:19:05.668228 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfe54a-75d2-49c7-982e-4c87954d45e4 None admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:05.668510 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfe54a-75d2-49c7-982e-4c87954d45e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:05.668817 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfe54a-75d2-49c7-982e-4c87954d45e4 None admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:05.669469 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfe54a-75d2-49c7-982e-4c87954d45e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:19:05.670894 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfe54a-75d2-49c7-982e-4c87954d45e4 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:19:05.691517 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 435/864] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Nov 2 20:19:05 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:19:07.832390 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c469fde-3aed-4537-805a-4e9a766ba4de None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:07.832977 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c469fde-3aed-4537-805a-4e9a766ba4de None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:07.832977 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c469fde-3aed-4537-805a-4e9a766ba4de None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:07.834300 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 430/865] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:19:07.839434 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3cce63-6276-44f7-93dd-c9629d7e13b7 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:07.839836 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3cce63-6276-44f7-93dd-c9629d7e13b7 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:07.839988 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3cce63-6276-44f7-93dd-c9629d7e13b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:07.857702 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-3d3cce63-6276-44f7-93dd-c9629d7e13b7 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:19:07.858872 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-3d3cce63-6276-44f7-93dd-c9629d7e13b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:19:07.910067 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:19:07.923875 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 436/866] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:19:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:19:08.194513 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c469fde-3aed-4537-805a-4e9a766ba4de None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:19:08.292236 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c469fde-3aed-4537-805a-4e9a766ba4de None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:19:08.324968 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8893c-1c4d-4379-8fcc-2d73dac20036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:19:08.325580 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8893c-1c4d-4379-8fcc-2d73dac20036 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:08.325856 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8893c-1c4d-4379-8fcc-2d73dac20036 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:08.326127 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8893c-1c4d-4379-8fcc-2d73dac20036 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:08.335655 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8893c-1c4d-4379-8fcc-2d73dac20036 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:19:08.340421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-2be8893c-1c4d-4379-8fcc-2d73dac20036 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:19:08.340421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:19:08.340421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:19:08.340421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:19:08.340421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:19:08.340421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:19:08.340421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:19:08.340421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:19:08.340421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:19:08.340421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:19:08.340421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:19:08.340421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:19:08.340421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:19:08.340421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:19:08.340421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:19:08.340421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:19:08.341577 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:19:08.341577 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:19:08.341577 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:19:08.341577 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:19:08.341577 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:19:08.341577 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:19:08.341577 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:19:08.341577 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:19:08.341577 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:19:08.341577 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:19:08.341577 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:19:08.341577 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:19:08.341577 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:19:08.341577 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:19:08.341577 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:19:08.341577 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:19:08.342595 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:19:08.342595 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:19:08.342595 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:19:08.342595 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:19:08.342595 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:19:08.342595 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:19:08.342595 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:19:08.342595 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:19:08.342595 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:19:08.342595 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:19:08.342595 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:19:08.342595 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:19:08.342595 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 431/867] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Nov 2 20:19:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:19:08.347299 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3cce63-6276-44f7-93dd-c9629d7e13b7 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:19:08.443148 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3cce63-6276-44f7-93dd-c9629d7e13b7 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:19:08.475742 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412c415-a4e5-421c-a3d2-bddfe11f8fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:19:08.476342 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412c415-a4e5-421c-a3d2-bddfe11f8fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:08.476663 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412c415-a4e5-421c-a3d2-bddfe11f8fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:08.476942 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412c415-a4e5-421c-a3d2-bddfe11f8fe4 None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:08.477621 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412c415-a4e5-421c-a3d2-bddfe11f8fe4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:19:08.477909 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412c415-a4e5-421c-a3d2-bddfe11f8fe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:19:08.479266 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412c415-a4e5-421c-a3d2-bddfe11f8fe4 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:19:08.487020 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 437/868] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:19:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:19:08.493413 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8893c-1c4d-4379-8fcc-2d73dac20036 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:19:08.540416 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:19:08.592878 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8893c-1c4d-4379-8fcc-2d73dac20036 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:19:08.625136 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4abd99-9395-45bd-961e-fa0ba1a7fb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:19:08.625756 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4abd99-9395-45bd-961e-fa0ba1a7fb2b None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:08.626036 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4abd99-9395-45bd-961e-fa0ba1a7fb2b None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:08.626311 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4abd99-9395-45bd-961e-fa0ba1a7fb2b None admin] PATH_INFO: `/v3/users/3cfd47049b85484ab5f8415a988db532` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:08.639204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4abd99-9395-45bd-961e-fa0ba1a7fb2b None admin] RBAC: Authorizing `identity:get_user(user_id=3cfd47049b85484ab5f8415a988db532)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:19:08.640705 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4abd99-9395-45bd-961e-fa0ba1a7fb2b None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:19:08.642279 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 432/869] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:19:08 2022] GET /identity/v3/users/3cfd47049b85484ab5f8415a988db532 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:19:08.647998 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412c415-a4e5-421c-a3d2-bddfe11f8fe4 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:19:08.696792 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:19:08.745091 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412c415-a4e5-421c-a3d2-bddfe11f8fe4 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:19:08.778147 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a8d1a-f338-42f8-b1ce-1452d7935be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:19:08.778765 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a8d1a-f338-42f8-b1ce-1452d7935be7 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:08.779048 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a8d1a-f338-42f8-b1ce-1452d7935be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:08.779325 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a8d1a-f338-42f8-b1ce-1452d7935be7 None admin] PATH_INFO: `/v3/projects/3786ec4ad1ec44ceb23df85e6b2081fe` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:08.780423 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a8d1a-f338-42f8-b1ce-1452d7935be7 None admin] RBAC: Authorizing `identity:get_project(project_id=3786ec4ad1ec44ceb23df85e6b2081fe)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:19:08.781888 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a8d1a-f338-42f8-b1ce-1452d7935be7 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:19:08.783492 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 438/870] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Nov 2 20:19:08 2022] GET /identity/v3/projects/3786ec4ad1ec44ceb23df85e6b2081fe => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:19:08.789878 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4abd99-9395-45bd-961e-fa0ba1a7fb2b None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:19:08.884291 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4abd99-9395-45bd-961e-fa0ba1a7fb2b None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:19:08.885774 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:19:08.917423 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513788f5-68ee-4fcb-b44d-e76bec519ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:19:08.918056 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513788f5-68ee-4fcb-b44d-e76bec519ad8 None admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:08.918334 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513788f5-68ee-4fcb-b44d-e76bec519ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:08.918606 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513788f5-68ee-4fcb-b44d-e76bec519ad8 None admin] PATH_INFO: `/v3/projects/3786ec4ad1ec44ceb23df85e6b2081fe/users/3cfd47049b85484ab5f8415a988db532/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:08.920443 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513788f5-68ee-4fcb-b44d-e76bec519ad8 None admin] RBAC: Authorizing `identity:create_grant(project_id=3786ec4ad1ec44ceb23df85e6b2081fe, user_id=3cfd47049b85484ab5f8415a988db532, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:19:08.921885 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513788f5-68ee-4fcb-b44d-e76bec519ad8 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:19:08.935096 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 433/871] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Nov 2 20:19:08 2022] PUT /identity/v3/projects/3786ec4ad1ec44ceb23df85e6b2081fe/users/3cfd47049b85484ab5f8415a988db532/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:19:11.042795 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404c712-bfa6-4c29-851e-f3fe8039748e None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:11.043317 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404c712-bfa6-4c29-851e-f3fe8039748e None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:11.043317 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404c712-bfa6-4c29-851e-f3fe8039748e None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:11.044703 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 439/872] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:19:11.049799 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd7183-2842-4ee0-be5e-98f651422756 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:11.050178 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd7183-2842-4ee0-be5e-98f651422756 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:11.050351 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd7183-2842-4ee0-be5e-98f651422756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:11.068894 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-a1fd7183-2842-4ee0-be5e-98f651422756 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:19:11.070115 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-a1fd7183-2842-4ee0-be5e-98f651422756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:19:11.134434 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 434/873] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:19:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:19:11.407915 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404c712-bfa6-4c29-851e-f3fe8039748e None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:19:11.505489 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404c712-bfa6-4c29-851e-f3fe8039748e None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:19:11.521927 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:19:11.538826 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea9e91-e7d2-4ccf-ac0c-b952f0f4f059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:19:11.539449 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea9e91-e7d2-4ccf-ac0c-b952f0f4f059 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:11.539727 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea9e91-e7d2-4ccf-ac0c-b952f0f4f059 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:11.540002 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea9e91-e7d2-4ccf-ac0c-b952f0f4f059 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:11.550934 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea9e91-e7d2-4ccf-ac0c-b952f0f4f059 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:19:11.556429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-46ea9e91-e7d2-4ccf-ac0c-b952f0f4f059 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:19:11.556429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:19:11.556429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:19:11.556429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:19:11.556429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:19:11.556429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:19:11.556429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:19:11.556429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:19:11.556429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:19:11.556429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:19:11.556429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:19:11.556429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:19:11.556429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:19:11.556429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:19:11.556429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:19:11.556429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:19:11.557526 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:19:11.557526 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:19:11.557526 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:19:11.557526 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:19:11.557526 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:19:11.557526 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:19:11.557526 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:19:11.557526 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:19:11.557526 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:19:11.557526 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:19:11.557526 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:19:11.557526 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:19:11.557526 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:19:11.557526 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:19:11.557526 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:19:11.557526 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:19:11.558765 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:19:11.558765 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:19:11.558765 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:19:11.558765 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:19:11.558765 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:19:11.558765 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:19:11.558765 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:19:11.558765 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:19:11.558765 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:19:11.558765 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:19:11.558765 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:19:11.558765 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:19:11.558765 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 440/874] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Nov 2 20:19:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:19:11.563758 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd7183-2842-4ee0-be5e-98f651422756 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:19:11.649758 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:19:11.659271 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd7183-2842-4ee0-be5e-98f651422756 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:19:11.692388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c2167-e632-4cdc-9efa-c34dc3f72cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:19:11.693048 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c2167-e632-4cdc-9efa-c34dc3f72cfb None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:11.693332 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c2167-e632-4cdc-9efa-c34dc3f72cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:11.693610 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c2167-e632-4cdc-9efa-c34dc3f72cfb None admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:11.694270 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c2167-e632-4cdc-9efa-c34dc3f72cfb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:19:11.694577 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c2167-e632-4cdc-9efa-c34dc3f72cfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:19:11.696518 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c2167-e632-4cdc-9efa-c34dc3f72cfb None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:19:11.704208 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 435/875] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:19:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:19:11.710001 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea9e91-e7d2-4ccf-ac0c-b952f0f4f059 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:19:11.807267 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea9e91-e7d2-4ccf-ac0c-b952f0f4f059 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:19:11.839725 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13e1cc-61f7-4f09-ba0b-de2de149914d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:19:11.840347 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13e1cc-61f7-4f09-ba0b-de2de149914d None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:11.840659 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13e1cc-61f7-4f09-ba0b-de2de149914d None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:11.840934 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13e1cc-61f7-4f09-ba0b-de2de149914d None admin] PATH_INFO: `/v3/users/3cfd47049b85484ab5f8415a988db532` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:11.842032 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b13e1cc-61f7-4f09-ba0b-de2de149914d None admin] RBAC: Authorizing `identity:get_user(user_id=3cfd47049b85484ab5f8415a988db532)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:19:11.843448 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b13e1cc-61f7-4f09-ba0b-de2de149914d None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:19:11.845060 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 441/876] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:19:11 2022] GET /identity/v3/users/3cfd47049b85484ab5f8415a988db532 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:19:11.850806 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c2167-e632-4cdc-9efa-c34dc3f72cfb None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:19:11.947008 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c2167-e632-4cdc-9efa-c34dc3f72cfb None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:19:11.978850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5da8c-1f4b-4299-9c91-b8595f6b95b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:19:11.979440 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5da8c-1f4b-4299-9c91-b8595f6b95b2 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:11.979726 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5da8c-1f4b-4299-9c91-b8595f6b95b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:11.980005 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5da8c-1f4b-4299-9c91-b8595f6b95b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:12.002600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:19:12.045347 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5da8c-1f4b-4299-9c91-b8595f6b95b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:19:12.046777 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5da8c-1f4b-4299-9c91-b8595f6b95b2 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:19:12.143529 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 436/877] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Nov 2 20:19:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 20:19:12.149979 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13e1cc-61f7-4f09-ba0b-de2de149914d None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:19:12.194928 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:19:12.247060 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13e1cc-61f7-4f09-ba0b-de2de149914d None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:19:12.279367 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa0078-9514-482f-a6f6-6f02c7730563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:19:12.279972 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa0078-9514-482f-a6f6-6f02c7730563 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:12.280251 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa0078-9514-482f-a6f6-6f02c7730563 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:12.280525 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa0078-9514-482f-a6f6-6f02c7730563 None admin] PATH_INFO: `/v3/projects/3786ec4ad1ec44ceb23df85e6b2081fe` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:12.281640 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa0078-9514-482f-a6f6-6f02c7730563 None admin] RBAC: Authorizing `identity:get_project(project_id=3786ec4ad1ec44ceb23df85e6b2081fe)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:19:12.283056 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa0078-9514-482f-a6f6-6f02c7730563 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:19:12.284660 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 442/878] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Nov 2 20:19:12 2022] GET /identity/v3/projects/3786ec4ad1ec44ceb23df85e6b2081fe => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:19:12.291172 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5da8c-1f4b-4299-9c91-b8595f6b95b2 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:19:12.343056 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:19:12.384992 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5da8c-1f4b-4299-9c91-b8595f6b95b2 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:19:12.417586 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bd2f0-65e0-4125-8906-788a9bcd6f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:19:12.418172 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bd2f0-65e0-4125-8906-788a9bcd6f42 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:12.418449 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bd2f0-65e0-4125-8906-788a9bcd6f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:12.418718 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bd2f0-65e0-4125-8906-788a9bcd6f42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:12.419424 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8bd2f0-65e0-4125-8906-788a9bcd6f42 None admin] RBAC: Adding query filter params (role.id=bca2e686aa5e4fdc844fc679a4c41939, scope.project.id=3786ec4ad1ec44ceb23df85e6b2081fe, user.id=3cfd47049b85484ab5f8415a988db532) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:19:12.419730 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8bd2f0-65e0-4125-8906-788a9bcd6f42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:19:12.421177 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8bd2f0-65e0-4125-8906-788a9bcd6f42 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:19:12.426620 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 437/879] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Nov 2 20:19:12 2022] GET /identity/v3/role_assignments?user.id=3cfd47049b85484ab5f8415a988db532&scope.project.id=3786ec4ad1ec44ceb23df85e6b2081fe&role.id=bca2e686aa5e4fdc844fc679a4c41939 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:19:14.545131 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838d8c6-6b1b-4dcc-9936-9d7c522f0aba None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:14.545596 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838d8c6-6b1b-4dcc-9936-9d7c522f0aba None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:14.545690 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838d8c6-6b1b-4dcc-9936-9d7c522f0aba None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:14.546995 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 443/880] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:19:14.552081 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0afd1a-d690-46be-84bd-35fd7181013c None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:14.552501 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0afd1a-d690-46be-84bd-35fd7181013c None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:14.552724 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0afd1a-d690-46be-84bd-35fd7181013c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:14.571823 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-1c0afd1a-d690-46be-84bd-35fd7181013c None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:19:14.573043 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-1c0afd1a-d690-46be-84bd-35fd7181013c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:19:14.636950 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 438/881] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:19:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:19:14.902774 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838d8c6-6b1b-4dcc-9936-9d7c522f0aba None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:19:15.001965 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838d8c6-6b1b-4dcc-9936-9d7c522f0aba None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:19:15.014854 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:19:15.034428 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a17d0d-4983-4c95-b44f-af5554e5152c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:19:15.035019 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a17d0d-4983-4c95-b44f-af5554e5152c None admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:15.035301 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a17d0d-4983-4c95-b44f-af5554e5152c None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:15.035576 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a17d0d-4983-4c95-b44f-af5554e5152c None admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:15.036251 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a17d0d-4983-4c95-b44f-af5554e5152c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:19:15.037649 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a17d0d-4983-4c95-b44f-af5554e5152c None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:19:15.053190 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 444/882] 10.222.0.23 () {60 vars in 1138 bytes} [Wed Nov 2 20:19:14 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:19:17.189251 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22995e80-2e5e-4670-bee1-1dd26e89e3e8 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:17.189825 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22995e80-2e5e-4670-bee1-1dd26e89e3e8 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:17.189825 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22995e80-2e5e-4670-bee1-1dd26e89e3e8 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:17.191143 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 439/883] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:19:17.196813 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f29ff-6a60-4861-9b53-e40f1343d700 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:17.197257 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f29ff-6a60-4861-9b53-e40f1343d700 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:17.197354 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f29ff-6a60-4861-9b53-e40f1343d700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:17.215973 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-931f29ff-6a60-4861-9b53-e40f1343d700 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:19:17.217171 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-931f29ff-6a60-4861-9b53-e40f1343d700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:19:17.282969 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 445/884] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:19:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:19:17.553490 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22995e80-2e5e-4670-bee1-1dd26e89e3e8 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:19:17.603164 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:19:17.651754 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22995e80-2e5e-4670-bee1-1dd26e89e3e8 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:19:17.683859 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950c092-2c63-434f-8182-12a5355ef272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:19:17.684787 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950c092-2c63-434f-8182-12a5355ef272 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:17.685069 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950c092-2c63-434f-8182-12a5355ef272 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:17.685345 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950c092-2c63-434f-8182-12a5355ef272 None admin] PATH_INFO: `/v3/domains/708d9e36087d42358c0ed2307e0be220` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:17.695383 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8950c092-2c63-434f-8182-12a5355ef272 None admin] RBAC: Authorizing `identity:get_domain(domain_id=708d9e36087d42358c0ed2307e0be220)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:19:17.696825 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8950c092-2c63-434f-8182-12a5355ef272 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:19:17.698422 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 440/885] 10.222.0.23 () {56 vars in 1183 bytes} [Wed Nov 2 20:19:17 2022] GET /identity/v3/domains/708d9e36087d42358c0ed2307e0be220 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:19:17.704144 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f29ff-6a60-4861-9b53-e40f1343d700 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:19:17.798238 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f29ff-6a60-4861-9b53-e40f1343d700 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:19:17.800401 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:19:17.832614 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2d92d-3a5e-4447-a72c-2f76ac919b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:19:17.833206 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2d92d-3a5e-4447-a72c-2f76ac919b9a None admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:17.833485 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2d92d-3a5e-4447-a72c-2f76ac919b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:17.833758 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2d92d-3a5e-4447-a72c-2f76ac919b9a None admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:17.834404 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2d92d-3a5e-4447-a72c-2f76ac919b9a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:19:17.836400 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2d92d-3a5e-4447-a72c-2f76ac919b9a None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:19:17.862666 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 446/886] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Nov 2 20:19:17 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:19:20.000310 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81340a85-e082-4703-9c6f-6c34177bf6af None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:20.000890 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81340a85-e082-4703-9c6f-6c34177bf6af None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:20.000890 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81340a85-e082-4703-9c6f-6c34177bf6af None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:20.002236 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 441/887] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:19:20.007358 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c490528-28ec-48d4-8739-977980ffd3f2 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:20.008363 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c490528-28ec-48d4-8739-977980ffd3f2 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:20.008482 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c490528-28ec-48d4-8739-977980ffd3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:20.026195 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-1c490528-28ec-48d4-8739-977980ffd3f2 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:19:20.027361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-1c490528-28ec-48d4-8739-977980ffd3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:19:20.092331 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 447/888] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:19:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:19:20.363696 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81340a85-e082-4703-9c6f-6c34177bf6af None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:19:20.462836 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81340a85-e082-4703-9c6f-6c34177bf6af None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:19:20.471669 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:19:20.496241 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880fae3f-326a-425e-8486-6b9dc687a424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:19:20.496897 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fae3f-326a-425e-8486-6b9dc687a424 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:20.497178 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fae3f-326a-425e-8486-6b9dc687a424 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:20.497453 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fae3f-326a-425e-8486-6b9dc687a424 None admin] PATH_INFO: `/v3/domains/708d9e36087d42358c0ed2307e0be220` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:20.498555 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880fae3f-326a-425e-8486-6b9dc687a424 None admin] RBAC: Authorizing `identity:get_domain(domain_id=708d9e36087d42358c0ed2307e0be220)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:19:20.499965 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880fae3f-326a-425e-8486-6b9dc687a424 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:19:20.501567 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 442/889] 10.222.0.23 () {56 vars in 1183 bytes} [Wed Nov 2 20:19:20 2022] GET /identity/v3/domains/708d9e36087d42358c0ed2307e0be220 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:19:20.507154 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c490528-28ec-48d4-8739-977980ffd3f2 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:19:20.589331 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:19:20.604499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c490528-28ec-48d4-8739-977980ffd3f2 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:19:20.637581 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1a2d7-b54a-4eb0-850a-b9f0d00c0522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:19:20.638126 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1a2d7-b54a-4eb0-850a-b9f0d00c0522 None admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:20.638403 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1a2d7-b54a-4eb0-850a-b9f0d00c0522 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:20.638674 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1a2d7-b54a-4eb0-850a-b9f0d00c0522 None admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:20.639318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1a2d7-b54a-4eb0-850a-b9f0d00c0522 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:19:20.640757 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1a2d7-b54a-4eb0-850a-b9f0d00c0522 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:19:20.662000 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 448/890] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Nov 2 20:19:20 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:19:22.798453 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5aeab-6718-485a-aba5-e2ed40442dc7 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:22.798964 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5aeab-6718-485a-aba5-e2ed40442dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:22.798964 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5aeab-6718-485a-aba5-e2ed40442dc7 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:22.800245 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 443/891] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:19:22.805904 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609485b-4e07-4180-af34-554b9be33e2a None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:22.806311 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609485b-4e07-4180-af34-554b9be33e2a None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:22.806458 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609485b-4e07-4180-af34-554b9be33e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:22.825009 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-a609485b-4e07-4180-af34-554b9be33e2a None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:19:22.826182 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-a609485b-4e07-4180-af34-554b9be33e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:19:22.889771 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 449/892] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:19:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:19:23.157453 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c5aeab-6718-485a-aba5-e2ed40442dc7 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:19:23.255874 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c5aeab-6718-485a-aba5-e2ed40442dc7 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:19:23.287986 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b7bb1-adf9-46d4-b84b-99e58f22d6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:19:23.289139 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b7bb1-adf9-46d4-b84b-99e58f22d6be None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:23.289433 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b7bb1-adf9-46d4-b84b-99e58f22d6be None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:23.289711 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b7bb1-adf9-46d4-b84b-99e58f22d6be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:23.299494 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b7bb1-adf9-46d4-b84b-99e58f22d6be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:19:23.304236 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-0f3b7bb1-adf9-46d4-b84b-99e58f22d6be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:19:23.304236 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:19:23.304236 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:19:23.304236 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:19:23.304236 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:19:23.304236 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:19:23.304236 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:19:23.304236 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:19:23.304236 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:19:23.304236 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:19:23.304236 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:19:23.304236 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:19:23.304236 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:19:23.304236 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:19:23.304236 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:19:23.304236 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:19:23.305970 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:19:23.305970 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:19:23.305970 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:19:23.305970 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:19:23.305970 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:19:23.305970 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:19:23.305970 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:19:23.305970 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:19:23.305970 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:19:23.305970 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:19:23.305970 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:19:23.305970 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:19:23.305970 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:19:23.305970 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:19:23.305970 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:19:23.305970 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:19:23.307108 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:19:23.307108 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:19:23.307108 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:19:23.307108 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:19:23.307108 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:19:23.307108 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:19:23.307108 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:19:23.307108 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:19:23.307108 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:19:23.307108 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:19:23.307108 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:19:23.307108 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:19:23.307108 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 444/893] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Nov 2 20:19:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:19:23.311996 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609485b-4e07-4180-af34-554b9be33e2a None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:19:23.379420 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:19:23.408520 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609485b-4e07-4180-af34-554b9be33e2a None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:19:23.441666 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28de99e-657b-4925-9154-bb4921f82857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:19:23.442258 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28de99e-657b-4925-9154-bb4921f82857 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:23.442538 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28de99e-657b-4925-9154-bb4921f82857 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:23.442808 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28de99e-657b-4925-9154-bb4921f82857 None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:23.443468 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28de99e-657b-4925-9154-bb4921f82857 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:19:23.443770 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28de99e-657b-4925-9154-bb4921f82857 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:19:23.445156 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28de99e-657b-4925-9154-bb4921f82857 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:19:23.453005 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 450/894] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:19:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:19:23.458927 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b7bb1-adf9-46d4-b84b-99e58f22d6be None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:19:23.493368 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:19:23.556807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b7bb1-adf9-46d4-b84b-99e58f22d6be None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:19:23.589270 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db1636-ebbf-4da8-9e7a-7e9ed552eda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:19:23.589886 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db1636-ebbf-4da8-9e7a-7e9ed552eda2 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:23.590164 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db1636-ebbf-4da8-9e7a-7e9ed552eda2 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:23.590437 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db1636-ebbf-4da8-9e7a-7e9ed552eda2 None admin] PATH_INFO: `/v3/users/1d2db09a879944eba32bdb31f210ad55` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:23.603256 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db1636-ebbf-4da8-9e7a-7e9ed552eda2 None admin] RBAC: Authorizing `identity:get_user(user_id=1d2db09a879944eba32bdb31f210ad55)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:19:23.604710 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db1636-ebbf-4da8-9e7a-7e9ed552eda2 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:19:23.606275 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 445/895] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:19:23 2022] GET /identity/v3/users/1d2db09a879944eba32bdb31f210ad55 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:19:23.612115 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28de99e-657b-4925-9154-bb4921f82857 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:19:23.706511 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28de99e-657b-4925-9154-bb4921f82857 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:19:23.738718 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef951a-85e2-4fd9-92f6-37a3c2e48a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:19:23.739324 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef951a-85e2-4fd9-92f6-37a3c2e48a7f None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:23.739603 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef951a-85e2-4fd9-92f6-37a3c2e48a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:23.739875 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef951a-85e2-4fd9-92f6-37a3c2e48a7f None admin] PATH_INFO: `/v3/projects/050c4686a5914be18138831575ac166b` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:23.740979 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ef951a-85e2-4fd9-92f6-37a3c2e48a7f None admin] RBAC: Authorizing `identity:get_project(project_id=050c4686a5914be18138831575ac166b)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:19:23.742445 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ef951a-85e2-4fd9-92f6-37a3c2e48a7f None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:19:23.744006 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 451/896] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Nov 2 20:19:23 2022] GET /identity/v3/projects/050c4686a5914be18138831575ac166b => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:19:23.749879 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db1636-ebbf-4da8-9e7a-7e9ed552eda2 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:19:23.839183 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:19:23.846112 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db1636-ebbf-4da8-9e7a-7e9ed552eda2 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:19:23.878561 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de25c3-37b1-4a65-a2f3-bf8ce208c639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:19:23.879208 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de25c3-37b1-4a65-a2f3-bf8ce208c639 None admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:23.879490 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de25c3-37b1-4a65-a2f3-bf8ce208c639 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:23.879768 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de25c3-37b1-4a65-a2f3-bf8ce208c639 None admin] PATH_INFO: `/v3/projects/050c4686a5914be18138831575ac166b/users/1d2db09a879944eba32bdb31f210ad55/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:23.881653 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de25c3-37b1-4a65-a2f3-bf8ce208c639 None admin] RBAC: Authorizing `identity:create_grant(project_id=050c4686a5914be18138831575ac166b, user_id=1d2db09a879944eba32bdb31f210ad55, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:19:23.883589 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de25c3-37b1-4a65-a2f3-bf8ce208c639 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:19:23.895272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 446/897] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Nov 2 20:19:23 2022] PUT /identity/v3/projects/050c4686a5914be18138831575ac166b/users/1d2db09a879944eba32bdb31f210ad55/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:19:25.987160 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63570fde-c828-4165-8a38-c66e286b10d1 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:25.987687 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63570fde-c828-4165-8a38-c66e286b10d1 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:25.987802 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63570fde-c828-4165-8a38-c66e286b10d1 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:25.989082 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 452/898] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:19:25.994743 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3925039-9e03-45b6-bfc7-e350dd7cd73c None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:25.995122 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3925039-9e03-45b6-bfc7-e350dd7cd73c None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:25.995292 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3925039-9e03-45b6-bfc7-e350dd7cd73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:26.013487 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-e3925039-9e03-45b6-bfc7-e350dd7cd73c None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:19:26.014654 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-e3925039-9e03-45b6-bfc7-e350dd7cd73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:19:26.080157 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 447/899] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:19:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:19:26.348617 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63570fde-c828-4165-8a38-c66e286b10d1 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:19:26.352023 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:19:26.449759 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63570fde-c828-4165-8a38-c66e286b10d1 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:19:26.481634 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3505a-7fd7-4162-8d63-d4cfa6c725e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:19:26.482248 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3505a-7fd7-4162-8d63-d4cfa6c725e3 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:26.482529 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3505a-7fd7-4162-8d63-d4cfa6c725e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:26.482805 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3505a-7fd7-4162-8d63-d4cfa6c725e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:26.493516 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb3505a-7fd7-4162-8d63-d4cfa6c725e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:19:26.498347 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-1bb3505a-7fd7-4162-8d63-d4cfa6c725e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:19:26.498347 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:19:26.498347 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:19:26.498347 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:19:26.498347 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:19:26.498347 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:19:26.498347 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:19:26.498347 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:19:26.498347 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:19:26.498347 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:19:26.498347 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:19:26.498347 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:19:26.498347 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:19:26.498347 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:19:26.498347 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:19:26.498347 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:19:26.499477 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:19:26.499477 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:19:26.499477 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:19:26.499477 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:19:26.499477 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:19:26.499477 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:19:26.499477 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:19:26.499477 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:19:26.499477 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:19:26.499477 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:19:26.499477 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:19:26.499477 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:19:26.499477 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:19:26.499477 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:19:26.499477 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:19:26.499477 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:19:26.500513 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:19:26.500513 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:19:26.500513 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:19:26.500513 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:19:26.500513 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:19:26.500513 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:19:26.500513 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:19:26.500513 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:19:26.500513 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:19:26.500513 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:19:26.500513 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:19:26.500513 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:19:26.500513 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 453/900] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Nov 2 20:19:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:19:26.505362 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3925039-9e03-45b6-bfc7-e350dd7cd73c None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:19:26.588134 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:19:26.603474 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3925039-9e03-45b6-bfc7-e350dd7cd73c None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:19:26.636245 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba77847-eeb1-4d55-8193-24f1b216fb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:19:26.636879 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba77847-eeb1-4d55-8193-24f1b216fb3d None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:26.637163 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba77847-eeb1-4d55-8193-24f1b216fb3d None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:26.637437 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba77847-eeb1-4d55-8193-24f1b216fb3d None admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:26.638098 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba77847-eeb1-4d55-8193-24f1b216fb3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:19:26.638404 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba77847-eeb1-4d55-8193-24f1b216fb3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:19:26.639754 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba77847-eeb1-4d55-8193-24f1b216fb3d None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:19:26.647429 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 448/901] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:19:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:19:26.653519 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3505a-7fd7-4162-8d63-d4cfa6c725e3 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:19:26.713395 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:19:26.751081 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3505a-7fd7-4162-8d63-d4cfa6c725e3 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:19:26.782858 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce84cf9-5e83-4b30-8b50-04f0daf63561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:19:26.783463 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce84cf9-5e83-4b30-8b50-04f0daf63561 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:26.783740 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce84cf9-5e83-4b30-8b50-04f0daf63561 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:26.784010 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce84cf9-5e83-4b30-8b50-04f0daf63561 None admin] PATH_INFO: `/v3/users/1d2db09a879944eba32bdb31f210ad55` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:26.785112 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce84cf9-5e83-4b30-8b50-04f0daf63561 None admin] RBAC: Authorizing `identity:get_user(user_id=1d2db09a879944eba32bdb31f210ad55)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:19:26.786519 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce84cf9-5e83-4b30-8b50-04f0daf63561 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:19:26.788052 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 454/902] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Nov 2 20:19:26 2022] GET /identity/v3/users/1d2db09a879944eba32bdb31f210ad55 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:19:26.794192 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba77847-eeb1-4d55-8193-24f1b216fb3d None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:19:26.889091 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba77847-eeb1-4d55-8193-24f1b216fb3d None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:19:26.920497 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1824c-4662-42dc-9489-09768eca37cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:19:26.921112 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1824c-4662-42dc-9489-09768eca37cf None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:26.921391 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1824c-4662-42dc-9489-09768eca37cf None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:26.921665 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1824c-4662-42dc-9489-09768eca37cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:26.936761 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:19:26.987231 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1824c-4662-42dc-9489-09768eca37cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:19:26.988693 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1824c-4662-42dc-9489-09768eca37cf None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:19:27.082701 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 449/903] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Nov 2 20:19:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 20:19:27.088595 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce84cf9-5e83-4b30-8b50-04f0daf63561 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:19:27.185896 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce84cf9-5e83-4b30-8b50-04f0daf63561 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:19:27.213018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:19:27.219077 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e20df4-69ac-4343-a71a-20024170a675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:19:27.219695 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e20df4-69ac-4343-a71a-20024170a675 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:27.219980 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e20df4-69ac-4343-a71a-20024170a675 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:27.220259 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e20df4-69ac-4343-a71a-20024170a675 None admin] PATH_INFO: `/v3/projects/050c4686a5914be18138831575ac166b` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:27.221395 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e20df4-69ac-4343-a71a-20024170a675 None admin] RBAC: Authorizing `identity:get_project(project_id=050c4686a5914be18138831575ac166b)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:19:27.222821 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e20df4-69ac-4343-a71a-20024170a675 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:19:27.224409 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 455/904] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Nov 2 20:19:27 2022] GET /identity/v3/projects/050c4686a5914be18138831575ac166b => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:19:27.231057 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1824c-4662-42dc-9489-09768eca37cf None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:19:27.275263 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:19:27.325872 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1824c-4662-42dc-9489-09768eca37cf None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:19:27.358808 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f086eb3-ffae-4606-8800-27a0b1a820b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:19:27.359402 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f086eb3-ffae-4606-8800-27a0b1a820b4 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:19:27.359689 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f086eb3-ffae-4606-8800-27a0b1a820b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:19:27.359991 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f086eb3-ffae-4606-8800-27a0b1a820b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:19:27.360807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f086eb3-ffae-4606-8800-27a0b1a820b4 None admin] RBAC: Adding query filter params (role.id=bca2e686aa5e4fdc844fc679a4c41939, scope.project.id=050c4686a5914be18138831575ac166b, user.id=1d2db09a879944eba32bdb31f210ad55) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:19:27.361122 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f086eb3-ffae-4606-8800-27a0b1a820b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:19:27.362528 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f086eb3-ffae-4606-8800-27a0b1a820b4 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:19:27.369353 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 450/905] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Nov 2 20:19:27 2022] GET /identity/v3/role_assignments?user.id=1d2db09a879944eba32bdb31f210ad55&scope.project.id=050c4686a5914be18138831575ac166b&role.id=bca2e686aa5e4fdc844fc679a4c41939 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:19:37.216361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:19:37.365728 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=45 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:22.659888 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32838065-ffc6-419d-b8cf-8b5aef841977 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:22.660479 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32838065-ffc6-419d-b8cf-8b5aef841977 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:22.660479 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32838065-ffc6-419d-b8cf-8b5aef841977 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:22.661963 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 456/906] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:20:22.667926 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf08e9-ea97-4870-aa1d-29cfb353e41c None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:22.668430 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf08e9-ea97-4870-aa1d-29cfb353e41c None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:22.668514 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf08e9-ea97-4870-aa1d-29cfb353e41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:22.691811 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-7aaf08e9-ea97-4870-aa1d-29cfb353e41c None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:20:22.693154 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-7aaf08e9-ea97-4870-aa1d-29cfb353e41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:20:22.794196 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 451/907] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:20:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:20:23.077375 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32838065-ffc6-419d-b8cf-8b5aef841977 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:23.192684 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32838065-ffc6-419d-b8cf-8b5aef841977 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:23.234009 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d2fd4-12e9-4546-aca2-eb39554f7653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:23.234990 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d2fd4-12e9-4546-aca2-eb39554f7653 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:23.235343 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d2fd4-12e9-4546-aca2-eb39554f7653 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:23.235694 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d2fd4-12e9-4546-aca2-eb39554f7653 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:23.247470 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d2fd4-12e9-4546-aca2-eb39554f7653 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:23.248981 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d2fd4-12e9-4546-aca2-eb39554f7653 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:23.264159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-0c4d2fd4-12e9-4546-aca2-eb39554f7653 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:20:23.264159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:20:23.264159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:20:23.264159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:20:23.264159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:20:23.264159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:20:23.264159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:20:23.264159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:20:23.264159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:20:23.264159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:20:23.264159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:20:23.264159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:20:23.264159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:20:23.264159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:20:23.264159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:20:23.264159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:20:23.265258 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:20:23.265258 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:20:23.265258 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:20:23.265258 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:20:23.265258 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:20:23.265258 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:20:23.265258 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:20:23.265258 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:20:23.265258 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:20:23.265258 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:20:23.265258 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:20:23.265258 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:20:23.265258 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:20:23.265258 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:20:23.265258 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:20:23.265258 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:20:23.265258 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:20:23.266248 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:20:23.266248 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:20:23.266248 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:20:23.266248 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 457/908] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:20:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:20:23.275645 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf08e9-ea97-4870-aa1d-29cfb353e41c None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:23.392146 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf08e9-ea97-4870-aa1d-29cfb353e41c None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:23.428955 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:23.436513 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c0a41-f0dc-4133-bb42-57ec2fe701d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:23.437176 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c0a41-f0dc-4133-bb42-57ec2fe701d3 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:23.437620 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c0a41-f0dc-4133-bb42-57ec2fe701d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:23.437907 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c0a41-f0dc-4133-bb42-57ec2fe701d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:23.438552 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c0a41-f0dc-4133-bb42-57ec2fe701d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:20:23.438857 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c0a41-f0dc-4133-bb42-57ec2fe701d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:23.440329 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c0a41-f0dc-4133-bb42-57ec2fe701d3 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:23.453189 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 452/909] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:20:23.462344 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d2fd4-12e9-4546-aca2-eb39554f7653 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:23.524059 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:23.590878 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d2fd4-12e9-4546-aca2-eb39554f7653 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:23.634808 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432ac8d-7cfb-440a-94ae-ef186446895c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:23.635501 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432ac8d-7cfb-440a-94ae-ef186446895c None admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:23.635781 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432ac8d-7cfb-440a-94ae-ef186446895c None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:23.636058 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432ac8d-7cfb-440a-94ae-ef186446895c None admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:23.636839 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432ac8d-7cfb-440a-94ae-ef186446895c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:23.638560 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432ac8d-7cfb-440a-94ae-ef186446895c None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:23.663894 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 458/910] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Nov 2 20:20:23 2022] POST /identity/v3/users => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:20:25.901875 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a461b1-c751-4367-832a-7b4b4fb67c2c None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:25.902420 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a461b1-c751-4367-832a-7b4b4fb67c2c None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:25.902501 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a461b1-c751-4367-832a-7b4b4fb67c2c None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:25.903897 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 453/911] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:20:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:20:25.909616 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee45f3-660b-4e77-825e-efb22ef9d98d None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:25.910077 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee45f3-660b-4e77-825e-efb22ef9d98d None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:25.910158 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee45f3-660b-4e77-825e-efb22ef9d98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:25.931972 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-80ee45f3-660b-4e77-825e-efb22ef9d98d None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:20:25.933189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-80ee45f3-660b-4e77-825e-efb22ef9d98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:20:26.008144 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 459/912] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:20:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:20:26.275997 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a461b1-c751-4367-832a-7b4b4fb67c2c None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:26.404866 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a461b1-c751-4367-832a-7b4b4fb67c2c None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:26.447402 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217259c5-fed2-4aef-9b61-34b2f4e0221a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:26.448079 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217259c5-fed2-4aef-9b61-34b2f4e0221a None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:26.448382 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217259c5-fed2-4aef-9b61-34b2f4e0221a None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:26.448686 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217259c5-fed2-4aef-9b61-34b2f4e0221a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:26.460013 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217259c5-fed2-4aef-9b61-34b2f4e0221a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:20:26.466597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-217259c5-fed2-4aef-9b61-34b2f4e0221a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 20:20:26.466597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:20:26.466597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:20:26.466597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:20:26.466597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:20:26.466597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:20:26.466597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:20:26.466597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:20:26.466597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:20:26.466597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:20:26.466597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:20:26.466597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:20:26.466597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:20:26.466597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:20:26.466597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:20:26.466597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:20:26.467527 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:20:26.467527 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:20:26.467527 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:20:26.467527 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:20:26.467527 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:20:26.467527 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:20:26.467527 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:20:26.467527 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:20:26.467527 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:20:26.467527 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:20:26.467527 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:20:26.467527 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:20:26.467527 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:20:26.467527 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:20:26.467527 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:20:26.467527 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:20:26.468390 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:20:26.468390 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:20:26.468390 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:20:26.468390 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:20:26.468390 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:20:26.468390 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:20:26.468390 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:20:26.468390 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:20:26.468390 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:20:26.468390 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:20:26.468390 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 20:20:26.468390 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:20:26.468390 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 454/913] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Nov 2 20:20:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:20:26.473981 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee45f3-660b-4e77-825e-efb22ef9d98d None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:26.531605 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:26.612299 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee45f3-660b-4e77-825e-efb22ef9d98d None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:26.660739 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681ba4e-dab2-40d6-9de8-7c8b60b6aeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:26.661370 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681ba4e-dab2-40d6-9de8-7c8b60b6aeb3 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:26.661701 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681ba4e-dab2-40d6-9de8-7c8b60b6aeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:26.662042 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681ba4e-dab2-40d6-9de8-7c8b60b6aeb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:26.662782 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681ba4e-dab2-40d6-9de8-7c8b60b6aeb3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:20:26.663095 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681ba4e-dab2-40d6-9de8-7c8b60b6aeb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:26.665156 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681ba4e-dab2-40d6-9de8-7c8b60b6aeb3 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:26.678433 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 460/914] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Nov 2 20:20:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:20:26.679687 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217259c5-fed2-4aef-9b61-34b2f4e0221a None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:26.744235 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:26.799357 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217259c5-fed2-4aef-9b61-34b2f4e0221a None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:26.837478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898fa16-0756-4e58-a173-83fc2f6fb33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:26.838255 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898fa16-0756-4e58-a173-83fc2f6fb33f None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:26.838535 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898fa16-0756-4e58-a173-83fc2f6fb33f None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:26.838804 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898fa16-0756-4e58-a173-83fc2f6fb33f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:26.849202 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898fa16-0756-4e58-a173-83fc2f6fb33f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:26.850683 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898fa16-0756-4e58-a173-83fc2f6fb33f None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:26.866151 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-c898fa16-0756-4e58-a173-83fc2f6fb33f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:20:26.866151 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:20:26.866151 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:20:26.866151 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:20:26.866151 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:20:26.866151 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:20:26.866151 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:20:26.866151 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:20:26.866151 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:20:26.866151 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:20:26.866151 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:20:26.866151 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:20:26.866151 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:20:26.866151 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:20:26.866151 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:20:26.866151 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:20:26.867127 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:20:26.867127 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:20:26.867127 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:20:26.867127 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:20:26.867127 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:20:26.867127 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:20:26.867127 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:20:26.867127 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:20:26.867127 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:20:26.867127 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:20:26.867127 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:20:26.867127 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:20:26.867127 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:20:26.867127 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:20:26.867127 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:20:26.867127 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:20:26.867127 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:20:26.868138 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:20:26.868138 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:20:26.868138 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:20:26.868138 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 455/915] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:20:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 20:20:26.873103 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681ba4e-dab2-40d6-9de8-7c8b60b6aeb3 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:26.992581 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:26.996033 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681ba4e-dab2-40d6-9de8-7c8b60b6aeb3 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:27.032677 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888bf951-b102-4fd2-a59a-64c270f85287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:27.033283 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bf951-b102-4fd2-a59a-64c270f85287 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:27.033567 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bf951-b102-4fd2-a59a-64c270f85287 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:27.033863 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bf951-b102-4fd2-a59a-64c270f85287 None admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:27.034480 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888bf951-b102-4fd2-a59a-64c270f85287 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:20:27.034821 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888bf951-b102-4fd2-a59a-64c270f85287 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:27.036165 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888bf951-b102-4fd2-a59a-64c270f85287 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:27.049267 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 461/916] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:20:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:20:27.055754 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898fa16-0756-4e58-a173-83fc2f6fb33f None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:27.167217 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898fa16-0756-4e58-a173-83fc2f6fb33f None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:27.168777 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:27.204860 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ebeea-3b30-4f45-a994-c5724012bb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:27.205629 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ebeea-3b30-4f45-a994-c5724012bb0d None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:27.205964 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ebeea-3b30-4f45-a994-c5724012bb0d None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:27.206206 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ebeea-3b30-4f45-a994-c5724012bb0d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:27.215400 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ebeea-3b30-4f45-a994-c5724012bb0d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:27.216997 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ebeea-3b30-4f45-a994-c5724012bb0d None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:27.229832 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-e52ebeea-3b30-4f45-a994-c5724012bb0d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 20:20:27.229832 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:20:27.229832 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:20:27.229832 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:20:27.229832 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:20:27.229832 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:20:27.229832 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:20:27.229832 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:20:27.229832 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:20:27.229832 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:20:27.229832 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:20:27.229832 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:20:27.229832 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 20:20:27.229832 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 20:20:27.229832 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 20:20:27.229832 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 20:20:27.232410 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:20:27.232410 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:20:27.232410 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 20:20:27.232410 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:20:27.232410 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 20:20:27.232410 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:20:27.232410 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:20:27.232410 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:20:27.232410 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:20:27.232410 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:20:27.232410 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:20:27.232410 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:20:27.232410 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:20:27.232410 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:20:27.232410 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:20:27.232410 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:20:27.232410 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:20:27.232410 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:20:27.233650 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:20:27.233650 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:20:27.233650 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 20:20:27.233650 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 20:20:27.233650 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 20:20:27.233650 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 20:20:27.233650 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 20:20:27.233650 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 20:20:27.233650 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Nov 02 20:20:27.233650 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:20:27.237425 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 456/917] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:20:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:20:27.237553 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888bf951-b102-4fd2-a59a-64c270f85287 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:27.346681 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888bf951-b102-4fd2-a59a-64c270f85287 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:27.386231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ac893-c650-45cc-adf5-b8186fa5ce64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:27.386973 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ac893-c650-45cc-adf5-b8186fa5ce64 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:27.387291 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ac893-c650-45cc-adf5-b8186fa5ce64 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:27.387590 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ac893-c650-45cc-adf5-b8186fa5ce64 None admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:27.388385 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ac893-c650-45cc-adf5-b8186fa5ce64 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:20:27.388779 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ac893-c650-45cc-adf5-b8186fa5ce64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:27.390368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ac893-c650-45cc-adf5-b8186fa5ce64 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:27.415675 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 462/918] 10.222.0.23 () {56 vars in 1143 bytes} [Wed Nov 2 20:20:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:20:27.417050 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ebeea-3b30-4f45-a994-c5724012bb0d None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:27.548792 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ebeea-3b30-4f45-a994-c5724012bb0d None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:27.590340 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c019c32-47c9-4102-9adc-04bcd36f9bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:27.591137 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c019c32-47c9-4102-9adc-04bcd36f9bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:27.591521 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c019c32-47c9-4102-9adc-04bcd36f9bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:27.591899 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c019c32-47c9-4102-9adc-04bcd36f9bb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:27.603467 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c019c32-47c9-4102-9adc-04bcd36f9bb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:27.605022 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c019c32-47c9-4102-9adc-04bcd36f9bb0 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:27.620867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-6c019c32-47c9-4102-9adc-04bcd36f9bb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:20:27.620867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:20:27.620867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:20:27.620867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:20:27.620867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:20:27.620867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:20:27.620867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:20:27.620867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:20:27.620867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:20:27.620867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:20:27.620867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:20:27.620867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:20:27.620867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:20:27.620867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:20:27.620867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:20:27.620867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:20:27.622093 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:20:27.622093 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:20:27.622093 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:20:27.622093 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:20:27.622093 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:20:27.622093 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:20:27.622093 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:20:27.622093 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:20:27.622093 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:20:27.622093 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:20:27.622093 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:20:27.622093 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:20:27.622093 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:20:27.622093 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:20:27.622093 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:20:27.622093 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:20:27.622093 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:20:27.623226 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:20:27.623226 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:20:27.623226 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:20:27.624184 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 457/919] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:20:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:20:27.630312 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ac893-c650-45cc-adf5-b8186fa5ce64 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:27.651668 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:27.746190 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ac893-c650-45cc-adf5-b8186fa5ce64 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:27.788157 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f0b79-2411-4cda-976e-066e76ec8852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:27.789318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f0b79-2411-4cda-976e-066e76ec8852 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:27.789602 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f0b79-2411-4cda-976e-066e76ec8852 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:27.789880 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f0b79-2411-4cda-976e-066e76ec8852 None admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:27.790526 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f0b79-2411-4cda-976e-066e76ec8852 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:20:27.790835 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f0b79-2411-4cda-976e-066e76ec8852 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:27.792254 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f0b79-2411-4cda-976e-066e76ec8852 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:27.805571 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 463/920] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:20:27.811702 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c019c32-47c9-4102-9adc-04bcd36f9bb0 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:27.830570 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:27.926198 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c019c32-47c9-4102-9adc-04bcd36f9bb0 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:27.967482 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c550d6-0340-473a-8e3f-f39bab1bee93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:27.968202 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c550d6-0340-473a-8e3f-f39bab1bee93 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:27.968526 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c550d6-0340-473a-8e3f-f39bab1bee93 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:27.968943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c550d6-0340-473a-8e3f-f39bab1bee93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:27.977079 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c550d6-0340-473a-8e3f-f39bab1bee93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:27.978650 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c550d6-0340-473a-8e3f-f39bab1bee93 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:27.990839 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-c1c550d6-0340-473a-8e3f-f39bab1bee93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:20:27.990839 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:20:27.990839 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:20:27.990839 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:20:27.990839 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:20:27.990839 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:20:27.990839 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:20:27.990839 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:20:27.990839 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:20:27.990839 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:20:27.990839 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:20:27.990839 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:20:27.990839 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 20:20:27.990839 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 20:20:27.990839 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 20:20:27.992597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 20:20:27.992597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:20:27.992597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:20:27.992597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:20:27.992597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:20:27.992597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:20:27.992597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:20:27.992597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:20:27.992597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:20:27.992597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:20:27.992597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:20:27.992597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:20:27.992597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:20:27.992597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:20:27.992597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:20:27.992597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:20:27.992597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:20:27.993704 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 20:20:27.993704 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 20:20:27.993704 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 20:20:27.993704 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 20:20:27.993704 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 20:20:27.993704 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 20:20:27.993704 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:20:27.993704 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:20:27.993704 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 458/921] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:20:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:20:28.001687 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f0b79-2411-4cda-976e-066e76ec8852 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:28.086985 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:28.112218 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f0b79-2411-4cda-976e-066e76ec8852 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:28.158936 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d7699-397f-4407-b9a2-fb5c3eeccddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:28.159705 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d7699-397f-4407-b9a2-fb5c3eeccddd None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:28.160159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d7699-397f-4407-b9a2-fb5c3eeccddd None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:28.160634 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d7699-397f-4407-b9a2-fb5c3eeccddd None admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:28.161695 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d7699-397f-4407-b9a2-fb5c3eeccddd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:20:28.162108 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d7699-397f-4407-b9a2-fb5c3eeccddd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:28.164807 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d7699-397f-4407-b9a2-fb5c3eeccddd None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:28.182383 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 464/922] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Nov 2 20:20:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:20:28.189649 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c550d6-0340-473a-8e3f-f39bab1bee93 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:28.280883 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:28.308913 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c550d6-0340-473a-8e3f-f39bab1bee93 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:28.348750 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d76ade-c883-46ef-b36c-35910efa8be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:28.349421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d76ade-c883-46ef-b36c-35910efa8be8 None admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:28.349704 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d76ade-c883-46ef-b36c-35910efa8be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:28.349982 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d76ade-c883-46ef-b36c-35910efa8be8 None admin] PATH_INFO: `/v3/projects/a144e65ce44c44dc99c07a7f5be303b7/users/603a9f31ae814003a2cbd02f964f4ac9/roles/59b45b6df1ee465bbbb8bdba4b4e281d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:28.369610 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d76ade-c883-46ef-b36c-35910efa8be8 None admin] RBAC: Authorizing `identity:create_grant(project_id=a144e65ce44c44dc99c07a7f5be303b7, user_id=603a9f31ae814003a2cbd02f964f4ac9, role_id=59b45b6df1ee465bbbb8bdba4b4e281d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:28.371251 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d76ade-c883-46ef-b36c-35910efa8be8 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:28.385883 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 459/923] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Nov 2 20:20:28 2022] PUT /identity/v3/projects/a144e65ce44c44dc99c07a7f5be303b7/users/603a9f31ae814003a2cbd02f964f4ac9/roles/59b45b6df1ee465bbbb8bdba4b4e281d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:20:30.606448 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a411b-b39f-4e71-8e6a-de30391ee9ec None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:30.607011 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a411b-b39f-4e71-8e6a-de30391ee9ec None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:30.607011 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a411b-b39f-4e71-8e6a-de30391ee9ec None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:30.608535 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 465/924] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 20:20:30.613866 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f0017-f1b8-42f7-90ea-3eb6b7bb19e3 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:30.614286 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f0017-f1b8-42f7-90ea-3eb6b7bb19e3 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:30.614467 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f0017-f1b8-42f7-90ea-3eb6b7bb19e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:30.633601 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-515f0017-f1b8-42f7-90ea-3eb6b7bb19e3 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:20:30.634846 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-515f0017-f1b8-42f7-90ea-3eb6b7bb19e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:20:30.706471 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 460/925] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:20:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:20:30.985529 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a411b-b39f-4e71-8e6a-de30391ee9ec None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:31.099904 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a411b-b39f-4e71-8e6a-de30391ee9ec None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:31.146150 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d31fc-1cec-4baa-9193-a4ce2466b252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:31.146850 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d31fc-1cec-4baa-9193-a4ce2466b252 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:31.147136 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d31fc-1cec-4baa-9193-a4ce2466b252 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:31.147503 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d31fc-1cec-4baa-9193-a4ce2466b252 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:31.155090 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:31.159616 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d31fc-1cec-4baa-9193-a4ce2466b252 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:20:31.164982 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-d60d31fc-1cec-4baa-9193-a4ce2466b252 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 20:20:31.164982 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:20:31.164982 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:20:31.164982 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:20:31.164982 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:20:31.164982 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:20:31.164982 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:20:31.164982 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:20:31.164982 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:20:31.164982 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:20:31.164982 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:20:31.164982 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:20:31.164982 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:20:31.164982 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:20:31.164982 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:20:31.164982 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:20:31.168680 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:20:31.168680 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:20:31.168680 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:20:31.168680 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:20:31.168680 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:20:31.168680 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:20:31.168680 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:20:31.168680 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:20:31.168680 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:20:31.168680 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:20:31.168680 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:20:31.168680 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:20:31.168680 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:20:31.168680 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:20:31.168680 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:20:31.168680 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:20:31.169787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:20:31.169787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:20:31.169787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:20:31.169787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:20:31.169787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:20:31.169787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:20:31.169787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:20:31.169787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:20:31.169787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:20:31.169787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:20:31.169787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 20:20:31.169787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:20:31.169787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 466/926] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Nov 2 20:20:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:20:31.172204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f0017-f1b8-42f7-90ea-3eb6b7bb19e3 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:31.235346 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:31.285837 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f0017-f1b8-42f7-90ea-3eb6b7bb19e3 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:31.325100 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f43577-8d4c-452b-8d3b-4438b6d51928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:31.325712 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f43577-8d4c-452b-8d3b-4438b6d51928 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:31.325991 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f43577-8d4c-452b-8d3b-4438b6d51928 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:31.326264 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f43577-8d4c-452b-8d3b-4438b6d51928 None admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:31.326936 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f43577-8d4c-452b-8d3b-4438b6d51928 None admin] RBAC: Adding query filter params (name=service) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:20:31.327239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f43577-8d4c-452b-8d3b-4438b6d51928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:31.328678 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f43577-8d4c-452b-8d3b-4438b6d51928 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:31.337537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 461/927] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Nov 2 20:20:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:20:31.343206 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d31fc-1cec-4baa-9193-a4ce2466b252 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:31.455848 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d31fc-1cec-4baa-9193-a4ce2466b252 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:31.493713 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a817ed-0855-4c29-8273-077f60b6ddcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:31.494330 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a817ed-0855-4c29-8273-077f60b6ddcb None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:31.494608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a817ed-0855-4c29-8273-077f60b6ddcb None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:31.494880 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a817ed-0855-4c29-8273-077f60b6ddcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:31.505296 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a817ed-0855-4c29-8273-077f60b6ddcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:31.506906 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a817ed-0855-4c29-8273-077f60b6ddcb None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:31.522825 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-c8a817ed-0855-4c29-8273-077f60b6ddcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:20:31.522825 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:20:31.522825 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:20:31.522825 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:20:31.522825 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:20:31.522825 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:20:31.522825 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:20:31.522825 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:20:31.522825 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:20:31.522825 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:20:31.522825 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:20:31.522825 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:20:31.522825 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:20:31.522825 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:20:31.522825 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:20:31.522825 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:20:31.523984 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:20:31.523984 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:20:31.523984 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:20:31.523984 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:20:31.523984 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:20:31.523984 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:20:31.523984 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:20:31.523984 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:20:31.523984 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:20:31.523984 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:20:31.523984 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:20:31.523984 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:20:31.523984 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:20:31.523984 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:20:31.523984 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:20:31.523984 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:20:31.523984 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:20:31.525057 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:20:31.525057 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:20:31.525057 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:20:31.526960 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 467/928] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:20:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:20:31.530942 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f43577-8d4c-452b-8d3b-4438b6d51928 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:31.646116 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f43577-8d4c-452b-8d3b-4438b6d51928 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:31.664525 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:31.684168 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d46f8-e02e-4e3f-b354-4695789e53bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:31.684850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d46f8-e02e-4e3f-b354-4695789e53bc None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:31.685132 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d46f8-e02e-4e3f-b354-4695789e53bc None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:31.685410 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d46f8-e02e-4e3f-b354-4695789e53bc None admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:31.686097 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d46f8-e02e-4e3f-b354-4695789e53bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:20:31.686663 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d46f8-e02e-4e3f-b354-4695789e53bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:31.688172 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d46f8-e02e-4e3f-b354-4695789e53bc None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:31.701476 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 462/929] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:20:31.707182 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a817ed-0855-4c29-8273-077f60b6ddcb None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:31.765135 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:31.821111 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a817ed-0855-4c29-8273-077f60b6ddcb None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:31.859147 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92278db2-2980-4bff-a991-376a42250acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:31.859992 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92278db2-2980-4bff-a991-376a42250acf None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:31.860401 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92278db2-2980-4bff-a991-376a42250acf None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:31.860820 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92278db2-2980-4bff-a991-376a42250acf None admin] PATH_INFO: `/v3/users/placement` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:31.872920 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92278db2-2980-4bff-a991-376a42250acf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:31.874727 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92278db2-2980-4bff-a991-376a42250acf None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:31.891368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-92278db2-2980-4bff-a991-376a42250acf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 20:20:31.891368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:20:31.891368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:20:31.891368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:20:31.891368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:20:31.891368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:20:31.891368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:20:31.891368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:20:31.891368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:20:31.891368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:20:31.891368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:20:31.891368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:20:31.891368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 20:20:31.891368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 20:20:31.891368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 20:20:31.891368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 20:20:31.892608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:20:31.892608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:20:31.892608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 20:20:31.892608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:20:31.892608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 20:20:31.892608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:20:31.892608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:20:31.892608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:20:31.892608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:20:31.892608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:20:31.892608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:20:31.892608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:20:31.892608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:20:31.892608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:20:31.892608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:20:31.892608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:20:31.892608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:20:31.892608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:20:31.893588 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:20:31.893588 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:20:31.893588 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 20:20:31.893588 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 20:20:31.893588 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 20:20:31.893588 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 20:20:31.893588 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 20:20:31.893588 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 20:20:31.893588 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Nov 02 20:20:31.893588 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:20:31.893588 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 468/930] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:20:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:20:31.899772 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d46f8-e02e-4e3f-b354-4695789e53bc None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:32.002322 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d46f8-e02e-4e3f-b354-4695789e53bc None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:32.039781 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134d394-d9d7-43be-b74b-1f062047705d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:32.040400 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134d394-d9d7-43be-b74b-1f062047705d None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:32.040731 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134d394-d9d7-43be-b74b-1f062047705d None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:32.040984 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134d394-d9d7-43be-b74b-1f062047705d None admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:32.041711 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134d394-d9d7-43be-b74b-1f062047705d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:20:32.042019 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134d394-d9d7-43be-b74b-1f062047705d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:32.043444 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134d394-d9d7-43be-b74b-1f062047705d None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:32.061975 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 463/931] 10.222.0.23 () {56 vars in 1143 bytes} [Wed Nov 2 20:20:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:20:32.067931 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92278db2-2980-4bff-a991-376a42250acf None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:32.190642 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92278db2-2980-4bff-a991-376a42250acf None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:32.204390 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:32.239196 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04465e6b-4e84-4bab-9399-2108d73f5e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:32.240069 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04465e6b-4e84-4bab-9399-2108d73f5e62 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:32.240452 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04465e6b-4e84-4bab-9399-2108d73f5e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:32.240760 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04465e6b-4e84-4bab-9399-2108d73f5e62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:32.315500 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04465e6b-4e84-4bab-9399-2108d73f5e62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:32.317105 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04465e6b-4e84-4bab-9399-2108d73f5e62 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:32.423356 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 469/932] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Nov 2 20:20:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 20:20:32.429814 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134d394-d9d7-43be-b74b-1f062047705d None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:32.465427 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:32.537679 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134d394-d9d7-43be-b74b-1f062047705d None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:32.571738 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a33fb-0368-4722-a115-b05693dad695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:32.572365 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a33fb-0368-4722-a115-b05693dad695 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:32.572678 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a33fb-0368-4722-a115-b05693dad695 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:32.572955 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a33fb-0368-4722-a115-b05693dad695 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:32.583762 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a33fb-0368-4722-a115-b05693dad695 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:32.585362 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a33fb-0368-4722-a115-b05693dad695 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:32.602998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-493a33fb-0368-4722-a115-b05693dad695 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:20:32.602998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:20:32.602998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:20:32.602998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:20:32.602998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:20:32.602998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:20:32.602998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:20:32.602998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:20:32.602998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:20:32.602998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:20:32.602998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:20:32.602998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:20:32.602998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:20:32.602998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:20:32.602998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:20:32.602998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:20:32.604302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:20:32.604302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:20:32.604302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:20:32.604302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:20:32.604302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:20:32.604302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:20:32.604302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:20:32.604302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:20:32.604302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:20:32.604302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:20:32.604302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:20:32.604302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:20:32.604302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:20:32.604302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:20:32.604302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:20:32.604302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:20:32.604302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:20:32.605235 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:20:32.605235 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:20:32.605235 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:20:32.605235 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 464/933] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:20:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:20:32.609918 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04465e6b-4e84-4bab-9399-2108d73f5e62 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:32.623342 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:32.716424 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04465e6b-4e84-4bab-9399-2108d73f5e62 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:32.755079 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9316675-4dcf-47db-bb0b-0afb2b60a6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:32.755689 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9316675-4dcf-47db-bb0b-0afb2b60a6e8 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:32.756044 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9316675-4dcf-47db-bb0b-0afb2b60a6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:32.756417 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9316675-4dcf-47db-bb0b-0afb2b60a6e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:32.757187 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9316675-4dcf-47db-bb0b-0afb2b60a6e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:20:32.757536 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9316675-4dcf-47db-bb0b-0afb2b60a6e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:32.759230 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9316675-4dcf-47db-bb0b-0afb2b60a6e8 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:32.772312 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 470/934] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:20:32.778263 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a33fb-0368-4722-a115-b05693dad695 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:32.871998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:32.890201 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a33fb-0368-4722-a115-b05693dad695 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:32.928115 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561cc43d-17e4-470e-b7ce-7b10ae6ab700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:32.928855 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cc43d-17e4-470e-b7ce-7b10ae6ab700 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:32.929068 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cc43d-17e4-470e-b7ce-7b10ae6ab700 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:32.929366 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cc43d-17e4-470e-b7ce-7b10ae6ab700 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:32.936165 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561cc43d-17e4-470e-b7ce-7b10ae6ab700 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:32.937949 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561cc43d-17e4-470e-b7ce-7b10ae6ab700 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:32.951002 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-561cc43d-17e4-470e-b7ce-7b10ae6ab700 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:20:32.951002 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:20:32.951002 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:20:32.951002 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:20:32.951002 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:20:32.951002 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:20:32.951002 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:20:32.951002 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:20:32.951002 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:20:32.951002 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:20:32.951002 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:20:32.951002 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:20:32.951002 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 20:20:32.951002 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 20:20:32.951002 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 20:20:32.952126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 20:20:32.952126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:20:32.952126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:20:32.952126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:20:32.952126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:20:32.952126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:20:32.952126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:20:32.952126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:20:32.952126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:20:32.952126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:20:32.952126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:20:32.952126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:20:32.952126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:20:32.952126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:20:32.952126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:20:32.952126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:20:32.952126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:20:32.953493 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 20:20:32.953493 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 20:20:32.953493 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 20:20:32.953493 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 20:20:32.953493 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 20:20:32.953493 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 20:20:32.953493 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:20:32.953493 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:20:32.953493 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 465/935] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:20:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:20:32.958291 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9316675-4dcf-47db-bb0b-0afb2b60a6e8 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:33.037934 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:33.071835 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9316675-4dcf-47db-bb0b-0afb2b60a6e8 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:33.109611 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c89c9-3c82-4ef9-88c5-65cdf058bfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:33.110333 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c89c9-3c82-4ef9-88c5-65cdf058bfc5 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:33.110599 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c89c9-3c82-4ef9-88c5-65cdf058bfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:33.110879 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c89c9-3c82-4ef9-88c5-65cdf058bfc5 None admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:33.111567 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c89c9-3c82-4ef9-88c5-65cdf058bfc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:20:33.111883 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c89c9-3c82-4ef9-88c5-65cdf058bfc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:33.113600 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c89c9-3c82-4ef9-88c5-65cdf058bfc5 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:33.126313 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 471/936] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Nov 2 20:20:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:20:33.133017 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561cc43d-17e4-470e-b7ce-7b10ae6ab700 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:33.254069 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561cc43d-17e4-470e-b7ce-7b10ae6ab700 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:33.290467 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea043a-cabc-4c1f-9a9b-cc6f1296d124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:33.290993 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea043a-cabc-4c1f-9a9b-cc6f1296d124 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:33.291312 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea043a-cabc-4c1f-9a9b-cc6f1296d124 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:33.291584 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea043a-cabc-4c1f-9a9b-cc6f1296d124 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:33.292299 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea043a-cabc-4c1f-9a9b-cc6f1296d124 None admin] RBAC: Adding query filter params (role.id=59b45b6df1ee465bbbb8bdba4b4e281d, scope.project.id=a144e65ce44c44dc99c07a7f5be303b7, user.id=603a9f31ae814003a2cbd02f964f4ac9) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:20:33.292632 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea043a-cabc-4c1f-9a9b-cc6f1296d124 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:33.294054 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea043a-cabc-4c1f-9a9b-cc6f1296d124 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:33.300251 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 466/937] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Nov 2 20:20:33 2022] GET /identity/v3/role_assignments?user.id=603a9f31ae814003a2cbd02f964f4ac9&scope.project.id=a144e65ce44c44dc99c07a7f5be303b7&role.id=59b45b6df1ee465bbbb8bdba4b4e281d => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:20:35.510825 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea7abc-301b-4b35-b960-e14e622b9e11 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:35.511748 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea7abc-301b-4b35-b960-e14e622b9e11 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:35.511748 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea7abc-301b-4b35-b960-e14e622b9e11 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:35.512714 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 472/938] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:20:35.518062 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc65d1-6640-4eda-957b-d4902211187b None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:35.518537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc65d1-6640-4eda-957b-d4902211187b None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:35.518625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc65d1-6640-4eda-957b-d4902211187b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:35.537444 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-b2dc65d1-6640-4eda-957b-d4902211187b None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:20:35.539329 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-b2dc65d1-6640-4eda-957b-d4902211187b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:20:35.542617 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:35.616072 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 467/939] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:20:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 20:20:35.883539 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea7abc-301b-4b35-b960-e14e622b9e11 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:35.993535 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea7abc-301b-4b35-b960-e14e622b9e11 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:36.023718 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:36.030294 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8c24b-1d2e-438f-a646-f8d99d9c35bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:36.031035 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8c24b-1d2e-438f-a646-f8d99d9c35bc None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:36.031411 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8c24b-1d2e-438f-a646-f8d99d9c35bc None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:36.031700 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8c24b-1d2e-438f-a646-f8d99d9c35bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:36.045424 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c8c24b-1d2e-438f-a646-f8d99d9c35bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:20:36.050711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-a2c8c24b-1d2e-438f-a646-f8d99d9c35bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:20:36.050711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:20:36.050711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:20:36.050711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:20:36.050711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:20:36.050711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:20:36.050711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:20:36.050711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:20:36.050711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:20:36.050711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:20:36.050711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:20:36.050711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:20:36.050711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:20:36.050711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:20:36.050711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:20:36.050711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:20:36.051956 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:20:36.051956 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:20:36.051956 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:20:36.051956 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:20:36.051956 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:20:36.051956 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:20:36.051956 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:20:36.051956 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:20:36.051956 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:20:36.051956 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:20:36.051956 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:20:36.051956 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:20:36.051956 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:20:36.051956 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:20:36.051956 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:20:36.051956 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:20:36.052903 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:20:36.052903 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:20:36.052903 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:20:36.052903 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:20:36.052903 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:20:36.052903 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:20:36.052903 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:20:36.052903 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:20:36.052903 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:20:36.052903 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:20:36.052903 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:20:36.052903 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:20:36.052903 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 473/940] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Nov 2 20:20:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:20:36.058518 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc65d1-6640-4eda-957b-d4902211187b None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:36.174450 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc65d1-6640-4eda-957b-d4902211187b None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:36.215195 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d3ce4-d2ea-47ac-8bef-241e277b3499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:36.215812 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d3ce4-d2ea-47ac-8bef-241e277b3499 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:36.216096 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d3ce4-d2ea-47ac-8bef-241e277b3499 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:36.216374 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d3ce4-d2ea-47ac-8bef-241e277b3499 None admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:36.217073 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d3ce4-d2ea-47ac-8bef-241e277b3499 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:20:36.217383 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d3ce4-d2ea-47ac-8bef-241e277b3499 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:36.218784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d3ce4-d2ea-47ac-8bef-241e277b3499 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:36.228317 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 468/941] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:20:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:20:36.236531 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8c24b-1d2e-438f-a646-f8d99d9c35bc None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:36.352400 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8c24b-1d2e-438f-a646-f8d99d9c35bc None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:36.390281 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334604a2-06df-4d85-8bcb-e4ed9d2e89a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:36.391136 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334604a2-06df-4d85-8bcb-e4ed9d2e89a4 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:36.391521 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334604a2-06df-4d85-8bcb-e4ed9d2e89a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:36.391887 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334604a2-06df-4d85-8bcb-e4ed9d2e89a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:36.405191 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334604a2-06df-4d85-8bcb-e4ed9d2e89a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:36.407198 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334604a2-06df-4d85-8bcb-e4ed9d2e89a4 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:36.425682 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-334604a2-06df-4d85-8bcb-e4ed9d2e89a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:20:36.425682 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:20:36.425682 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:20:36.425682 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:20:36.425682 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:20:36.425682 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:20:36.425682 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:20:36.425682 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:20:36.425682 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:20:36.425682 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:20:36.425682 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:20:36.425682 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:20:36.425682 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:20:36.425682 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:20:36.425682 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:20:36.425682 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:20:36.426625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:20:36.426625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:20:36.426625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:20:36.426625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:20:36.426625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:20:36.426625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:20:36.426625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:20:36.426625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:20:36.426625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:20:36.426625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:20:36.426625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:20:36.426625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:20:36.426625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:20:36.426625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:20:36.426625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:20:36.426625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:20:36.426625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:20:36.427564 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:20:36.427564 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:20:36.427564 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:20:36.427564 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 474/942] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:20:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 20:20:36.432790 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d3ce4-d2ea-47ac-8bef-241e277b3499 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:36.435733 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:36.554581 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d3ce4-d2ea-47ac-8bef-241e277b3499 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:36.588752 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c58c1a-ac6d-49c9-bfd3-ec8a8369da0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:36.589358 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c58c1a-ac6d-49c9-bfd3-ec8a8369da0f None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:36.589640 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c58c1a-ac6d-49c9-bfd3-ec8a8369da0f None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:36.589916 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c58c1a-ac6d-49c9-bfd3-ec8a8369da0f None admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:36.590556 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c58c1a-ac6d-49c9-bfd3-ec8a8369da0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:20:36.590861 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c58c1a-ac6d-49c9-bfd3-ec8a8369da0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:36.592221 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c58c1a-ac6d-49c9-bfd3-ec8a8369da0f None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:36.611714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 469/943] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:20:36.613253 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334604a2-06df-4d85-8bcb-e4ed9d2e89a4 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:36.797260 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:36.861109 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334604a2-06df-4d85-8bcb-e4ed9d2e89a4 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:36.899552 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8b008-872a-4f6c-bfdc-6299fb390a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:36.900170 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8b008-872a-4f6c-bfdc-6299fb390a0a None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:36.900453 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8b008-872a-4f6c-bfdc-6299fb390a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:36.900769 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8b008-872a-4f6c-bfdc-6299fb390a0a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:36.907970 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8b008-872a-4f6c-bfdc-6299fb390a0a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:36.909437 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8b008-872a-4f6c-bfdc-6299fb390a0a None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:36.922520 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-63c8b008-872a-4f6c-bfdc-6299fb390a0a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 20:20:36.922520 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:20:36.922520 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:20:36.922520 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:20:36.922520 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:20:36.922520 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:20:36.922520 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:20:36.922520 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:20:36.922520 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:20:36.922520 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:20:36.922520 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:20:36.922520 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:20:36.922520 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 20:20:36.922520 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 20:20:36.922520 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 20:20:36.922520 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 20:20:36.923574 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:20:36.923574 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:20:36.923574 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 20:20:36.923574 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:20:36.923574 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 20:20:36.923574 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:20:36.923574 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:20:36.923574 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:20:36.923574 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:20:36.923574 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:20:36.923574 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:20:36.923574 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:20:36.923574 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:20:36.923574 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:20:36.923574 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:20:36.923574 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:20:36.923574 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:20:36.923574 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:20:36.924503 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:20:36.924503 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:20:36.924503 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 20:20:36.924503 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 20:20:36.924503 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 20:20:36.924503 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 20:20:36.924503 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 20:20:36.924503 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 20:20:36.924503 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Nov 02 20:20:36.924503 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:20:36.924503 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 475/944] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:20:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:20:36.930204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c58c1a-ac6d-49c9-bfd3-ec8a8369da0f None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:36.998955 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:37.045741 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c58c1a-ac6d-49c9-bfd3-ec8a8369da0f None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:37.091211 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ff45f-1644-495a-aa88-8e1923ae1e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:37.091856 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ff45f-1644-495a-aa88-8e1923ae1e70 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:37.092157 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ff45f-1644-495a-aa88-8e1923ae1e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:37.092416 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ff45f-1644-495a-aa88-8e1923ae1e70 None admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:37.093179 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ff45f-1644-495a-aa88-8e1923ae1e70 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:20:37.093553 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ff45f-1644-495a-aa88-8e1923ae1e70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:37.095322 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ff45f-1644-495a-aa88-8e1923ae1e70 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:37.122566 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 470/945] 10.222.0.23 () {56 vars in 1143 bytes} [Wed Nov 2 20:20:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:20:37.123804 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8b008-872a-4f6c-bfdc-6299fb390a0a None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:37.250006 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8b008-872a-4f6c-bfdc-6299fb390a0a None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:37.252509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:37.291389 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39217f3-232e-4d0d-9730-f20cb1794cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:37.292060 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39217f3-232e-4d0d-9730-f20cb1794cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:37.292352 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39217f3-232e-4d0d-9730-f20cb1794cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:37.292651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39217f3-232e-4d0d-9730-f20cb1794cc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:37.304930 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39217f3-232e-4d0d-9730-f20cb1794cc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:37.306464 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39217f3-232e-4d0d-9730-f20cb1794cc6 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:37.321284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-b39217f3-232e-4d0d-9730-f20cb1794cc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:20:37.321284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:20:37.321284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:20:37.321284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:20:37.321284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:20:37.321284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:20:37.321284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:20:37.321284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:20:37.321284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:20:37.321284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:20:37.321284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:20:37.321284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:20:37.321284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:20:37.321284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:20:37.321284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:20:37.321284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:20:37.322478 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:20:37.322478 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:20:37.322478 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:20:37.322478 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:20:37.322478 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:20:37.322478 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:20:37.322478 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:20:37.322478 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:20:37.322478 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:20:37.322478 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:20:37.322478 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:20:37.322478 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:20:37.322478 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:20:37.322478 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:20:37.322478 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:20:37.322478 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:20:37.322478 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:20:37.323369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:20:37.323369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:20:37.323369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:20:37.323369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 476/946] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:20:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:20:37.328384 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ff45f-1644-495a-aa88-8e1923ae1e70 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:37.432454 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ff45f-1644-495a-aa88-8e1923ae1e70 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:37.461686 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:37.477548 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499a144-b147-458d-badd-ebe253313eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:37.478197 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499a144-b147-458d-badd-ebe253313eba None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:37.478443 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499a144-b147-458d-badd-ebe253313eba None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:37.478715 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499a144-b147-458d-badd-ebe253313eba None admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:37.479391 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4499a144-b147-458d-badd-ebe253313eba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:20:37.479661 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4499a144-b147-458d-badd-ebe253313eba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:37.481051 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4499a144-b147-458d-badd-ebe253313eba None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:37.492533 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 471/947] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:20:37.498528 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39217f3-232e-4d0d-9730-f20cb1794cc6 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:37.615920 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39217f3-232e-4d0d-9730-f20cb1794cc6 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:37.661112 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a5be9-5168-4740-81eb-ef80c330fb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:37.661999 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a5be9-5168-4740-81eb-ef80c330fb12 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:37.662496 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a5be9-5168-4740-81eb-ef80c330fb12 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:37.662784 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a5be9-5168-4740-81eb-ef80c330fb12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:37.670231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a5be9-5168-4740-81eb-ef80c330fb12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:37.671928 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a5be9-5168-4740-81eb-ef80c330fb12 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:37.683668 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-3d1a5be9-5168-4740-81eb-ef80c330fb12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:20:37.683668 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:20:37.683668 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:20:37.683668 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:20:37.683668 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:20:37.683668 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:20:37.683668 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:20:37.683668 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:20:37.683668 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:20:37.683668 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:20:37.683668 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:20:37.683668 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:20:37.683668 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 20:20:37.683668 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 20:20:37.683668 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 20:20:37.684860 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 20:20:37.684860 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:20:37.684860 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:20:37.684860 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:20:37.684860 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:20:37.684860 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:20:37.684860 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:20:37.684860 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:20:37.684860 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:20:37.684860 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:20:37.684860 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:20:37.684860 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:20:37.684860 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:20:37.684860 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:20:37.684860 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:20:37.684860 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:20:37.684860 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:20:37.685935 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 20:20:37.685935 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 20:20:37.685935 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 20:20:37.685935 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 20:20:37.685935 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 20:20:37.685935 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 20:20:37.685935 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:20:37.685935 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:20:37.685935 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 477/948] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:20:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:20:37.691293 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499a144-b147-458d-badd-ebe253313eba None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:37.825046 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499a144-b147-458d-badd-ebe253313eba None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:37.861866 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e02087-1ebf-4fdb-a649-e722648d1602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:37.862642 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e02087-1ebf-4fdb-a649-e722648d1602 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:37.862928 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e02087-1ebf-4fdb-a649-e722648d1602 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:37.863248 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e02087-1ebf-4fdb-a649-e722648d1602 None admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:37.864001 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e02087-1ebf-4fdb-a649-e722648d1602 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:20:37.864317 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e02087-1ebf-4fdb-a649-e722648d1602 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:37.866060 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e02087-1ebf-4fdb-a649-e722648d1602 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:37.879553 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 472/949] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Nov 2 20:20:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:20:37.885576 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a5be9-5168-4740-81eb-ef80c330fb12 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:37.903404 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:38.000376 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a5be9-5168-4740-81eb-ef80c330fb12 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:38.042044 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5c471-c412-4609-bc02-2e32705bc6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:38.043163 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5c471-c412-4609-bc02-2e32705bc6e3 None admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:38.043578 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5c471-c412-4609-bc02-2e32705bc6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:38.043936 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5c471-c412-4609-bc02-2e32705bc6e3 None admin] PATH_INFO: `/v3/projects/a144e65ce44c44dc99c07a7f5be303b7/users/603a9f31ae814003a2cbd02f964f4ac9/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:38.046321 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff5c471-c412-4609-bc02-2e32705bc6e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=a144e65ce44c44dc99c07a7f5be303b7, user_id=603a9f31ae814003a2cbd02f964f4ac9, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:38.048271 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff5c471-c412-4609-bc02-2e32705bc6e3 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:38.063016 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 478/950] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Nov 2 20:20:37 2022] PUT /identity/v3/projects/a144e65ce44c44dc99c07a7f5be303b7/users/603a9f31ae814003a2cbd02f964f4ac9/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:20:40.233338 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65558b7-deb2-4fd0-8c14-4a4d8becb170 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:40.233917 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65558b7-deb2-4fd0-8c14-4a4d8becb170 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:40.234030 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65558b7-deb2-4fd0-8c14-4a4d8becb170 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:40.235381 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 473/951] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 20:20:40.242668 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321c947-e5e5-42ef-acd3-f2da67673402 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:40.243128 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321c947-e5e5-42ef-acd3-f2da67673402 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:40.243341 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321c947-e5e5-42ef-acd3-f2da67673402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:40.265081 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-8321c947-e5e5-42ef-acd3-f2da67673402 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:20:40.266289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-8321c947-e5e5-42ef-acd3-f2da67673402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:20:40.332743 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 479/952] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:20:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:20:40.618819 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65558b7-deb2-4fd0-8c14-4a4d8becb170 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:40.672160 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:40.737782 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65558b7-deb2-4fd0-8c14-4a4d8becb170 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:40.774570 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d365dd-97a5-4bcb-a262-432b412c900e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:40.775115 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d365dd-97a5-4bcb-a262-432b412c900e None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:40.775388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d365dd-97a5-4bcb-a262-432b412c900e None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:40.775659 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d365dd-97a5-4bcb-a262-432b412c900e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:40.786231 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d365dd-97a5-4bcb-a262-432b412c900e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 20:20:40.791168 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-f7d365dd-97a5-4bcb-a262-432b412c900e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:20:40.791168 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:20:40.791168 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:20:40.791168 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:20:40.791168 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:20:40.791168 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:20:40.791168 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:20:40.791168 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:20:40.791168 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:20:40.791168 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:20:40.791168 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:20:40.791168 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:20:40.791168 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 20:20:40.791168 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 20:20:40.791168 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 20:20:40.791168 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 20:20:40.792246 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 20:20:40.792246 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 20:20:40.792246 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 20:20:40.792246 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 20:20:40.792246 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:20:40.792246 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:20:40.792246 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:20:40.792246 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:20:40.792246 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:20:40.792246 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:20:40.792246 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:20:40.792246 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:20:40.792246 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:20:40.792246 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:20:40.792246 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:20:40.792246 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:20:40.793274 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:20:40.793274 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:20:40.793274 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:20:40.793274 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:20:40.793274 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 20:20:40.793274 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 20:20:40.793274 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 20:20:40.793274 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 20:20:40.793274 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 20:20:40.793274 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 20:20:40.793274 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 20:20:40.793274 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:20:40.793274 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 474/953] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Nov 2 20:20:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:20:40.798447 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321c947-e5e5-42ef-acd3-f2da67673402 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:40.802166 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:40.907955 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321c947-e5e5-42ef-acd3-f2da67673402 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:40.946255 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882178b6-1d95-4f01-aaaa-4fc412656813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:40.946956 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882178b6-1d95-4f01-aaaa-4fc412656813 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:40.947239 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882178b6-1d95-4f01-aaaa-4fc412656813 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:40.947504 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882178b6-1d95-4f01-aaaa-4fc412656813 None admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:40.948164 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882178b6-1d95-4f01-aaaa-4fc412656813 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:20:40.948535 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882178b6-1d95-4f01-aaaa-4fc412656813 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:40.950015 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882178b6-1d95-4f01-aaaa-4fc412656813 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:40.958764 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 480/954] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Nov 2 20:20:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:20:40.965717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d365dd-97a5-4bcb-a262-432b412c900e None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:41.069091 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:41.072521 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d365dd-97a5-4bcb-a262-432b412c900e None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:41.110629 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba5f13-7301-44ee-b91a-50b8f49b8a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:41.111269 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba5f13-7301-44ee-b91a-50b8f49b8a5f None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:41.111546 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba5f13-7301-44ee-b91a-50b8f49b8a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:41.111822 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba5f13-7301-44ee-b91a-50b8f49b8a5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:41.125893 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba5f13-7301-44ee-b91a-50b8f49b8a5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:41.127438 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba5f13-7301-44ee-b91a-50b8f49b8a5f None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:41.142717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-c4ba5f13-7301-44ee-b91a-50b8f49b8a5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:20:41.142717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:20:41.142717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:20:41.142717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:20:41.142717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:20:41.142717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:20:41.142717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:20:41.142717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:20:41.142717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:20:41.142717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:20:41.142717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:20:41.142717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:20:41.142717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:20:41.142717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:20:41.142717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:20:41.142717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:20:41.143903 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:20:41.143903 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:20:41.143903 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:20:41.143903 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:20:41.143903 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:20:41.143903 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:20:41.143903 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:20:41.143903 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:20:41.143903 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:20:41.143903 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:20:41.143903 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:20:41.143903 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:20:41.143903 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:20:41.143903 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:20:41.143903 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:20:41.143903 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:20:41.143903 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:20:41.145015 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:20:41.145015 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:20:41.145015 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:20:41.145015 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 475/955] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:20:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 20:20:41.150438 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882178b6-1d95-4f01-aaaa-4fc412656813 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:41.227385 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:41.270064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882178b6-1d95-4f01-aaaa-4fc412656813 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:41.307430 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f73169-8d37-4f23-8c3d-a3b6242cb5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:41.308035 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f73169-8d37-4f23-8c3d-a3b6242cb5af None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:41.308325 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f73169-8d37-4f23-8c3d-a3b6242cb5af None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:41.308632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f73169-8d37-4f23-8c3d-a3b6242cb5af None admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:41.309446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f73169-8d37-4f23-8c3d-a3b6242cb5af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:20:41.309764 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f73169-8d37-4f23-8c3d-a3b6242cb5af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:41.311290 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f73169-8d37-4f23-8c3d-a3b6242cb5af None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:41.324863 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 481/956] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:20:41.330804 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba5f13-7301-44ee-b91a-50b8f49b8a5f None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:41.440832 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba5f13-7301-44ee-b91a-50b8f49b8a5f None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:41.477955 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c81c7-ec18-4afb-8ac3-b5ba0c14f56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:41.478680 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c81c7-ec18-4afb-8ac3-b5ba0c14f56b None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:41.478961 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c81c7-ec18-4afb-8ac3-b5ba0c14f56b None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:41.479234 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c81c7-ec18-4afb-8ac3-b5ba0c14f56b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:41.488031 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c81c7-ec18-4afb-8ac3-b5ba0c14f56b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:41.489494 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c81c7-ec18-4afb-8ac3-b5ba0c14f56b None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:41.503204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-740c81c7-ec18-4afb-8ac3-b5ba0c14f56b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 20:20:41.503204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:20:41.503204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:20:41.503204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:20:41.503204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:20:41.503204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:20:41.503204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:20:41.503204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:20:41.503204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:20:41.503204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:20:41.503204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:20:41.503204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:20:41.503204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 20:20:41.503204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 20:20:41.503204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 20:20:41.503204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 20:20:41.504360 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:20:41.504360 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:20:41.504360 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 20:20:41.504360 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:20:41.504360 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 20:20:41.504360 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 20:20:41.504360 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:20:41.504360 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:20:41.504360 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:20:41.504360 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:20:41.504360 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:20:41.504360 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:20:41.504360 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:20:41.504360 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:20:41.504360 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:20:41.504360 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:20:41.504360 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:20:41.504360 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:20:41.505372 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:20:41.505372 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:20:41.505372 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 20:20:41.505372 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 20:20:41.505372 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 20:20:41.505372 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 20:20:41.505372 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 20:20:41.505372 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 20:20:41.505372 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Nov 02 20:20:41.505372 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:20:41.505372 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 476/957] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:20:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:20:41.510331 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f73169-8d37-4f23-8c3d-a3b6242cb5af None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:41.630758 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f73169-8d37-4f23-8c3d-a3b6242cb5af None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:41.662415 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:41.671692 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64add868-ab46-45b5-ad10-dbf3a2bac55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:41.672314 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64add868-ab46-45b5-ad10-dbf3a2bac55f None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:41.672609 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64add868-ab46-45b5-ad10-dbf3a2bac55f None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:41.672885 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64add868-ab46-45b5-ad10-dbf3a2bac55f None admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:41.673616 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64add868-ab46-45b5-ad10-dbf3a2bac55f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:20:41.673924 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64add868-ab46-45b5-ad10-dbf3a2bac55f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:41.675364 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64add868-ab46-45b5-ad10-dbf3a2bac55f None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:41.696777 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 482/958] 10.222.0.23 () {56 vars in 1143 bytes} [Wed Nov 2 20:20:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:20:41.702572 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c81c7-ec18-4afb-8ac3-b5ba0c14f56b None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:41.719247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:41.819626 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c81c7-ec18-4afb-8ac3-b5ba0c14f56b None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:41.856516 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bd082-ed06-499f-a79e-bdbc20122b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:41.857183 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bd082-ed06-499f-a79e-bdbc20122b73 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:41.857465 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bd082-ed06-499f-a79e-bdbc20122b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:41.857742 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bd082-ed06-499f-a79e-bdbc20122b73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:41.928595 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486bd082-ed06-499f-a79e-bdbc20122b73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:41.930300 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486bd082-ed06-499f-a79e-bdbc20122b73 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:41.945711 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:42.034116 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 477/959] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Nov 2 20:20:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 20:20:42.040028 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64add868-ab46-45b5-ad10-dbf3a2bac55f None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:42.142891 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64add868-ab46-45b5-ad10-dbf3a2bac55f None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:42.177632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd106b-fd4a-430e-b331-1a2d3f37b876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:42.178269 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd106b-fd4a-430e-b331-1a2d3f37b876 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:42.178552 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd106b-fd4a-430e-b331-1a2d3f37b876 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:42.178879 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd106b-fd4a-430e-b331-1a2d3f37b876 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:42.191956 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd106b-fd4a-430e-b331-1a2d3f37b876 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:42.193751 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd106b-fd4a-430e-b331-1a2d3f37b876 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:42.215106 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-86cd106b-fd4a-430e-b331-1a2d3f37b876 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:20:42.215106 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:20:42.215106 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:20:42.215106 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:20:42.215106 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:20:42.215106 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:20:42.215106 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:20:42.215106 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:20:42.215106 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:20:42.215106 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:20:42.215106 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:20:42.215106 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:20:42.215106 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 20:20:42.215106 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 20:20:42.215106 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 20:20:42.215106 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 20:20:42.216132 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:20:42.216132 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:20:42.216132 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:20:42.216132 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:20:42.216132 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:20:42.216132 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:20:42.216132 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:20:42.216132 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:20:42.216132 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:20:42.216132 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:20:42.216132 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:20:42.216132 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:20:42.216132 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:20:42.216132 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:20:42.216132 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:20:42.216132 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:20:42.216132 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 20:20:42.217111 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 20:20:42.217111 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 20:20:42.217111 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:20:42.217111 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 483/960] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:20:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:20:42.222951 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bd082-ed06-499f-a79e-bdbc20122b73 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:42.335927 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bd082-ed06-499f-a79e-bdbc20122b73 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:42.349247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:42.371581 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93406d98-1c68-426e-b512-f91e322333b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:42.372186 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93406d98-1c68-426e-b512-f91e322333b9 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:42.372466 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93406d98-1c68-426e-b512-f91e322333b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:42.372767 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93406d98-1c68-426e-b512-f91e322333b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:42.373403 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93406d98-1c68-426e-b512-f91e322333b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:20:42.373709 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93406d98-1c68-426e-b512-f91e322333b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:42.375063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93406d98-1c68-426e-b512-f91e322333b9 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:42.387506 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 478/961] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Nov 2 20:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:20:42.393367 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd106b-fd4a-430e-b331-1a2d3f37b876 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:42.430024 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:42.495156 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd106b-fd4a-430e-b331-1a2d3f37b876 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:42.527699 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda8b7b-5081-444e-9ed7-872b9f4c3d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:42.528322 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda8b7b-5081-444e-9ed7-872b9f4c3d47 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:42.528631 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda8b7b-5081-444e-9ed7-872b9f4c3d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:42.528902 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda8b7b-5081-444e-9ed7-872b9f4c3d47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:42.535359 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda8b7b-5081-444e-9ed7-872b9f4c3d47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:42.536822 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda8b7b-5081-444e-9ed7-872b9f4c3d47 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:42.548097 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application [None req-cfda8b7b-5081-444e-9ed7-872b9f4c3d47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:20:42.548097 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:20:42.548097 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:20:42.548097 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:20:42.548097 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:20:42.548097 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:20:42.548097 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:20:42.548097 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:20:42.548097 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:20:42.548097 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:20:42.548097 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:20:42.548097 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:20:42.548097 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 20:20:42.548097 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 20:20:42.548097 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 20:20:42.549166 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 20:20:42.549166 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:20:42.549166 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:20:42.549166 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:20:42.549166 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:20:42.549166 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:20:42.549166 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:20:42.549166 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:20:42.549166 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application with Lock( Nov 02 20:20:42.549166 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:20:42.549166 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:20:42.549166 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:20:42.549166 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:20:42.549166 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:20:42.549166 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:20:42.549166 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:20:42.549166 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:20:42.550264 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 20:20:42.550264 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 20:20:42.550264 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 20:20:42.550264 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 20:20:42.550264 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 20:20:42.550264 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 20:20:42.550264 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 20:20:42.550264 dv-cinder-862365-5-smb devstack@keystone.service[81402]: ERROR keystone.server.flask.application Nov 02 20:20:42.550264 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 484/962] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Nov 2 20:20:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:20:42.555638 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93406d98-1c68-426e-b512-f91e322333b9 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:42.652837 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93406d98-1c68-426e-b512-f91e322333b9 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:42.685983 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4ab05-39d1-420e-8f92-7e9d425402d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:42.686769 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4ab05-39d1-420e-8f92-7e9d425402d5 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:42.687062 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4ab05-39d1-420e-8f92-7e9d425402d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:42.687339 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4ab05-39d1-420e-8f92-7e9d425402d5 None admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:42.688025 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4ab05-39d1-420e-8f92-7e9d425402d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:20:42.688334 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4ab05-39d1-420e-8f92-7e9d425402d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:42.689780 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4ab05-39d1-420e-8f92-7e9d425402d5 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:42.701263 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 479/963] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Nov 2 20:20:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:20:42.707123 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda8b7b-5081-444e-9ed7-872b9f4c3d47 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:42.798485 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:42.804939 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda8b7b-5081-444e-9ed7-872b9f4c3d47 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:42.837238 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4786bd5-9f7e-4130-9dcd-92165e233575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:42.837855 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4786bd5-9f7e-4130-9dcd-92165e233575 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:42.838137 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4786bd5-9f7e-4130-9dcd-92165e233575 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:42.838409 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4786bd5-9f7e-4130-9dcd-92165e233575 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:42.839122 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4786bd5-9f7e-4130-9dcd-92165e233575 None admin] RBAC: Adding query filter params (role.id=bca2e686aa5e4fdc844fc679a4c41939, scope.project.id=a144e65ce44c44dc99c07a7f5be303b7, user.id=603a9f31ae814003a2cbd02f964f4ac9) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:20:42.839429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4786bd5-9f7e-4130-9dcd-92165e233575 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:42.840863 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4786bd5-9f7e-4130-9dcd-92165e233575 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:42.846421 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 485/964] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Nov 2 20:20:42 2022] GET /identity/v3/role_assignments?user.id=603a9f31ae814003a2cbd02f964f4ac9&scope.project.id=a144e65ce44c44dc99c07a7f5be303b7&role.id=bca2e686aa5e4fdc844fc679a4c41939 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:20:44.995872 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3744dd-996a-4329-9510-42586efe30fb None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:44.996400 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3744dd-996a-4329-9510-42586efe30fb None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:44.996400 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3744dd-996a-4329-9510-42586efe30fb None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:44.997792 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 480/965] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:20:45.003024 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa966313-70fd-4576-b167-eb3a96ed4c88 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:45.003446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa966313-70fd-4576-b167-eb3a96ed4c88 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:45.003580 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa966313-70fd-4576-b167-eb3a96ed4c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:45.021280 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-fa966313-70fd-4576-b167-eb3a96ed4c88 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:20:45.022458 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-fa966313-70fd-4576-b167-eb3a96ed4c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:20:45.086195 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 486/966] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:20:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:20:45.355731 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3744dd-996a-4329-9510-42586efe30fb None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:45.385442 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:45.453010 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3744dd-996a-4329-9510-42586efe30fb None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:45.485520 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbc6eb-a075-41c6-81b1-b43b9e3da7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:45.486132 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbc6eb-a075-41c6-81b1-b43b9e3da7e5 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:45.486409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbc6eb-a075-41c6-81b1-b43b9e3da7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:45.486678 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbc6eb-a075-41c6-81b1-b43b9e3da7e5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:45.487247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbc6eb-a075-41c6-81b1-b43b9e3da7e5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:45.488608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbc6eb-a075-41c6-81b1-b43b9e3da7e5 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:45.497063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-09fbc6eb-a075-41c6-81b1-b43b9e3da7e5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 20:20:45.497063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:20:45.497063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 20:20:45.497063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 20:20:45.497063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 20:20:45.497063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 20:20:45.497063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 20:20:45.497063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:20:45.497063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 20:20:45.497063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:20:45.497063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 20:20:45.497063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:20:45.497063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:20:45.497063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:20:45.497063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:20:45.497063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:20:45.497063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:20:45.498239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:20:45.498239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:20:45.498239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:20:45.498239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:20:45.498239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:20:45.498239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:20:45.498239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 20:20:45.498239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 20:20:45.498239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 20:20:45.498239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 20:20:45.498239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:20:45.498239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:20:45.498239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:20:45.498239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:20:45.498239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:20:45.498239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:20:45.499466 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:20:45.499466 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:20:45.499466 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:20:45.499466 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:20:45.499466 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:20:45.499466 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:20:45.499466 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:20:45.499466 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:20:45.499466 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:20:45.499466 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:20:45.499466 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 20:20:45.499466 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:20:45.499466 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 20:20:45.499466 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:20:45.499466 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 481/967] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Nov 2 20:20:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:20:45.504041 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa966313-70fd-4576-b167-eb3a96ed4c88 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:45.591162 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:45.600706 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa966313-70fd-4576-b167-eb3a96ed4c88 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:45.633325 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86816380-7fab-421b-9cf4-d78d3f176c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:45.633858 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86816380-7fab-421b-9cf4-d78d3f176c03 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:45.634135 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86816380-7fab-421b-9cf4-d78d3f176c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:45.634410 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86816380-7fab-421b-9cf4-d78d3f176c03 None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:45.635031 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86816380-7fab-421b-9cf4-d78d3f176c03 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:20:45.635330 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86816380-7fab-421b-9cf4-d78d3f176c03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:45.636704 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86816380-7fab-421b-9cf4-d78d3f176c03 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:45.641339 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 487/968] 10.222.0.23 () {56 vars in 1116 bytes} [Wed Nov 2 20:20:45 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:20:45.647011 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbc6eb-a075-41c6-81b1-b43b9e3da7e5 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:45.736496 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:45.742401 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbc6eb-a075-41c6-81b1-b43b9e3da7e5 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:45.774908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af48b0a-8681-4249-bbe1-4520b7997554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:45.775490 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af48b0a-8681-4249-bbe1-4520b7997554 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:45.775766 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af48b0a-8681-4249-bbe1-4520b7997554 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:45.776038 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af48b0a-8681-4249-bbe1-4520b7997554 None admin] PATH_INFO: `/v3/services` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:45.776679 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af48b0a-8681-4249-bbe1-4520b7997554 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:20:45.776982 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af48b0a-8681-4249-bbe1-4520b7997554 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:45.778317 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af48b0a-8681-4249-bbe1-4520b7997554 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:45.782522 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 482/969] 10.222.0.23 () {56 vars in 1116 bytes} [Wed Nov 2 20:20:45 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:20:47.904147 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303fbe4-f73c-4220-865a-c9bda1755424 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:47.904862 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303fbe4-f73c-4220-865a-c9bda1755424 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:47.904862 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303fbe4-f73c-4220-865a-c9bda1755424 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:47.906067 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 488/970] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:20:47.911531 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f361df-1299-4cd9-92fb-63419ab9fa95 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:47.911963 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f361df-1299-4cd9-92fb-63419ab9fa95 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:47.912086 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f361df-1299-4cd9-92fb-63419ab9fa95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:47.931147 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-f0f361df-1299-4cd9-92fb-63419ab9fa95 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:20:47.932329 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-f0f361df-1299-4cd9-92fb-63419ab9fa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:20:47.996890 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 483/971] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:20:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:20:48.273557 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303fbe4-f73c-4220-865a-c9bda1755424 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:48.371820 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303fbe4-f73c-4220-865a-c9bda1755424 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:48.404315 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978b65c-4a08-4080-81c0-f0d4043911a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:48.404948 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978b65c-4a08-4080-81c0-f0d4043911a4 None admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:48.405233 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978b65c-4a08-4080-81c0-f0d4043911a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:48.405514 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978b65c-4a08-4080-81c0-f0d4043911a4 None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:48.406175 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978b65c-4a08-4080-81c0-f0d4043911a4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:48.407549 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978b65c-4a08-4080-81c0-f0d4043911a4 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:48.423003 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 489/972] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Nov 2 20:20:48 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:20:50.564947 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc611f6-9bb3-4edd-9995-ff52a90ac5ac None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:50.565452 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc611f6-9bb3-4edd-9995-ff52a90ac5ac None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:50.565566 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc611f6-9bb3-4edd-9995-ff52a90ac5ac None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:50.566831 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 484/973] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:20:50.572739 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d4ee5-bc03-49b9-8204-d1a5033a2577 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:50.573125 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d4ee5-bc03-49b9-8204-d1a5033a2577 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:50.573307 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d4ee5-bc03-49b9-8204-d1a5033a2577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:50.591595 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-196d4ee5-bc03-49b9-8204-d1a5033a2577 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:20:50.592814 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-196d4ee5-bc03-49b9-8204-d1a5033a2577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:20:50.601884 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:50.665095 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 490/974] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:20:50 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:20:50.932680 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc611f6-9bb3-4edd-9995-ff52a90ac5ac None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:51.020464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:51.031208 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc611f6-9bb3-4edd-9995-ff52a90ac5ac None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:51.064370 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487f13e-95f6-4bc1-bf53-8b9e2abefdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:51.065020 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487f13e-95f6-4bc1-bf53-8b9e2abefdf2 None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:51.065305 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487f13e-95f6-4bc1-bf53-8b9e2abefdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:51.065582 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487f13e-95f6-4bc1-bf53-8b9e2abefdf2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:51.066163 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487f13e-95f6-4bc1-bf53-8b9e2abefdf2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:51.067520 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487f13e-95f6-4bc1-bf53-8b9e2abefdf2 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:51.076034 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-4487f13e-95f6-4bc1-bf53-8b9e2abefdf2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 20:20:51.076034 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:20:51.076034 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 20:20:51.076034 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 20:20:51.076034 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 20:20:51.076034 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 20:20:51.076034 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 20:20:51.076034 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:20:51.076034 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 20:20:51.076034 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:20:51.076034 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 20:20:51.076034 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:20:51.076034 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:20:51.076034 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:20:51.076034 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:20:51.076034 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:20:51.076034 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:20:51.077283 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:20:51.077283 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:20:51.077283 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:20:51.077283 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:20:51.077283 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:20:51.077283 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:20:51.077283 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 20:20:51.077283 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 20:20:51.077283 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 20:20:51.077283 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 20:20:51.077283 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:20:51.077283 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:20:51.077283 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:20:51.077283 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:20:51.077283 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:20:51.077283 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:20:51.078492 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:20:51.078492 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:20:51.078492 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:20:51.078492 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:20:51.078492 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:20:51.078492 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:20:51.078492 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:20:51.078492 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:20:51.078492 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:20:51.078492 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:20:51.078492 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 20:20:51.078492 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:20:51.078492 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 20:20:51.078492 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:20:51.078492 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 485/975] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Nov 2 20:20:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:20:51.083238 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d4ee5-bc03-49b9-8204-d1a5033a2577 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:51.178418 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d4ee5-bc03-49b9-8204-d1a5033a2577 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:51.215586 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a13cd8-c2f2-4067-bdfc-291723658624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:51.216189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a13cd8-c2f2-4067-bdfc-291723658624 None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:51.216471 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a13cd8-c2f2-4067-bdfc-291723658624 None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:51.216821 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a13cd8-c2f2-4067-bdfc-291723658624 None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:51.217516 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a13cd8-c2f2-4067-bdfc-291723658624 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:20:51.217861 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a13cd8-c2f2-4067-bdfc-291723658624 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:51.219362 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a13cd8-c2f2-4067-bdfc-291723658624 None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:51.225346 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 491/976] 10.222.0.23 () {56 vars in 1116 bytes} [Wed Nov 2 20:20:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:20:51.231998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487f13e-95f6-4bc1-bf53-8b9e2abefdf2 None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:51.330964 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487f13e-95f6-4bc1-bf53-8b9e2abefdf2 None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:51.364101 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e9fed-2efa-4151-8082-0f5a4da6b6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:51.364740 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e9fed-2efa-4151-8082-0f5a4da6b6ad None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:51.365028 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e9fed-2efa-4151-8082-0f5a4da6b6ad None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:51.365307 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e9fed-2efa-4151-8082-0f5a4da6b6ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:51.366001 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e9fed-2efa-4151-8082-0f5a4da6b6ad None admin] RBAC: Adding query filter params (interface=public, service_id=a4433e610f4849a7bcba580b49c5e581, region_id=RegionOne) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:20:51.366314 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e9fed-2efa-4151-8082-0f5a4da6b6ad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:51.367729 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e9fed-2efa-4151-8082-0f5a4da6b6ad None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:51.372596 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 486/977] 10.222.0.23 () {56 vars in 1251 bytes} [Wed Nov 2 20:20:51 2022] GET /identity/v3/endpoints?service_id=a4433e610f4849a7bcba580b49c5e581&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:20:51.378342 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a13cd8-c2f2-4067-bdfc-291723658624 None admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:51.382065 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:51.474788 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a13cd8-c2f2-4067-bdfc-291723658624 None admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:51.507131 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418c539-4df7-4cbd-9db4-43a6110a64bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:51.508230 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418c539-4df7-4cbd-9db4-43a6110a64bc None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:51.508506 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418c539-4df7-4cbd-9db4-43a6110a64bc None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:51.508811 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418c539-4df7-4cbd-9db4-43a6110a64bc None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:51.509401 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418c539-4df7-4cbd-9db4-43a6110a64bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:51.510744 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418c539-4df7-4cbd-9db4-43a6110a64bc None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:51.517668 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 492/978] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Nov 2 20:20:51 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:20:53.623975 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d500e9-a131-4945-8ded-3590b4b702d2 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:53.624517 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d500e9-a131-4945-8ded-3590b4b702d2 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:53.624517 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d500e9-a131-4945-8ded-3590b4b702d2 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:53.625869 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 487/979] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:20:53.630917 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf10f0c-8e52-4862-a6d1-307797e193cf None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:53.631370 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf10f0c-8e52-4862-a6d1-307797e193cf None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:53.631470 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf10f0c-8e52-4862-a6d1-307797e193cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:53.649499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-adf10f0c-8e52-4862-a6d1-307797e193cf None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:20:53.650657 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-adf10f0c-8e52-4862-a6d1-307797e193cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:20:53.709001 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:53.715113 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 493/980] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:20:53 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 20:20:53.979350 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d500e9-a131-4945-8ded-3590b4b702d2 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:53.998914 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:54.079034 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d500e9-a131-4945-8ded-3590b4b702d2 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:54.111164 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab629af0-0095-4ec1-8b3b-b31a20bafe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:54.111778 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab629af0-0095-4ec1-8b3b-b31a20bafe9a None admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:54.112057 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab629af0-0095-4ec1-8b3b-b31a20bafe9a None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:54.112334 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab629af0-0095-4ec1-8b3b-b31a20bafe9a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:54.112944 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab629af0-0095-4ec1-8b3b-b31a20bafe9a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:54.114287 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab629af0-0095-4ec1-8b3b-b31a20bafe9a None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:54.123298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application [None req-ab629af0-0095-4ec1-8b3b-b31a20bafe9a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 20:20:54.123298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:20:54.123298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 20:20:54.123298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 20:20:54.123298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 20:20:54.123298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 20:20:54.123298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 20:20:54.123298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:20:54.123298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 20:20:54.123298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:20:54.123298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 20:20:54.123298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:20:54.123298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 20:20:54.123298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 20:20:54.123298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 20:20:54.123298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 20:20:54.123298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 20:20:54.124448 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 20:20:54.124448 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 20:20:54.124448 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 20:20:54.124448 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 20:20:54.124448 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 20:20:54.124448 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 20:20:54.124448 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 20:20:54.124448 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 20:20:54.124448 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 20:20:54.124448 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 20:20:54.124448 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 20:20:54.124448 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 20:20:54.124448 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 20:20:54.124448 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 20:20:54.124448 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 20:20:54.124448 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 20:20:54.125625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 20:20:54.125625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application with Lock( Nov 02 20:20:54.125625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 20:20:54.125625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self._enter() Nov 02 20:20:54.125625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 20:20:54.125625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 20:20:54.125625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 20:20:54.125625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application return self.creator() Nov 02 20:20:54.125625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 20:20:54.125625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application created_value = creator( Nov 02 20:20:54.125625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 20:20:54.125625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 20:20:54.125625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 20:20:54.125625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: ERROR keystone.server.flask.application Nov 02 20:20:54.125625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 488/981] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Nov 2 20:20:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 20:20:54.130201 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf10f0c-8e52-4862-a6d1-307797e193cf None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:54.230119 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf10f0c-8e52-4862-a6d1-307797e193cf None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:54.266957 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0f73c-7972-402e-b0e5-fe7988e8ce6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:54.267589 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0f73c-7972-402e-b0e5-fe7988e8ce6e None admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:54.267872 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0f73c-7972-402e-b0e5-fe7988e8ce6e None admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:54.268148 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0f73c-7972-402e-b0e5-fe7988e8ce6e None admin] PATH_INFO: `/v3/services` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:54.268802 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0f73c-7972-402e-b0e5-fe7988e8ce6e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:20:54.269109 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0f73c-7972-402e-b0e5-fe7988e8ce6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:54.270468 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0f73c-7972-402e-b0e5-fe7988e8ce6e None admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:54.275971 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 494/982] 10.222.0.23 () {56 vars in 1116 bytes} [Wed Nov 2 20:20:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:20:54.281795 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab629af0-0095-4ec1-8b3b-b31a20bafe9a None admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:20:54.360640 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:20:54.378330 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab629af0-0095-4ec1-8b3b-b31a20bafe9a None admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:20:54.411345 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366d213-8caf-4d2d-a3b6-1f9c211a4b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:20:54.411940 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366d213-8caf-4d2d-a3b6-1f9c211a4b07 None admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:20:54.412221 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366d213-8caf-4d2d-a3b6-1f9c211a4b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:20:54.412495 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366d213-8caf-4d2d-a3b6-1f9c211a4b07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:20:54.413183 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366d213-8caf-4d2d-a3b6-1f9c211a4b07 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:20:54.414588 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366d213-8caf-4d2d-a3b6-1f9c211a4b07 None admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:20:54.433814 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 489/983] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:20:54 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:21:04.275852 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=69 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:21:04.428936 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:21:57.388183 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff380d38-7d9a-4885-87f8-fbacd3b9c1a7 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:21:57.389138 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff380d38-7d9a-4885-87f8-fbacd3b9c1a7 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:21:57.389571 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff380d38-7d9a-4885-87f8-fbacd3b9c1a7 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:21:57.396228 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a68cf-fa30-47a3-955f-be48d0d94930 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:21:57.397047 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a68cf-fa30-47a3-955f-be48d0d94930 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:21:57.397481 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a68cf-fa30-47a3-955f-be48d0d94930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:21:57.402985 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 495/984] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:21:57 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:21:57.500584 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-490a68cf-fa30-47a3-955f-be48d0d94930 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:21:57.502420 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-490a68cf-fa30-47a3-955f-be48d0d94930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:21:57.665173 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 490/985] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:21:57.956763 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32216d9a-713b-40b3-9569-87aa8287ff90 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:21:57.957133 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32216d9a-713b-40b3-9569-87aa8287ff90 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:21:57.957482 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32216d9a-713b-40b3-9569-87aa8287ff90 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:21:57.959198 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 496/986] 10.222.0.23 () {54 vars in 965 bytes} [Wed Nov 2 20:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:21:57.964908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed05774-cfc3-4690-898c-e539ec4eb96d None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:21:57.965271 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed05774-cfc3-4690-898c-e539ec4eb96d None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:21:57.965621 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed05774-cfc3-4690-898c-e539ec4eb96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:21:58.050371 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-7ed05774-cfc3-4690-898c-e539ec4eb96d None None] MFA Rules not processed for user `fdb57cba49ce43ad95096047859dfe1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:21:58.051892 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-7ed05774-cfc3-4690-898c-e539ec4eb96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:21:58.075055 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:21:58.138502 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 491/987] 10.222.0.23 () {58 vars in 1062 bytes} [Wed Nov 2 20:21:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:21:58.149332 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32216d9a-713b-40b3-9569-87aa8287ff90 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:21:58.151119 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-32216d9a-713b-40b3-9569-87aa8287ff90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:21:58.272014 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32216d9a-713b-40b3-9569-87aa8287ff90 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:21:58.352743 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114759e-3a67-4f26-8bc2-09dc2aea6c3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:21:58.353357 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114759e-3a67-4f26-8bc2-09dc2aea6c3f service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:21:58.353639 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114759e-3a67-4f26-8bc2-09dc2aea6c3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:21:58.353914 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114759e-3a67-4f26-8bc2-09dc2aea6c3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:21:58.355512 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-2114759e-3a67-4f26-8bc2-09dc2aea6c3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:21:58.413488 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:21:58.471576 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114759e-3a67-4f26-8bc2-09dc2aea6c3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:21:58.473056 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114759e-3a67-4f26-8bc2-09dc2aea6c3f service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:21:58.491741 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 497/988] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:21:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:22:00.913309 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed97367-5e87-423a-b753-8edae42893b5 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:00.913877 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed97367-5e87-423a-b753-8edae42893b5 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:00.913985 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed97367-5e87-423a-b753-8edae42893b5 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:00.915412 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 492/989] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:22:00.920421 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bc4eb-7741-4961-9449-d414f46ca61f None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:00.920858 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bc4eb-7741-4961-9449-d414f46ca61f None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:00.921054 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bc4eb-7741-4961-9449-d414f46ca61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:00.996937 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-853bc4eb-7741-4961-9449-d414f46ca61f None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:22:00.998129 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-853bc4eb-7741-4961-9449-d414f46ca61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:01.096863 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 498/990] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:22:01.379266 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed97367-5e87-423a-b753-8edae42893b5 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:22:01.380838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-5ed97367-5e87-423a-b753-8edae42893b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:01.494533 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed97367-5e87-423a-b753-8edae42893b5 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:22:01.567763 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:22:01.570088 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1d96c-811c-42cd-836b-49864447dfe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:22:01.570876 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1d96c-811c-42cd-836b-49864447dfe3 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:01.571205 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1d96c-811c-42cd-836b-49864447dfe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:01.571669 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1d96c-811c-42cd-836b-49864447dfe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:01.573488 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-71f1d96c-811c-42cd-836b-49864447dfe3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:01.684337 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1d96c-811c-42cd-836b-49864447dfe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:22:01.685800 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1d96c-811c-42cd-836b-49864447dfe3 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:22:01.705239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 493/991] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:22:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:22:04.149996 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42bdc2-54b2-4171-9d98-d61a5e41888b None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:04.150521 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42bdc2-54b2-4171-9d98-d61a5e41888b None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:04.150634 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42bdc2-54b2-4171-9d98-d61a5e41888b None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:04.151887 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 499/992] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:22:04.157324 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c2ed5-1972-42f6-ac69-a317be9edcfc None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:04.157728 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c2ed5-1972-42f6-ac69-a317be9edcfc None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:04.157878 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c2ed5-1972-42f6-ac69-a317be9edcfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:04.223183 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-d13c2ed5-1972-42f6-ac69-a317be9edcfc None None] MFA Rules not processed for user `fd569b70f63d4b6e81062c7234183a4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:22:04.224402 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-d13c2ed5-1972-42f6-ac69-a317be9edcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:04.276409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:22:04.319839 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 494/993] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:22:04 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:22:04.603903 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42bdc2-54b2-4171-9d98-d61a5e41888b None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:22:04.605462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-6e42bdc2-54b2-4171-9d98-d61a5e41888b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:04.616668 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:22:04.709062 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42bdc2-54b2-4171-9d98-d61a5e41888b None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:22:04.781546 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8ce7f-bad9-4dcd-ad86-92d4b1f76535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:22:04.782077 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8ce7f-bad9-4dcd-ad86-92d4b1f76535 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:04.782355 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8ce7f-bad9-4dcd-ad86-92d4b1f76535 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:04.782627 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8ce7f-bad9-4dcd-ad86-92d4b1f76535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:04.784198 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-97b8ce7f-bad9-4dcd-ad86-92d4b1f76535 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:04.844520 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:22:04.890663 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b8ce7f-bad9-4dcd-ad86-92d4b1f76535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:22:04.892120 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b8ce7f-bad9-4dcd-ad86-92d4b1f76535 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:22:04.909939 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 500/994] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:22:04 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:22:07.560512 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a9c1a-0d05-4f68-a559-fc71753fd493 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:07.561030 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a9c1a-0d05-4f68-a559-fc71753fd493 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:07.561122 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a9c1a-0d05-4f68-a559-fc71753fd493 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:07.562445 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 495/995] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:22:07.567772 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f222e-4279-4042-965a-d28aa31d94e0 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:07.568182 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f222e-4279-4042-965a-d28aa31d94e0 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:07.568315 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f222e-4279-4042-965a-d28aa31d94e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:07.632239 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-326f222e-4279-4042-965a-d28aa31d94e0 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:22:07.633466 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-326f222e-4279-4042-965a-d28aa31d94e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:07.727820 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 501/996] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:22:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:22:08.012933 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a9c1a-0d05-4f68-a559-fc71753fd493 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:22:08.014494 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-546a9c1a-0d05-4f68-a559-fc71753fd493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:08.115290 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a9c1a-0d05-4f68-a559-fc71753fd493 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:22:08.186094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80368a57-a853-4d4b-b164-ce0a5e89b900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:22:08.186690 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80368a57-a853-4d4b-b164-ce0a5e89b900 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:08.186971 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80368a57-a853-4d4b-b164-ce0a5e89b900 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:08.187255 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80368a57-a853-4d4b-b164-ce0a5e89b900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:08.188872 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-80368a57-a853-4d4b-b164-ce0a5e89b900 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:08.196316 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:22:08.296578 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80368a57-a853-4d4b-b164-ce0a5e89b900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:22:08.297923 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80368a57-a853-4d4b-b164-ce0a5e89b900 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:22:08.315516 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 496/997] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:22:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:22:11.114191 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0f5ba-bffc-47f9-a53b-7ee76b1eded9 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:11.114731 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0f5ba-bffc-47f9-a53b-7ee76b1eded9 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:11.114731 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0f5ba-bffc-47f9-a53b-7ee76b1eded9 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:11.116109 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 502/998] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:22:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:22:11.122258 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07aeaa-8863-4fef-bd71-fc41fee57159 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:11.122773 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07aeaa-8863-4fef-bd71-fc41fee57159 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:11.122899 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07aeaa-8863-4fef-bd71-fc41fee57159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:11.199238 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-4a07aeaa-8863-4fef-bd71-fc41fee57159 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:22:11.200471 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-4a07aeaa-8863-4fef-bd71-fc41fee57159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:11.263646 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:22:11.304597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 497/999] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:22:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:22:11.592273 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0f5ba-bffc-47f9-a53b-7ee76b1eded9 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:22:11.593917 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-2ba0f5ba-bffc-47f9-a53b-7ee76b1eded9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:11.613412 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:22:11.698240 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0f5ba-bffc-47f9-a53b-7ee76b1eded9 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:22:11.772252 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d4885-087e-41cd-971e-4422722a94fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:22:11.772805 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d4885-087e-41cd-971e-4422722a94fc service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:11.773089 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d4885-087e-41cd-971e-4422722a94fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:11.773393 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d4885-087e-41cd-971e-4422722a94fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:11.774970 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-b30d4885-087e-41cd-971e-4422722a94fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:11.849143 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:22:11.888397 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d4885-087e-41cd-971e-4422722a94fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:22:11.889881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d4885-087e-41cd-971e-4422722a94fc service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:22:11.908096 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 503/1000] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:22:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:22:14.107071 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df3d5b-929f-4942-8f31-d8b881ba0268 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:14.107592 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df3d5b-929f-4942-8f31-d8b881ba0268 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:14.107699 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df3d5b-929f-4942-8f31-d8b881ba0268 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:14.109013 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 498/1001] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:22:14.114226 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb58a5a-d345-4e38-9b9b-6530e843a5b7 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:14.114638 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb58a5a-d345-4e38-9b9b-6530e843a5b7 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:14.114895 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb58a5a-d345-4e38-9b9b-6530e843a5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:14.190772 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-dcb58a5a-d345-4e38-9b9b-6530e843a5b7 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:22:14.191999 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-dcb58a5a-d345-4e38-9b9b-6530e843a5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:14.291078 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 504/1002] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:22:14.576678 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df3d5b-929f-4942-8f31-d8b881ba0268 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:22:14.578207 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-e8df3d5b-929f-4942-8f31-d8b881ba0268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:14.682199 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df3d5b-929f-4942-8f31-d8b881ba0268 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:22:14.757478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518f5c6-3520-4700-93dd-b585f927357e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:22:14.758624 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518f5c6-3520-4700-93dd-b585f927357e service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:14.758908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518f5c6-3520-4700-93dd-b585f927357e service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:14.759185 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518f5c6-3520-4700-93dd-b585f927357e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:14.760820 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-6518f5c6-3520-4700-93dd-b585f927357e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:14.778410 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:22:14.872099 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518f5c6-3520-4700-93dd-b585f927357e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:22:14.873744 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518f5c6-3520-4700-93dd-b585f927357e service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:22:14.892164 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 499/1003] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:22:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:22:17.080669 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc7177-e8ff-451e-8d0e-0e647f0358e5 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:17.081171 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc7177-e8ff-451e-8d0e-0e647f0358e5 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:17.081297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc7177-e8ff-451e-8d0e-0e647f0358e5 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:17.082556 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 505/1004] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:22:17.088253 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32a4b1-a157-423c-8eea-f6dca67a1ef0 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:17.088688 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32a4b1-a157-423c-8eea-f6dca67a1ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:17.088861 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32a4b1-a157-423c-8eea-f6dca67a1ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:17.156906 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-0a32a4b1-a157-423c-8eea-f6dca67a1ef0 None None] MFA Rules not processed for user `fd569b70f63d4b6e81062c7234183a4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:22:17.158130 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-0a32a4b1-a157-423c-8eea-f6dca67a1ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:17.227975 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:22:17.261071 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 500/1005] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:22:17 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:22:17.544287 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc7177-e8ff-451e-8d0e-0e647f0358e5 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:22:17.545863 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-50fc7177-e8ff-451e-8d0e-0e647f0358e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:17.577792 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:22:17.651284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc7177-e8ff-451e-8d0e-0e647f0358e5 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:22:17.726452 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c2512-3b08-4ec0-8dbc-131a252de9e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:22:17.727054 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c2512-3b08-4ec0-8dbc-131a252de9e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:17.727332 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c2512-3b08-4ec0-8dbc-131a252de9e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:17.727603 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c2512-3b08-4ec0-8dbc-131a252de9e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:17.729190 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-0c7c2512-3b08-4ec0-8dbc-131a252de9e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:17.807439 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:22:17.838809 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c2512-3b08-4ec0-8dbc-131a252de9e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:22:17.840174 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c2512-3b08-4ec0-8dbc-131a252de9e0 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:22:17.858440 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 506/1006] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:22:17 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:22:20.223429 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df558688-1415-4572-9c55-47722222750e None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:20.224006 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df558688-1415-4572-9c55-47722222750e None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:20.224006 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df558688-1415-4572-9c55-47722222750e None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:20.225353 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 501/1007] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:22:20.230959 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd275b8-4b25-4577-8b79-479264c8d4ff None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:20.231330 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd275b8-4b25-4577-8b79-479264c8d4ff None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:20.231506 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd275b8-4b25-4577-8b79-479264c8d4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:20.295905 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-bfd275b8-4b25-4577-8b79-479264c8d4ff None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:22:20.297116 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-bfd275b8-4b25-4577-8b79-479264c8d4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:20.391338 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 507/1008] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:22:20.676762 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df558688-1415-4572-9c55-47722222750e None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:22:20.678291 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-df558688-1415-4572-9c55-47722222750e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:20.780982 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df558688-1415-4572-9c55-47722222750e None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:22:20.852751 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2117e7-5137-4dd0-ab93-55b36e1649c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:22:20.853354 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2117e7-5137-4dd0-ab93-55b36e1649c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:20.853638 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2117e7-5137-4dd0-ab93-55b36e1649c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:20.853912 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2117e7-5137-4dd0-ab93-55b36e1649c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:20.855491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-5a2117e7-5137-4dd0-ab93-55b36e1649c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:20.881542 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:22:20.962890 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2117e7-5137-4dd0-ab93-55b36e1649c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:22:20.964340 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2117e7-5137-4dd0-ab93-55b36e1649c3 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:22:20.982293 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 502/1009] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:22:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:22:23.163714 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c0f13-ed19-416c-88dc-2ea9831548d9 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:23.164800 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c0f13-ed19-416c-88dc-2ea9831548d9 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:23.164800 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c0f13-ed19-416c-88dc-2ea9831548d9 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:23.166141 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 508/1010] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:22:23.171529 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820c95f-f168-4fb5-b108-d5e0d8ed15e3 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:23.171921 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820c95f-f168-4fb5-b108-d5e0d8ed15e3 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:23.172084 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820c95f-f168-4fb5-b108-d5e0d8ed15e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:23.236987 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-0820c95f-f168-4fb5-b108-d5e0d8ed15e3 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:22:23.238100 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-0820c95f-f168-4fb5-b108-d5e0d8ed15e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:23.310257 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:22:23.332695 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 503/1011] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:22:23.618386 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c0f13-ed19-416c-88dc-2ea9831548d9 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:22:23.619940 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-8c3c0f13-ed19-416c-88dc-2ea9831548d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:23.659509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:22:23.722191 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c0f13-ed19-416c-88dc-2ea9831548d9 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:22:23.795570 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714dbf67-c13f-4578-81e1-cfc579c6984a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:22:23.796102 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dbf67-c13f-4578-81e1-cfc579c6984a service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:23.796388 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dbf67-c13f-4578-81e1-cfc579c6984a service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:23.796722 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dbf67-c13f-4578-81e1-cfc579c6984a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:23.798310 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-714dbf67-c13f-4578-81e1-cfc579c6984a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:23.880357 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:22:23.906807 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714dbf67-c13f-4578-81e1-cfc579c6984a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:22:23.908237 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714dbf67-c13f-4578-81e1-cfc579c6984a service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:22:23.925630 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 509/1012] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:22:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:22:26.376195 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f47a2-6acb-4fe1-8956-e7dc1f4c9fb4 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:26.376813 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f47a2-6acb-4fe1-8956-e7dc1f4c9fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:26.376813 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f47a2-6acb-4fe1-8956-e7dc1f4c9fb4 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:26.378185 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 504/1013] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:22:26.383761 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b48a0-9e33-44e8-9c75-2ffbe612b0a1 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:26.384150 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b48a0-9e33-44e8-9c75-2ffbe612b0a1 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:26.384307 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b48a0-9e33-44e8-9c75-2ffbe612b0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:26.449167 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-a04b48a0-9e33-44e8-9c75-2ffbe612b0a1 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:22:26.450346 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-a04b48a0-9e33-44e8-9c75-2ffbe612b0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:26.552573 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 510/1014] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:22:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:22:26.833604 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f47a2-6acb-4fe1-8956-e7dc1f4c9fb4 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:22:26.835123 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-163f47a2-6acb-4fe1-8956-e7dc1f4c9fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:26.934811 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f47a2-6acb-4fe1-8956-e7dc1f4c9fb4 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:22:27.006911 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4106e3a-c775-43c4-a2f2-ee3df9e4a092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:22:27.007516 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4106e3a-c775-43c4-a2f2-ee3df9e4a092 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:27.007799 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4106e3a-c775-43c4-a2f2-ee3df9e4a092 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:27.008074 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4106e3a-c775-43c4-a2f2-ee3df9e4a092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:27.009700 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-a4106e3a-c775-43c4-a2f2-ee3df9e4a092 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:27.044591 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:22:27.116256 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4106e3a-c775-43c4-a2f2-ee3df9e4a092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:22:27.117697 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4106e3a-c775-43c4-a2f2-ee3df9e4a092 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:22:27.135593 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 505/1015] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:22:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:22:31.193641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a995cb-409a-462e-8d55-f81a72aa37fa None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:31.194235 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a995cb-409a-462e-8d55-f81a72aa37fa None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:31.194235 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a995cb-409a-462e-8d55-f81a72aa37fa None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:31.195532 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 511/1016] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:22:31.201424 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54db9d-d1fe-465e-b149-78287aa00f71 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:31.201850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54db9d-d1fe-465e-b149-78287aa00f71 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:31.202189 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54db9d-d1fe-465e-b149-78287aa00f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:31.269527 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-dd54db9d-d1fe-465e-b149-78287aa00f71 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:22:31.270635 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-dd54db9d-d1fe-465e-b149-78287aa00f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:31.358629 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:22:31.370415 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 506/1017] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:22:31.652361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a995cb-409a-462e-8d55-f81a72aa37fa None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:22:31.653900 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-a7a995cb-409a-462e-8d55-f81a72aa37fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:31.701925 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:22:31.757400 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a995cb-409a-462e-8d55-f81a72aa37fa None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:22:31.830975 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6338482-4686-4eed-a6a2-8f59631ac6a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:22:31.831580 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6338482-4686-4eed-a6a2-8f59631ac6a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:31.831858 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6338482-4686-4eed-a6a2-8f59631ac6a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:31.832129 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6338482-4686-4eed-a6a2-8f59631ac6a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:31.833733 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-a6338482-4686-4eed-a6a2-8f59631ac6a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:31.926396 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:22:31.943253 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6338482-4686-4eed-a6a2-8f59631ac6a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:22:31.944769 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6338482-4686-4eed-a6a2-8f59631ac6a3 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:22:31.967102 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 512/1018] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:22:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:22:34.770799 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce059b-82f2-4399-88a3-6fe4a69d8b68 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:34.771357 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce059b-82f2-4399-88a3-6fe4a69d8b68 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:34.771357 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce059b-82f2-4399-88a3-6fe4a69d8b68 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:34.772876 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 507/1019] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:22:34.777878 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32598ea-39c9-46bf-a091-7760c794e9ac None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:34.778282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32598ea-39c9-46bf-a091-7760c794e9ac None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:34.778581 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32598ea-39c9-46bf-a091-7760c794e9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:34.843984 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-e32598ea-39c9-46bf-a091-7760c794e9ac None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:22:34.845212 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-e32598ea-39c9-46bf-a091-7760c794e9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:34.942217 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 513/1020] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:22:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:22:35.230090 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce059b-82f2-4399-88a3-6fe4a69d8b68 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:22:35.231626 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-31ce059b-82f2-4399-88a3-6fe4a69d8b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:35.341149 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce059b-82f2-4399-88a3-6fe4a69d8b68 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:22:35.414007 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90174b78-822a-418c-9034-ca8613690d73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:22:35.414578 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90174b78-822a-418c-9034-ca8613690d73 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:35.414862 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90174b78-822a-418c-9034-ca8613690d73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:35.415141 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90174b78-822a-418c-9034-ca8613690d73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:35.416776 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-90174b78-822a-418c-9034-ca8613690d73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:35.460756 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:22:35.529079 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90174b78-822a-418c-9034-ca8613690d73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:22:35.530525 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90174b78-822a-418c-9034-ca8613690d73 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:22:35.548928 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 508/1021] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:22:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:22:39.662489 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093dc81c-edad-4140-9c8d-05d53a3f6ec8 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:39.663003 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093dc81c-edad-4140-9c8d-05d53a3f6ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:39.663093 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093dc81c-edad-4140-9c8d-05d53a3f6ec8 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:39.664973 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 514/1022] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:22:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:22:39.670378 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d1e54-08da-4e8b-979c-0b88891a1810 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:39.670832 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d1e54-08da-4e8b-979c-0b88891a1810 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:39.671005 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d1e54-08da-4e8b-979c-0b88891a1810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:39.739752 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-5e0d1e54-08da-4e8b-979c-0b88891a1810 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:22:39.741039 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-5e0d1e54-08da-4e8b-979c-0b88891a1810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:39.835588 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:22:39.838328 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 509/1023] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:22:40.125789 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093dc81c-edad-4140-9c8d-05d53a3f6ec8 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:22:40.127315 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-093dc81c-edad-4140-9c8d-05d53a3f6ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:40.184655 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:22:40.231474 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093dc81c-edad-4140-9c8d-05d53a3f6ec8 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:22:40.303369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac0e48-17d9-4221-9717-1e815135c1cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:22:40.303996 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac0e48-17d9-4221-9717-1e815135c1cd service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:40.304279 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac0e48-17d9-4221-9717-1e815135c1cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:40.304577 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac0e48-17d9-4221-9717-1e815135c1cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:40.306716 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-7eac0e48-17d9-4221-9717-1e815135c1cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:40.409567 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:22:40.413524 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac0e48-17d9-4221-9717-1e815135c1cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:22:40.415459 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac0e48-17d9-4221-9717-1e815135c1cd service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:22:40.434068 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 515/1024] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:22:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:22:45.320825 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75b3fc-8b9a-4b03-9e4d-c738730cdbc3 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:45.321262 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75b3fc-8b9a-4b03-9e4d-c738730cdbc3 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:45.321457 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75b3fc-8b9a-4b03-9e4d-c738730cdbc3 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:45.323235 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 510/1025] 10.222.0.23 () {54 vars in 921 bytes} [Wed Nov 2 20:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:22:45.328819 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e24449-3c21-46bd-a2c0-ccdebed9e492 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:45.329239 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e24449-3c21-46bd-a2c0-ccdebed9e492 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:45.329321 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e24449-3c21-46bd-a2c0-ccdebed9e492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:45.471870 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-04e24449-3c21-46bd-a2c0-ccdebed9e492 None None] MFA Rules not processed for user `603a9f31ae814003a2cbd02f964f4ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:22:45.473635 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-04e24449-3c21-46bd-a2c0-ccdebed9e492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:45.587602 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 516/1026] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Nov 2 20:22:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:22:49.775208 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7e999-1fb9-405f-934a-366c6c7fa62c None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:49.775718 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7e999-1fb9-405f-934a-366c6c7fa62c None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:49.775902 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7e999-1fb9-405f-934a-366c6c7fa62c None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:49.777572 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 511/1027] 10.222.0.23 () {54 vars in 921 bytes} [Wed Nov 2 20:22:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:22:49.782940 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac61c9-6340-476b-bbec-58460e1d44ff None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:49.783357 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac61c9-6340-476b-bbec-58460e1d44ff None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:49.783556 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac61c9-6340-476b-bbec-58460e1d44ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:49.840293 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:22:49.864412 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-07ac61c9-6340-476b-bbec-58460e1d44ff None None] MFA Rules not processed for user `603a9f31ae814003a2cbd02f964f4ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:22:49.865660 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-07ac61c9-6340-476b-bbec-58460e1d44ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:49.981536 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 517/1028] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Nov 2 20:22:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:22:51.277526 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556513be-805f-4046-8470-9d4d3bd81221 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:51.278049 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556513be-805f-4046-8470-9d4d3bd81221 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:51.278049 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556513be-805f-4046-8470-9d4d3bd81221 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:51.279338 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 512/1029] 10.222.0.23 () {54 vars in 921 bytes} [Wed Nov 2 20:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:22:51.284383 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470572b-0cc1-436d-b5de-23059acc1327 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:51.285214 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470572b-0cc1-436d-b5de-23059acc1327 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:51.285568 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470572b-0cc1-436d-b5de-23059acc1327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:51.372714 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-8470572b-0cc1-436d-b5de-23059acc1327 None None] MFA Rules not processed for user `603a9f31ae814003a2cbd02f964f4ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:22:51.373918 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-8470572b-0cc1-436d-b5de-23059acc1327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:51.415850 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:22:51.482664 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 518/1030] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Nov 2 20:22:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:22:55.003961 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4bb0d-f440-4533-a2ff-7be073096dff None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:55.004823 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4bb0d-f440-4533-a2ff-7be073096dff None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:55.005310 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4bb0d-f440-4533-a2ff-7be073096dff None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:55.010261 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 513/1031] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:22:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:22:55.013165 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df697e80-9f9a-48bf-9ebb-5cf470804a2a None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:55.013623 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df697e80-9f9a-48bf-9ebb-5cf470804a2a None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:55.013738 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df697e80-9f9a-48bf-9ebb-5cf470804a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:55.082625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-df697e80-9f9a-48bf-9ebb-5cf470804a2a None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:22:55.083829 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-df697e80-9f9a-48bf-9ebb-5cf470804a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:55.186826 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 519/1032] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:22:55.496748 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfa46e-65dd-4d5b-9faa-7a24976735e9 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:55.497298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfa46e-65dd-4d5b-9faa-7a24976735e9 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:55.497683 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfa46e-65dd-4d5b-9faa-7a24976735e9 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:55.501062 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 514/1033] 10.222.0.23 () {54 vars in 961 bytes} [Wed Nov 2 20:22:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:22:55.510952 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833de4c-251f-4bb5-82a4-128ae5b7aeb7 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:55.511476 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833de4c-251f-4bb5-82a4-128ae5b7aeb7 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:55.512565 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833de4c-251f-4bb5-82a4-128ae5b7aeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:55.533067 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:22:55.599954 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-0833de4c-251f-4bb5-82a4-128ae5b7aeb7 None None] MFA Rules not processed for user `f906fd11db004026a78eb3d69fa5b298`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:22:55.601389 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-0833de4c-251f-4bb5-82a4-128ae5b7aeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:55.727351 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 520/1034] 10.222.0.23 () {58 vars in 1058 bytes} [Wed Nov 2 20:22:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:22:55.735304 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfa46e-65dd-4d5b-9faa-7a24976735e9 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:22:55.736946 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-7dcfa46e-65dd-4d5b-9faa-7a24976735e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:55.895821 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfa46e-65dd-4d5b-9faa-7a24976735e9 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:22:55.975877 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:22:56.020597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6648b9-c08e-48c2-b383-900ed4c75813 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:22:56.021291 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6648b9-c08e-48c2-b383-900ed4c75813 service nova] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:56.021645 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6648b9-c08e-48c2-b383-900ed4c75813 service nova] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:56.022012 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6648b9-c08e-48c2-b383-900ed4c75813 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:56.023831 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-0f6648b9-c08e-48c2-b383-900ed4c75813 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:56.124262 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6648b9-c08e-48c2-b383-900ed4c75813 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:22:56.126080 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6648b9-c08e-48c2-b383-900ed4c75813 service nova] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:22:56.146396 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 515/1035] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:22:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:22:58.530928 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3baa0f-119a-4bb9-8d2b-8bc14660026a None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:58.531402 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3baa0f-119a-4bb9-8d2b-8bc14660026a None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:58.531487 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3baa0f-119a-4bb9-8d2b-8bc14660026a None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:58.533010 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 521/1036] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:22:58.537982 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b87626-c878-4924-b42c-46777bdde4c0 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:58.538400 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b87626-c878-4924-b42c-46777bdde4c0 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:58.538540 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b87626-c878-4924-b42c-46777bdde4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:58.613660 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-c9b87626-c878-4924-b42c-46777bdde4c0 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:22:58.614868 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-c9b87626-c878-4924-b42c-46777bdde4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:58.653639 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:22:58.714462 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 516/1037] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:22:58.999728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3baa0f-119a-4bb9-8d2b-8bc14660026a None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:22:59.001502 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-8b3baa0f-119a-4bb9-8d2b-8bc14660026a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:59.080021 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:22:59.189994 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3baa0f-119a-4bb9-8d2b-8bc14660026a None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:22:59.321065 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed697a3d-b64d-4477-8d54-ee5a338543a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:22:59.321681 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed697a3d-b64d-4477-8d54-ee5a338543a7 service nova] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:22:59.321964 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed697a3d-b64d-4477-8d54-ee5a338543a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:22:59.322237 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed697a3d-b64d-4477-8d54-ee5a338543a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:22:59.323846 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-ed697a3d-b64d-4477-8d54-ee5a338543a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:22:59.347152 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:22:59.421429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed697a3d-b64d-4477-8d54-ee5a338543a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:22:59.423048 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed697a3d-b64d-4477-8d54-ee5a338543a7 service nova] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:22:59.442905 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 522/1038] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:22:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:23:01.929143 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a9d88-7350-4866-b370-1dbbacac38ef None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:01.930193 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a9d88-7350-4866-b370-1dbbacac38ef None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:01.930193 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a9d88-7350-4866-b370-1dbbacac38ef None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:01.931734 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 517/1039] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:23:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:23:01.936742 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a4664-0940-48ba-958b-8bd3ced18ab1 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:01.937126 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a4664-0940-48ba-958b-8bd3ced18ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:01.937330 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a4664-0940-48ba-958b-8bd3ced18ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:02.006329 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-475a4664-0940-48ba-958b-8bd3ced18ab1 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:23:02.007537 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-475a4664-0940-48ba-958b-8bd3ced18ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:02.110964 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:02.113688 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 523/1040] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:23:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:23:02.406076 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae52f8-429f-4550-b760-ae6cabaaacb3 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:02.406362 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae52f8-429f-4550-b760-ae6cabaaacb3 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:02.406669 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae52f8-429f-4550-b760-ae6cabaaacb3 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:02.408135 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 518/1041] 10.222.0.23 () {54 vars in 961 bytes} [Wed Nov 2 20:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:23:02.413687 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e930d00-9a12-41ab-989d-31f7927569e1 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:02.413976 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e930d00-9a12-41ab-989d-31f7927569e1 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:02.414926 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e930d00-9a12-41ab-989d-31f7927569e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:02.494642 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-2e930d00-9a12-41ab-989d-31f7927569e1 None None] MFA Rules not processed for user `f906fd11db004026a78eb3d69fa5b298`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:23:02.495836 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-2e930d00-9a12-41ab-989d-31f7927569e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:02.620780 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 524/1042] 10.222.0.23 () {58 vars in 1058 bytes} [Wed Nov 2 20:23:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:23:02.629057 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae52f8-429f-4550-b760-ae6cabaaacb3 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:23:02.630566 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-d5ae52f8-429f-4550-b760-ae6cabaaacb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:02.783956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae52f8-429f-4550-b760-ae6cabaaacb3 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:23:02.806198 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:02.908684 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7bddf-ab2e-4365-ad73-f62654673195 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:23:02.909472 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7bddf-ab2e-4365-ad73-f62654673195 service nova] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:02.909750 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7bddf-ab2e-4365-ad73-f62654673195 service nova] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:02.910022 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7bddf-ab2e-4365-ad73-f62654673195 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:02.911741 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-efb7bddf-ab2e-4365-ad73-f62654673195 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:03.014075 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7bddf-ab2e-4365-ad73-f62654673195 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:23:03.015663 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7bddf-ab2e-4365-ad73-f62654673195 service nova] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:23:03.034922 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 519/1043] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:23:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 20:23:03.091683 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c387dd-a861-4aa8-843c-e0feb2c9d9e7 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:03.092182 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c387dd-a861-4aa8-843c-e0feb2c9d9e7 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:03.092281 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c387dd-a861-4aa8-843c-e0feb2c9d9e7 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:03.093772 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 525/1044] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:23:03.098898 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea943125-15af-4fcd-87c7-462d562cff76 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:03.099197 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea943125-15af-4fcd-87c7-462d562cff76 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:03.099480 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea943125-15af-4fcd-87c7-462d562cff76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:03.134034 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:03.178517 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-ea943125-15af-4fcd-87c7-462d562cff76 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:23:03.180395 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-ea943125-15af-4fcd-87c7-462d562cff76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:03.300071 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 520/1045] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:23:03.635015 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a14de3-9870-4e20-98d3-a9b2aa61bc1a None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:03.635015 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a14de3-9870-4e20-98d3-a9b2aa61bc1a None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:03.635015 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a14de3-9870-4e20-98d3-a9b2aa61bc1a None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:03.636903 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 526/1046] 10.222.0.23 () {54 vars in 963 bytes} [Wed Nov 2 20:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:23:03.640351 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46f69d-7b32-41b1-836c-095b334525a7 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:03.640837 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46f69d-7b32-41b1-836c-095b334525a7 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:03.641212 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46f69d-7b32-41b1-836c-095b334525a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:03.722119 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-bc46f69d-7b32-41b1-836c-095b334525a7 None None] MFA Rules not processed for user `3860ca67d4c446ac9d7617fb4608408f`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:23:03.723451 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-bc46f69d-7b32-41b1-836c-095b334525a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:03.774952 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:03.807624 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 521/1047] 10.222.0.23 () {58 vars in 1060 bytes} [Wed Nov 2 20:23:03 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:23:03.815271 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a14de3-9870-4e20-98d3-a9b2aa61bc1a None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:23:03.817059 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-b4a14de3-9870-4e20-98d3-a9b2aa61bc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:03.870405 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:03.927006 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a14de3-9870-4e20-98d3-a9b2aa61bc1a None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:23:04.013499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7488a39-7f2b-4d54-9f40-84bb0f462a0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:23:04.014124 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7488a39-7f2b-4d54-9f40-84bb0f462a0e service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:04.014404 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7488a39-7f2b-4d54-9f40-84bb0f462a0e service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:04.014674 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7488a39-7f2b-4d54-9f40-84bb0f462a0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:04.016391 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-a7488a39-7f2b-4d54-9f40-84bb0f462a0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:04.134101 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:04.150769 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7488a39-7f2b-4d54-9f40-84bb0f462a0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:23:04.152197 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7488a39-7f2b-4d54-9f40-84bb0f462a0e service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:23:04.171912 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 527/1048] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:23:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:23:05.281746 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44faa393-e889-49bc-9b32-ccb4dcaff1f7 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:05.282261 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44faa393-e889-49bc-9b32-ccb4dcaff1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:05.282261 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44faa393-e889-49bc-9b32-ccb4dcaff1f7 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:05.283545 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 522/1049] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:23:05.288726 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c59e7-d9cb-498d-a5c9-50d32160f957 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:05.289206 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c59e7-d9cb-498d-a5c9-50d32160f957 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:05.289313 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c59e7-d9cb-498d-a5c9-50d32160f957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:05.354675 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-c20c59e7-d9cb-498d-a5c9-50d32160f957 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:23:05.355875 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-c20c59e7-d9cb-498d-a5c9-50d32160f957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:05.453137 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 528/1050] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:23:05.748939 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44faa393-e889-49bc-9b32-ccb4dcaff1f7 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:23:05.750525 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-44faa393-e889-49bc-9b32-ccb4dcaff1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:05.905595 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44faa393-e889-49bc-9b32-ccb4dcaff1f7 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:23:05.959191 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:06.023024 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113285b-dc54-4fd5-b74c-08d16859293a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:23:06.024351 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113285b-dc54-4fd5-b74c-08d16859293a service nova] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:06.024713 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113285b-dc54-4fd5-b74c-08d16859293a service nova] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:06.024993 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113285b-dc54-4fd5-b74c-08d16859293a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:06.026592 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-7113285b-dc54-4fd5-b74c-08d16859293a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:06.120814 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113285b-dc54-4fd5-b74c-08d16859293a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:23:06.122419 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113285b-dc54-4fd5-b74c-08d16859293a service nova] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:23:06.141512 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 523/1051] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:23:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:23:08.362131 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ad609-480b-4e95-a832-c5d37a1243b0 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:08.362671 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ad609-480b-4e95-a832-c5d37a1243b0 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:08.362671 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ad609-480b-4e95-a832-c5d37a1243b0 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:08.364142 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 529/1052] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:23:08.369382 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d130a0-c453-4308-b33c-217e87e0488b None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:08.369785 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d130a0-c453-4308-b33c-217e87e0488b None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:08.369951 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d130a0-c453-4308-b33c-217e87e0488b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:08.452444 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-38d130a0-c453-4308-b33c-217e87e0488b None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:23:08.454127 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-38d130a0-c453-4308-b33c-217e87e0488b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:08.463713 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:08.572580 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 524/1053] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:23:08.856402 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ad609-480b-4e95-a832-c5d37a1243b0 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:23:08.858078 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-7f0ad609-480b-4e95-a832-c5d37a1243b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:08.921570 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:09.016281 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ad609-480b-4e95-a832-c5d37a1243b0 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:23:09.134161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6fab5-1b2a-41c3-aa46-b6938506cd40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:23:09.134697 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6fab5-1b2a-41c3-aa46-b6938506cd40 service nova] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:09.134965 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6fab5-1b2a-41c3-aa46-b6938506cd40 service nova] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:09.135233 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6fab5-1b2a-41c3-aa46-b6938506cd40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:09.136822 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-6ae6fab5-1b2a-41c3-aa46-b6938506cd40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:09.156391 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:09.237445 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae6fab5-1b2a-41c3-aa46-b6938506cd40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:23:09.239036 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae6fab5-1b2a-41c3-aa46-b6938506cd40 service nova] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:23:09.258974 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 530/1054] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:23:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:23:11.470294 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fdd70-3fc8-4cef-9cb9-cd731e3a0651 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:11.470747 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fdd70-3fc8-4cef-9cb9-cd731e3a0651 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:11.470838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fdd70-3fc8-4cef-9cb9-cd731e3a0651 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:11.476124 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 525/1055] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:23:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:23:11.477854 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b52c2-ea38-457c-a24f-a18ba04dfccd None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:11.478591 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b52c2-ea38-457c-a24f-a18ba04dfccd None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:11.479019 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b52c2-ea38-457c-a24f-a18ba04dfccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:11.558950 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-359b52c2-ea38-457c-a24f-a18ba04dfccd None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:23:11.560145 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-359b52c2-ea38-457c-a24f-a18ba04dfccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:11.656872 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:11.662806 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 531/1056] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:23:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:23:11.952396 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221fdd70-3fc8-4cef-9cb9-cd731e3a0651 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:23:11.954032 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-221fdd70-3fc8-4cef-9cb9-cd731e3a0651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:12.099935 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:12.111589 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221fdd70-3fc8-4cef-9cb9-cd731e3a0651 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:23:12.240347 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb96e52-b4ad-4f51-a5b4-47cdf7d7d9fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:23:12.240921 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb96e52-b4ad-4f51-a5b4-47cdf7d7d9fb service nova] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:12.241207 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb96e52-b4ad-4f51-a5b4-47cdf7d7d9fb service nova] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:12.241485 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb96e52-b4ad-4f51-a5b4-47cdf7d7d9fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:12.243633 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-1fb96e52-b4ad-4f51-a5b4-47cdf7d7d9fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:12.342331 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb96e52-b4ad-4f51-a5b4-47cdf7d7d9fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:23:12.343936 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb96e52-b4ad-4f51-a5b4-47cdf7d7d9fb service nova] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:23:12.354162 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:12.363058 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 526/1057] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:23:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:23:14.564779 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b253bf-4654-4d63-a158-2b57af317653 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:14.565322 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b253bf-4654-4d63-a158-2b57af317653 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:14.565322 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b253bf-4654-4d63-a158-2b57af317653 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:14.566916 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 532/1058] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:23:14.573859 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c23e3-29a4-49cc-a252-6a0c7bf4cc1d None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:14.574359 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c23e3-29a4-49cc-a252-6a0c7bf4cc1d None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:14.574558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c23e3-29a4-49cc-a252-6a0c7bf4cc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:14.649712 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-ba2c23e3-29a4-49cc-a252-6a0c7bf4cc1d None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:23:14.651536 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-ba2c23e3-29a4-49cc-a252-6a0c7bf4cc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:14.763817 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 527/1059] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:23:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:23:15.131014 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b253bf-4654-4d63-a158-2b57af317653 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:23:15.133498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-74b253bf-4654-4d63-a158-2b57af317653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:15.298304 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b253bf-4654-4d63-a158-2b57af317653 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:23:15.372753 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:15.425218 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840801c-263f-43df-8820-7f55ad81418d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:23:15.425831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840801c-263f-43df-8820-7f55ad81418d service nova] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:15.426118 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840801c-263f-43df-8820-7f55ad81418d service nova] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:15.426398 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840801c-263f-43df-8820-7f55ad81418d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:15.428017 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-8840801c-263f-43df-8820-7f55ad81418d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:15.534197 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840801c-263f-43df-8820-7f55ad81418d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:23:15.535815 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840801c-263f-43df-8820-7f55ad81418d service nova] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:23:15.556327 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 533/1060] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:23:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:23:17.843341 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30c829-5666-4eb4-b331-1ba611034c35 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:17.843897 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30c829-5666-4eb4-b331-1ba611034c35 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:17.843897 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30c829-5666-4eb4-b331-1ba611034c35 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:17.845302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 528/1061] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:23:17.850702 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62430bf2-adaa-403e-a420-863506e0d155 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:17.851116 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62430bf2-adaa-403e-a420-863506e0d155 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:17.851247 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62430bf2-adaa-403e-a420-863506e0d155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:17.916872 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-62430bf2-adaa-403e-a420-863506e0d155 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:23:17.918068 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-62430bf2-adaa-403e-a420-863506e0d155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:17.951133 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:18.014987 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 534/1062] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:23:18.300361 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30c829-5666-4eb4-b331-1ba611034c35 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:23:18.301898 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-2f30c829-5666-4eb4-b331-1ba611034c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:18.378641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:18.448752 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30c829-5666-4eb4-b331-1ba611034c35 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:23:18.564892 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c7b8c-7165-4be2-8073-97d62ef2604e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:23:18.565414 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c7b8c-7165-4be2-8073-97d62ef2604e service nova] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:18.565691 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c7b8c-7165-4be2-8073-97d62ef2604e service nova] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:18.565962 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c7b8c-7165-4be2-8073-97d62ef2604e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:18.567800 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-676c7b8c-7165-4be2-8073-97d62ef2604e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:18.607893 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:18.661651 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c7b8c-7165-4be2-8073-97d62ef2604e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:23:18.663234 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c7b8c-7165-4be2-8073-97d62ef2604e service nova] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:23:18.682399 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 529/1063] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:23:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:23:19.420594 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84413c-4c16-4ca7-8705-aee8983a7e3b None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:19.421193 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84413c-4c16-4ca7-8705-aee8983a7e3b None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:19.421193 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84413c-4c16-4ca7-8705-aee8983a7e3b None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:19.422463 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 535/1064] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:23:19.427613 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2052e6-ca80-4340-98ce-bc40890959ed None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:19.428034 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2052e6-ca80-4340-98ce-bc40890959ed None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:19.428166 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2052e6-ca80-4340-98ce-bc40890959ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:19.495421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-ac2052e6-ca80-4340-98ce-bc40890959ed None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:23:19.496648 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-ac2052e6-ca80-4340-98ce-bc40890959ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:19.599915 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 530/1065] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:23:19.897962 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea75107-0e66-46c3-b401-591b1b77920c None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:19.898251 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea75107-0e66-46c3-b401-591b1b77920c None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:19.898527 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea75107-0e66-46c3-b401-591b1b77920c None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:19.900025 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 536/1066] 10.222.0.23 () {54 vars in 962 bytes} [Wed Nov 2 20:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:23:19.905452 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947b507-547e-403b-a878-1c421f55c09c None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:19.905866 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947b507-547e-403b-a878-1c421f55c09c None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:19.906145 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947b507-547e-403b-a878-1c421f55c09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:19.921930 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:19.982736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-8947b507-547e-403b-a878-1c421f55c09c None None] MFA Rules not processed for user `62ca656e59ff46b08661385d8ec79846`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:23:19.983946 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-8947b507-547e-403b-a878-1c421f55c09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:20.058771 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 531/1067] 10.222.0.23 () {58 vars in 1059 bytes} [Wed Nov 2 20:23:19 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:23:20.066669 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea75107-0e66-46c3-b401-591b1b77920c None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:23:20.068471 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-5ea75107-0e66-46c3-b401-591b1b77920c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:20.169224 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea75107-0e66-46c3-b401-591b1b77920c None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:23:20.227455 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:20.243272 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44923c4-a60c-4ed0-819a-85ab6c82a98f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62ca656e59ff46b08661385d8ec79846', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:23:20.243878 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44923c4-a60c-4ed0-819a-85ab6c82a98f service glance] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:20.244155 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44923c4-a60c-4ed0-819a-85ab6c82a98f service glance] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:20.244428 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44923c4-a60c-4ed0-819a-85ab6c82a98f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:20.246038 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-f44923c4-a60c-4ed0-819a-85ab6c82a98f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:20.354408 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44923c4-a60c-4ed0-819a-85ab6c82a98f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:23:20.355846 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44923c4-a60c-4ed0-819a-85ab6c82a98f service glance] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:23:20.374365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 537/1068] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:23:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:23:20.849251 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eec6bb-3b34-4145-8126-9df3b1c76b60 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:20.849768 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eec6bb-3b34-4145-8126-9df3b1c76b60 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:20.849897 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eec6bb-3b34-4145-8126-9df3b1c76b60 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:20.851233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 532/1069] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:23:20.856835 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5c8bb-619d-46a6-97df-931ca3f05ce8 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:20.857262 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5c8bb-619d-46a6-97df-931ca3f05ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:20.857404 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5c8bb-619d-46a6-97df-931ca3f05ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:20.928777 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-9bd5c8bb-619d-46a6-97df-931ca3f05ce8 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:23:20.930019 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-9bd5c8bb-619d-46a6-97df-931ca3f05ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:20.978087 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:21.038906 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 538/1070] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:23:21.117844 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879424f-0914-44db-8c66-bbb648995331 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:21.118026 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879424f-0914-44db-8c66-bbb648995331 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:21.118580 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879424f-0914-44db-8c66-bbb648995331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:21.192302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-b879424f-0914-44db-8c66-bbb648995331 None None] MFA Rules not processed for user `66937804f65147f392f4ddfc3e961d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:23:21.193773 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-b879424f-0914-44db-8c66-bbb648995331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:21.256157 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:21.297074 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 533/1071] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Nov 2 20:23:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:23:21.339265 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5c8bb-619d-46a6-97df-931ca3f05ce8 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:23:21.340465 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-9bd5c8bb-619d-46a6-97df-931ca3f05ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:21.348920 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c09cf-3904-4f30-861a-2afcbc7dbe9c None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:21.349409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c09cf-3904-4f30-861a-2afcbc7dbe9c None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:21.349762 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c09cf-3904-4f30-861a-2afcbc7dbe9c None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:21.351437 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 534/1072] 10.222.0.23 () {54 vars in 943 bytes} [Wed Nov 2 20:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:23:21.357871 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5ae77-48c6-42a0-8a4d-a5e396226ef3 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:21.358154 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5ae77-48c6-42a0-8a4d-a5e396226ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:21.358428 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5ae77-48c6-42a0-8a4d-a5e396226ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:21.435872 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-c5e5ae77-48c6-42a0-8a4d-a5e396226ef3 None None] MFA Rules not processed for user `95f22f80ac694e9888c132af1e58e292`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:23:21.437101 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-c5e5ae77-48c6-42a0-8a4d-a5e396226ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:21.457953 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5c8bb-619d-46a6-97df-931ca3f05ce8 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:23:21.514442 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:21.549422 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 535/1073] 10.222.0.23 () {58 vars in 1040 bytes} [Wed Nov 2 20:23:21 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:23:21.559236 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e5ae77-48c6-42a0-8a4d-a5e396226ef3 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:23:21.569089 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e5ae77-48c6-42a0-8a4d-a5e396226ef3 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:23:21.580083 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c4b3a-2101-4ed6-a279-da708c284879 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:23:21.580721 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c4b3a-2101-4ed6-a279-da708c284879 service nova] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:21.581004 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c4b3a-2101-4ed6-a279-da708c284879 service nova] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:21.581277 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c4b3a-2101-4ed6-a279-da708c284879 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:21.582869 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-7e3c4b3a-2101-4ed6-a279-da708c284879 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:21.596302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:21.673905 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c4b3a-2101-4ed6-a279-da708c284879 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:23:21.675425 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c4b3a-2101-4ed6-a279-da708c284879 service nova] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:23:21.675761 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd06261-b648-4ea7-ae0c-ecb410875407 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f22f80ac694e9888c132af1e58e292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:23:21.676370 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd06261-b648-4ea7-ae0c-ecb410875407 service swift] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:21.676689 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd06261-b648-4ea7-ae0c-ecb410875407 service swift] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:21.676964 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd06261-b648-4ea7-ae0c-ecb410875407 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:21.678630 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-edd06261-b648-4ea7-ae0c-ecb410875407 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:21.693683 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 539/1074] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:23:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:23:21.766706 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd06261-b648-4ea7-ae0c-ecb410875407 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:23:21.768468 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd06261-b648-4ea7-ae0c-ecb410875407 service swift] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:23:21.778312 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 536/1075] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Nov 2 20:23:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 20:23:23.907351 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cc77e-2a5c-4665-80a3-50115eb7d15b None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:23.907974 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cc77e-2a5c-4665-80a3-50115eb7d15b None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:23.907974 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cc77e-2a5c-4665-80a3-50115eb7d15b None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:23.909529 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 540/1076] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:23:23.914815 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aebcf0-49e7-4413-a035-c220915d6881 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:23.915265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aebcf0-49e7-4413-a035-c220915d6881 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:23.915361 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aebcf0-49e7-4413-a035-c220915d6881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:23.988574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-98aebcf0-49e7-4413-a035-c220915d6881 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:23:23.989790 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-98aebcf0-49e7-4413-a035-c220915d6881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:23.997082 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:24.098135 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 537/1077] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:23:24.392113 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cc77e-2a5c-4665-80a3-50115eb7d15b None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:23:24.393719 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-b02cc77e-2a5c-4665-80a3-50115eb7d15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:24.476050 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:24.570306 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cc77e-2a5c-4665-80a3-50115eb7d15b None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:23:24.694859 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46615d4a-8a8a-45e1-b8fe-a386d9f7ea65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:23:24.695478 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46615d4a-8a8a-45e1-b8fe-a386d9f7ea65 service nova] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:24.696270 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46615d4a-8a8a-45e1-b8fe-a386d9f7ea65 service nova] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:24.696559 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46615d4a-8a8a-45e1-b8fe-a386d9f7ea65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:24.698473 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-46615d4a-8a8a-45e1-b8fe-a386d9f7ea65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:24.726241 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:24.795986 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46615d4a-8a8a-45e1-b8fe-a386d9f7ea65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:23:24.797623 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46615d4a-8a8a-45e1-b8fe-a386d9f7ea65 service nova] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:23:24.820989 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 541/1078] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:23:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:23:27.062254 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85281ec-8cb7-440c-9334-4a87770985b4 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:27.062254 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85281ec-8cb7-440c-9334-4a87770985b4 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:27.062254 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85281ec-8cb7-440c-9334-4a87770985b4 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:27.062254 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 538/1079] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:23:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:23:27.064410 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95ff41-bc4e-4a9f-a230-6853411e2de2 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:27.064902 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95ff41-bc4e-4a9f-a230-6853411e2de2 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:27.068628 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95ff41-bc4e-4a9f-a230-6853411e2de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:27.183728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-db95ff41-bc4e-4a9f-a230-6853411e2de2 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:23:27.184936 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-db95ff41-bc4e-4a9f-a230-6853411e2de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:27.303556 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 542/1080] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:23:27.594314 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85281ec-8cb7-440c-9334-4a87770985b4 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:23:27.595884 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-d85281ec-8cb7-440c-9334-4a87770985b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:27.753956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:27.769742 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85281ec-8cb7-440c-9334-4a87770985b4 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:23:27.898731 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25eea2-161e-40c5-b757-3c6ddd23f861 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:23:27.899948 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25eea2-161e-40c5-b757-3c6ddd23f861 service nova] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:27.900303 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25eea2-161e-40c5-b757-3c6ddd23f861 service nova] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:27.900676 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25eea2-161e-40c5-b757-3c6ddd23f861 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:27.902289 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-5b25eea2-161e-40c5-b757-3c6ddd23f861 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:28.002625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25eea2-161e-40c5-b757-3c6ddd23f861 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:23:28.004240 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25eea2-161e-40c5-b757-3c6ddd23f861 service nova] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:23:28.017000 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:28.027960 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 539/1081] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:23:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:23:30.251826 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacd32d-95e0-4e2f-a721-85b3e9faed98 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:30.252428 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacd32d-95e0-4e2f-a721-85b3e9faed98 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:30.252428 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacd32d-95e0-4e2f-a721-85b3e9faed98 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:30.253757 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 543/1082] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:23:30.259197 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be048ffb-9ed8-469d-a9a3-9429a29b4c75 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:30.259616 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be048ffb-9ed8-469d-a9a3-9429a29b4c75 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:30.259815 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be048ffb-9ed8-469d-a9a3-9429a29b4c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:30.334484 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-be048ffb-9ed8-469d-a9a3-9429a29b4c75 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:23:30.335703 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-be048ffb-9ed8-469d-a9a3-9429a29b4c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:30.452587 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 540/1083] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:23:30.743442 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacd32d-95e0-4e2f-a721-85b3e9faed98 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:23:30.744994 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-4bacd32d-95e0-4e2f-a721-85b3e9faed98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:30.747851 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:30.903591 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacd32d-95e0-4e2f-a721-85b3e9faed98 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:23:30.988269 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:31.031641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232028f4-f1df-41e8-99c9-f98b1058c373 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:23:31.032230 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232028f4-f1df-41e8-99c9-f98b1058c373 service nova] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:31.032506 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232028f4-f1df-41e8-99c9-f98b1058c373 service nova] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:31.032812 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232028f4-f1df-41e8-99c9-f98b1058c373 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:31.034396 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-232028f4-f1df-41e8-99c9-f98b1058c373 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:31.154744 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232028f4-f1df-41e8-99c9-f98b1058c373 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:23:31.156805 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232028f4-f1df-41e8-99c9-f98b1058c373 service nova] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:23:31.194136 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 544/1084] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:23:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:23:40.447347 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=67 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:41.189444 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=61 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:44.784484 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e3925-c3b9-4a49-8585-b3d86760d7c9 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:44.785053 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e3925-c3b9-4a49-8585-b3d86760d7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:44.785053 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e3925-c3b9-4a49-8585-b3d86760d7c9 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:44.786313 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 541/1085] 10.222.0.23 () {54 vars in 918 bytes} [Wed Nov 2 20:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:23:44.791836 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217c8c4-b308-49b8-ae32-7f709bc855db None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:44.792233 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217c8c4-b308-49b8-ae32-7f709bc855db None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:44.792387 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217c8c4-b308-49b8-ae32-7f709bc855db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:44.867086 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-c217c8c4-b308-49b8-ae32-7f709bc855db None None] MFA Rules not processed for user `603a9f31ae814003a2cbd02f964f4ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:23:44.868322 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-c217c8c4-b308-49b8-ae32-7f709bc855db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:44.971710 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 545/1086] 10.222.0.23 () {58 vars in 1015 bytes} [Wed Nov 2 20:23:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:23:44.985856 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7a220-916b-408a-adb4-34d1527f9b18 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:44.986143 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7a220-916b-408a-adb4-34d1527f9b18 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:44.986421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7a220-916b-408a-adb4-34d1527f9b18 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:44.987776 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 542/1087] 10.222.0.23 () {54 vars in 918 bytes} [Wed Nov 2 20:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:23:44.992229 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2458a4-5448-4356-a26c-d87be90b304c None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:44.992560 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2458a4-5448-4356-a26c-d87be90b304c None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:44.992851 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2458a4-5448-4356-a26c-d87be90b304c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:45.065928 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:45.069265 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-8d2458a4-5448-4356-a26c-d87be90b304c None None] MFA Rules not processed for user `f906fd11db004026a78eb3d69fa5b298`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:23:45.071562 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-8d2458a4-5448-4356-a26c-d87be90b304c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:45.183861 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 546/1088] 10.222.0.23 () {58 vars in 1015 bytes} [Wed Nov 2 20:23:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:23:47.762490 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630d346-19a4-44a7-b181-5f8fa5d10c32 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:47.763053 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630d346-19a4-44a7-b181-5f8fa5d10c32 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:47.763053 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630d346-19a4-44a7-b181-5f8fa5d10c32 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:47.764384 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 543/1089] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 20:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:23:47.769768 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0a5d0-594a-47ce-816c-e376719b7b1b None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:47.770171 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0a5d0-594a-47ce-816c-e376719b7b1b None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:47.770280 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0a5d0-594a-47ce-816c-e376719b7b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:47.835260 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-f2f0a5d0-594a-47ce-816c-e376719b7b1b None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:23:47.837069 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-f2f0a5d0-594a-47ce-816c-e376719b7b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:47.890577 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:47.932044 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 547/1090] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 20:23:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:23:48.223877 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630d346-19a4-44a7-b181-5f8fa5d10c32 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:23:48.225522 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-f630d346-19a4-44a7-b181-5f8fa5d10c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:48.369324 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630d346-19a4-44a7-b181-5f8fa5d10c32 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:23:48.440384 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:48.481056 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44a941-4220-484d-b4c8-886718783654 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:23:48.481597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44a941-4220-484d-b4c8-886718783654 service nova] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:48.481881 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44a941-4220-484d-b4c8-886718783654 service nova] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:48.482157 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44a941-4220-484d-b4c8-886718783654 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:48.483758 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-8f44a941-4220-484d-b4c8-886718783654 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:48.576395 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f44a941-4220-484d-b4c8-886718783654 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:23:48.578012 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f44a941-4220-484d-b4c8-886718783654 service nova] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:23:48.595783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 544/1091] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:23:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:23:49.718355 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7d570-34ae-42b8-ad62-c4b3d6eca410 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:49.718922 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7d570-34ae-42b8-ad62-c4b3d6eca410 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:49.718922 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7d570-34ae-42b8-ad62-c4b3d6eca410 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:49.720257 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 548/1092] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 20:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:23:49.725243 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7af29-e414-4cd9-98d2-5b438f22ca59 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:49.725669 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7af29-e414-4cd9-98d2-5b438f22ca59 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:49.725780 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7af29-e414-4cd9-98d2-5b438f22ca59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:49.801659 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-b7f7af29-e414-4cd9-98d2-5b438f22ca59 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:23:49.802780 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-b7f7af29-e414-4cd9-98d2-5b438f22ca59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:49.830327 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:49.898357 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 545/1093] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 20:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:23:50.059805 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7d570-34ae-42b8-ad62-c4b3d6eca410 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:23:50.061289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-35c7d570-34ae-42b8-ad62-c4b3d6eca410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:50.204809 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7d570-34ae-42b8-ad62-c4b3d6eca410 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:23:50.245842 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:50.317164 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93d841-359c-46a8-89ad-1b55c1a9c0d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:23:50.317691 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93d841-359c-46a8-89ad-1b55c1a9c0d7 service nova] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:50.318223 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93d841-359c-46a8-89ad-1b55c1a9c0d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:50.318493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93d841-359c-46a8-89ad-1b55c1a9c0d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:50.320068 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-cb93d841-359c-46a8-89ad-1b55c1a9c0d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:50.406859 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93d841-359c-46a8-89ad-1b55c1a9c0d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:23:50.408458 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93d841-359c-46a8-89ad-1b55c1a9c0d7 service nova] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:23:50.426562 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 549/1094] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:23:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:23:51.538444 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2e476-a008-4951-ba53-30383841fa0d None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:51.538882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2e476-a008-4951-ba53-30383841fa0d None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:51.538987 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2e476-a008-4951-ba53-30383841fa0d None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:51.541214 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 546/1095] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 20:23:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:23:51.546109 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed80aea-1a8d-49b6-aa58-9a0735063fa1 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:51.546554 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed80aea-1a8d-49b6-aa58-9a0735063fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:51.546660 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed80aea-1a8d-49b6-aa58-9a0735063fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:51.600292 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:51.623164 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-4ed80aea-1a8d-49b6-aa58-9a0735063fa1 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:23:51.624380 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-4ed80aea-1a8d-49b6-aa58-9a0735063fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:51.718349 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 550/1096] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 20:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:23:51.872008 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2e476-a008-4951-ba53-30383841fa0d None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:23:51.873550 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-f1e2e476-a008-4951-ba53-30383841fa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:52.016039 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2e476-a008-4951-ba53-30383841fa0d None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:23:52.028453 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:52.127928 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177dd97c-31a0-4e1e-aac0-1d9d2f8ba67e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:23:52.128449 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177dd97c-31a0-4e1e-aac0-1d9d2f8ba67e service nova] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:52.128755 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177dd97c-31a0-4e1e-aac0-1d9d2f8ba67e service nova] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:52.129029 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177dd97c-31a0-4e1e-aac0-1d9d2f8ba67e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:52.130607 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-177dd97c-31a0-4e1e-aac0-1d9d2f8ba67e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:52.218074 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177dd97c-31a0-4e1e-aac0-1d9d2f8ba67e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:23:52.219654 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177dd97c-31a0-4e1e-aac0-1d9d2f8ba67e service nova] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:23:52.237846 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 547/1097] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:23:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:23:53.321336 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514365b-79d7-4d3c-b3e1-b1abb70c4700 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:53.321881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514365b-79d7-4d3c-b3e1-b1abb70c4700 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:53.321881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514365b-79d7-4d3c-b3e1-b1abb70c4700 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:53.323202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 551/1098] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 20:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:23:53.328150 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861de5a7-f5b3-4903-abdb-974bc57dbccf None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:53.328572 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861de5a7-f5b3-4903-abdb-974bc57dbccf None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:53.328734 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861de5a7-f5b3-4903-abdb-974bc57dbccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:53.348209 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:53.405418 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-861de5a7-f5b3-4903-abdb-974bc57dbccf None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:23:53.406621 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-861de5a7-f5b3-4903-abdb-974bc57dbccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:53.502074 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 548/1099] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 20:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:23:53.651636 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514365b-79d7-4d3c-b3e1-b1abb70c4700 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:23:53.653084 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-3514365b-79d7-4d3c-b3e1-b1abb70c4700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:53.760404 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:53.795649 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514365b-79d7-4d3c-b3e1-b1abb70c4700 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:23:53.906167 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd60cd-3525-4a34-b825-033a6b689a53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:23:53.906692 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd60cd-3525-4a34-b825-033a6b689a53 service nova] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:53.906969 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd60cd-3525-4a34-b825-033a6b689a53 service nova] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:53.907240 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd60cd-3525-4a34-b825-033a6b689a53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:53.908841 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-acdd60cd-3525-4a34-b825-033a6b689a53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:53.982659 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:53.996347 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd60cd-3525-4a34-b825-033a6b689a53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:23:53.997965 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd60cd-3525-4a34-b825-033a6b689a53 service nova] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:23:54.015272 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 552/1100] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:23:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:23:55.121335 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e649df-a9f1-4d8e-a56f-2afdac2b2c4f None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:55.121902 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e649df-a9f1-4d8e-a56f-2afdac2b2c4f None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:55.121902 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e649df-a9f1-4d8e-a56f-2afdac2b2c4f None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:55.123247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 549/1101] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 20:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:23:55.128218 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c549f3-7acb-4dfa-9f38-aa157a71786e None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:55.128672 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c549f3-7acb-4dfa-9f38-aa157a71786e None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:55.128787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c549f3-7acb-4dfa-9f38-aa157a71786e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:55.202799 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-61c549f3-7acb-4dfa-9f38-aa157a71786e None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:23:55.203986 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-61c549f3-7acb-4dfa-9f38-aa157a71786e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:55.307127 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 553/1102] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 20:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:23:55.457690 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e649df-a9f1-4d8e-a56f-2afdac2b2c4f None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:23:55.459201 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-64e649df-a9f1-4d8e-a56f-2afdac2b2c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:55.546840 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:55.608165 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e649df-a9f1-4d8e-a56f-2afdac2b2c4f None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:23:55.718937 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6270f07-c8a1-4049-a807-477661cd2717 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:23:55.719544 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6270f07-c8a1-4049-a807-477661cd2717 service nova] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:55.719824 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6270f07-c8a1-4049-a807-477661cd2717 service nova] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:55.720133 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6270f07-c8a1-4049-a807-477661cd2717 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:55.721827 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-f6270f07-c8a1-4049-a807-477661cd2717 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:55.769637 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:55.811434 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6270f07-c8a1-4049-a807-477661cd2717 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:23:55.813049 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6270f07-c8a1-4049-a807-477661cd2717 service nova] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:23:55.831392 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 550/1103] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:23:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:23:56.883478 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed0f61-e426-448f-97af-8412b6ffff98 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:56.884008 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed0f61-e426-448f-97af-8412b6ffff98 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:56.884008 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed0f61-e426-448f-97af-8412b6ffff98 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:56.885400 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 554/1104] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 20:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:23:56.890170 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5a880-ccaf-49c2-a359-ba2555bbb40e None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:56.890601 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5a880-ccaf-49c2-a359-ba2555bbb40e None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:56.890726 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5a880-ccaf-49c2-a359-ba2555bbb40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:56.965565 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-ade5a880-ccaf-49c2-a359-ba2555bbb40e None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:23:56.966803 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-ade5a880-ccaf-49c2-a359-ba2555bbb40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:57.061779 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 551/1105] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 20:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:23:57.212608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed0f61-e426-448f-97af-8412b6ffff98 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:23:57.214030 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-cbed0f61-e426-448f-97af-8412b6ffff98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:57.261977 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:57.357349 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed0f61-e426-448f-97af-8412b6ffff98 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:23:57.470771 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4da973-99ef-41b0-99c4-0cc2bac4c23a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:23:57.471342 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4da973-99ef-41b0-99c4-0cc2bac4c23a service nova] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:57.471672 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4da973-99ef-41b0-99c4-0cc2bac4c23a service nova] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:57.471980 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4da973-99ef-41b0-99c4-0cc2bac4c23a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:57.473695 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-db4da973-99ef-41b0-99c4-0cc2bac4c23a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:57.480560 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:57.563923 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4da973-99ef-41b0-99c4-0cc2bac4c23a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:23:57.565566 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4da973-99ef-41b0-99c4-0cc2bac4c23a service nova] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:23:57.583047 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 555/1106] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:23:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:23:58.617834 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e683af-54ef-4245-b508-22990ec17c29 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:58.618370 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e683af-54ef-4245-b508-22990ec17c29 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:58.618370 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e683af-54ef-4245-b508-22990ec17c29 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:58.619732 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 552/1107] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 20:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:23:58.624742 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ea5b4-7048-4959-80d4-f652daf4ed99 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:58.625183 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ea5b4-7048-4959-80d4-f652daf4ed99 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:58.625287 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ea5b4-7048-4959-80d4-f652daf4ed99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:58.700977 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-254ea5b4-7048-4959-80d4-f652daf4ed99 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:23:58.702182 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-254ea5b4-7048-4959-80d4-f652daf4ed99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:58.769071 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:58.798660 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 556/1108] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 20:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:23:58.947871 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e683af-54ef-4245-b508-22990ec17c29 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:23:58.949699 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-51e683af-54ef-4245-b508-22990ec17c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:58.967229 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:59.092852 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e683af-54ef-4245-b508-22990ec17c29 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:23:59.179967 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:23:59.205720 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e2a28-1781-4818-b9d9-4be488ccd462 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:23:59.206378 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e2a28-1781-4818-b9d9-4be488ccd462 service nova] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:23:59.206698 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e2a28-1781-4818-b9d9-4be488ccd462 service nova] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:23:59.207010 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e2a28-1781-4818-b9d9-4be488ccd462 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:23:59.208763 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-685e2a28-1781-4818-b9d9-4be488ccd462 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:23:59.298502 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e2a28-1781-4818-b9d9-4be488ccd462 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:23:59.300160 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e2a28-1781-4818-b9d9-4be488ccd462 service nova] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:23:59.317829 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 553/1109] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:23:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:24:00.349509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa9a07-ba0a-4077-bfcd-083d368c02d9 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:00.350062 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa9a07-ba0a-4077-bfcd-083d368c02d9 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:00.350062 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa9a07-ba0a-4077-bfcd-083d368c02d9 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:00.351424 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 557/1110] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 20:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:24:00.356983 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4d5eb-f584-4c5b-9f78-1843741aba3b None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:00.357388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4d5eb-f584-4c5b-9f78-1843741aba3b None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:00.357534 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4d5eb-f584-4c5b-9f78-1843741aba3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:00.430848 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-33e4d5eb-f584-4c5b-9f78-1843741aba3b None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:24:00.432035 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-33e4d5eb-f584-4c5b-9f78-1843741aba3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:00.472577 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:24:00.529367 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 554/1111] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 20:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:24:00.677457 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa9a07-ba0a-4077-bfcd-083d368c02d9 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:24:00.678879 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-d4fa9a07-ba0a-4077-bfcd-083d368c02d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:00.823932 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa9a07-ba0a-4077-bfcd-083d368c02d9 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:24:00.877313 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:24:00.934722 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b53f54-7956-400d-aa10-0b4efcd5b54e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:24:00.935268 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b53f54-7956-400d-aa10-0b4efcd5b54e service nova] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:00.935554 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b53f54-7956-400d-aa10-0b4efcd5b54e service nova] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:00.935863 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b53f54-7956-400d-aa10-0b4efcd5b54e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:00.937511 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-48b53f54-7956-400d-aa10-0b4efcd5b54e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:01.024832 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b53f54-7956-400d-aa10-0b4efcd5b54e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:24:01.026418 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b53f54-7956-400d-aa10-0b4efcd5b54e service nova] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:24:01.043721 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 558/1112] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:24:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:24:02.083049 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a022d-7018-42de-b084-592d9cb9900b None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:02.083597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a022d-7018-42de-b084-592d9cb9900b None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:02.083697 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a022d-7018-42de-b084-592d9cb9900b None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:02.085013 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 555/1113] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 20:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:24:02.089821 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5429d-a1b5-4ae2-8cc9-d3d3dcf50ebf None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:02.090258 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5429d-a1b5-4ae2-8cc9-d3d3dcf50ebf None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:02.090398 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5429d-a1b5-4ae2-8cc9-d3d3dcf50ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:02.164147 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-bdc5429d-a1b5-4ae2-8cc9-d3d3dcf50ebf None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:24:02.165858 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-bdc5429d-a1b5-4ae2-8cc9-d3d3dcf50ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:02.167817 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:24:02.260954 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 559/1114] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 20:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:24:02.409560 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a022d-7018-42de-b084-592d9cb9900b None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:24:02.411018 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-8d1a022d-7018-42de-b084-592d9cb9900b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:02.555643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a022d-7018-42de-b084-592d9cb9900b None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:24:02.581840 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:24:02.667755 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b783013-6eed-4982-a1fa-957df9d462e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:24:02.668276 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b783013-6eed-4982-a1fa-957df9d462e3 service nova] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:02.668567 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b783013-6eed-4982-a1fa-957df9d462e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:02.668859 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b783013-6eed-4982-a1fa-957df9d462e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:02.670445 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-0b783013-6eed-4982-a1fa-957df9d462e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:02.759720 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b783013-6eed-4982-a1fa-957df9d462e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:24:02.761361 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b783013-6eed-4982-a1fa-957df9d462e3 service nova] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:24:02.779550 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 556/1115] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:24:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:24:04.825580 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4672544-c2b7-437d-8725-5e909179876e None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:04.826171 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4672544-c2b7-437d-8725-5e909179876e None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:04.826171 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4672544-c2b7-437d-8725-5e909179876e None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:04.827469 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 560/1116] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 20:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:24:04.832909 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f0250-1015-4cf3-9aff-088cc7d1b69c None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:04.833328 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f0250-1015-4cf3-9aff-088cc7d1b69c None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:04.833498 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f0250-1015-4cf3-9aff-088cc7d1b69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:04.873443 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:24:04.898623 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-8e2f0250-1015-4cf3-9aff-088cc7d1b69c None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:24:04.899835 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-8e2f0250-1015-4cf3-9aff-088cc7d1b69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:04.993558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 557/1117] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 20:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:24:05.280710 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4672544-c2b7-437d-8725-5e909179876e None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:24:05.282682 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-d4672544-c2b7-437d-8725-5e909179876e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:05.385646 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4672544-c2b7-437d-8725-5e909179876e None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:24:05.417527 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:24:05.458675 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9e3b1-6067-4b63-a771-f04d6f7cb4e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:24:05.459280 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9e3b1-6067-4b63-a771-f04d6f7cb4e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:05.459561 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9e3b1-6067-4b63-a771-f04d6f7cb4e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:05.459838 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9e3b1-6067-4b63-a771-f04d6f7cb4e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:05.461959 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-06e9e3b1-6067-4b63-a771-f04d6f7cb4e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:05.573372 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e9e3b1-6067-4b63-a771-f04d6f7cb4e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:24:05.574813 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e9e3b1-6067-4b63-a771-f04d6f7cb4e9 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:24:05.592663 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 561/1118] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:24:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:24:07.877973 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc191e-fe24-4230-b36a-c8235a0d276b None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:07.878541 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc191e-fe24-4230-b36a-c8235a0d276b None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:07.878541 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc191e-fe24-4230-b36a-c8235a0d276b None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:07.879901 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 558/1119] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 20:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:24:07.885571 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540773f-63a4-4b18-84ac-0ad7f5aaab83 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:07.885991 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540773f-63a4-4b18-84ac-0ad7f5aaab83 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:07.886126 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540773f-63a4-4b18-84ac-0ad7f5aaab83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:07.951503 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-3540773f-63a4-4b18-84ac-0ad7f5aaab83 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:24:07.952756 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-3540773f-63a4-4b18-84ac-0ad7f5aaab83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:07.965255 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:24:08.046727 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 562/1120] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 20:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:24:08.328448 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc191e-fe24-4230-b36a-c8235a0d276b None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:24:08.330005 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-ebfc191e-fe24-4230-b36a-c8235a0d276b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:08.432099 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc191e-fe24-4230-b36a-c8235a0d276b None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:24:08.445045 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:24:08.505969 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6eb214-07c4-4d68-af76-8834c5ee8c90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:24:08.506572 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6eb214-07c4-4d68-af76-8834c5ee8c90 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:08.506848 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6eb214-07c4-4d68-af76-8834c5ee8c90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:08.507116 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6eb214-07c4-4d68-af76-8834c5ee8c90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:08.509328 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-5e6eb214-07c4-4d68-af76-8834c5ee8c90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:08.616596 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6eb214-07c4-4d68-af76-8834c5ee8c90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:24:08.618491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6eb214-07c4-4d68-af76-8834c5ee8c90 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:24:08.636512 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 559/1121] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:24:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:24:11.119038 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6546f2f-1d7f-4f5a-bb6e-62180678f1f1 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:11.119632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6546f2f-1d7f-4f5a-bb6e-62180678f1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:11.119632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6546f2f-1d7f-4f5a-bb6e-62180678f1f1 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:11.121083 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 563/1122] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 20:24:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:24:11.126427 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a33d5-7b96-4ceb-b276-8bb3377a272e None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:11.126872 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a33d5-7b96-4ceb-b276-8bb3377a272e None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:11.127000 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a33d5-7b96-4ceb-b276-8bb3377a272e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:11.174786 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:24:11.193116 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-070a33d5-7b96-4ceb-b276-8bb3377a272e None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:24:11.194597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-070a33d5-7b96-4ceb-b276-8bb3377a272e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:11.290081 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 560/1123] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 20:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:24:11.572498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6546f2f-1d7f-4f5a-bb6e-62180678f1f1 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:24:11.574059 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-e6546f2f-1d7f-4f5a-bb6e-62180678f1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:11.684078 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6546f2f-1d7f-4f5a-bb6e-62180678f1f1 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:24:11.727792 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:24:11.762730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3763b-ccbd-48df-835e-a0224be5b875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:24:11.763334 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3763b-ccbd-48df-835e-a0224be5b875 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:11.763610 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3763b-ccbd-48df-835e-a0224be5b875 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:11.763886 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3763b-ccbd-48df-835e-a0224be5b875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:11.765524 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-03f3763b-ccbd-48df-835e-a0224be5b875 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:11.871153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f3763b-ccbd-48df-835e-a0224be5b875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:24:11.872613 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f3763b-ccbd-48df-835e-a0224be5b875 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:24:11.890378 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 564/1124] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:24:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:24:14.145859 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e75d3-ed65-4947-b925-ad41ec251572 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:14.146423 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e75d3-ed65-4947-b925-ad41ec251572 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:14.146423 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e75d3-ed65-4947-b925-ad41ec251572 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:14.147771 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 561/1125] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 20:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:24:14.153868 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17749f5-38d8-4098-b4be-48d8e304fb46 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:14.154308 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17749f5-38d8-4098-b4be-48d8e304fb46 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:14.154411 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17749f5-38d8-4098-b4be-48d8e304fb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:14.222703 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-c17749f5-38d8-4098-b4be-48d8e304fb46 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:24:14.223932 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-c17749f5-38d8-4098-b4be-48d8e304fb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:14.243950 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:24:14.319153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 565/1126] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 20:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:24:14.601700 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e75d3-ed65-4947-b925-ad41ec251572 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:24:14.603264 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-328e75d3-ed65-4947-b925-ad41ec251572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:14.704966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e75d3-ed65-4947-b925-ad41ec251572 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:24:14.725049 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:24:14.777628 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0427b-1119-46c4-958b-1afef135a2c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:24:14.778162 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0427b-1119-46c4-958b-1afef135a2c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:14.778445 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0427b-1119-46c4-958b-1afef135a2c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:14.778721 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0427b-1119-46c4-958b-1afef135a2c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:14.780306 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-29f0427b-1119-46c4-958b-1afef135a2c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:14.887658 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0427b-1119-46c4-958b-1afef135a2c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:24:14.889122 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0427b-1119-46c4-958b-1afef135a2c9 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:24:14.906974 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 562/1127] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:24:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:24:17.210307 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e33c6-5a3c-4513-a45b-d6abcc9eb3cb None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:17.210839 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e33c6-5a3c-4513-a45b-d6abcc9eb3cb None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:17.210839 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e33c6-5a3c-4513-a45b-d6abcc9eb3cb None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:17.212176 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 566/1128] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 20:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:24:17.217599 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b7e36-3010-47cd-b7ca-17724100fcbe None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:17.218017 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b7e36-3010-47cd-b7ca-17724100fcbe None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:17.218130 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b7e36-3010-47cd-b7ca-17724100fcbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:17.281257 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:24:17.283994 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-8b1b7e36-3010-47cd-b7ca-17724100fcbe None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:24:17.285766 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-8b1b7e36-3010-47cd-b7ca-17724100fcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:17.381009 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 563/1129] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 20:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:24:17.667735 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e33c6-5a3c-4513-a45b-d6abcc9eb3cb None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:24:17.669357 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-136e33c6-5a3c-4513-a45b-d6abcc9eb3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:17.770325 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e33c6-5a3c-4513-a45b-d6abcc9eb3cb None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:24:17.819376 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:24:17.844846 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95948ed6-bdd3-4672-97e9-d6511239435c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:24:17.845456 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95948ed6-bdd3-4672-97e9-d6511239435c service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:17.845738 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95948ed6-bdd3-4672-97e9-d6511239435c service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:17.846014 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95948ed6-bdd3-4672-97e9-d6511239435c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:17.847610 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-95948ed6-bdd3-4672-97e9-d6511239435c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:17.954042 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95948ed6-bdd3-4672-97e9-d6511239435c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:24:17.955468 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95948ed6-bdd3-4672-97e9-d6511239435c service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:24:17.973854 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 567/1130] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:24:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:24:20.161372 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031552d1-f53b-43a6-8465-9ce9c597283d None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:20.161961 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031552d1-f53b-43a6-8465-9ce9c597283d None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:20.161961 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031552d1-f53b-43a6-8465-9ce9c597283d None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:20.163251 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 564/1131] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 20:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:24:20.169325 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6c737-1622-40da-9ac3-ed59bf0374b8 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:20.169745 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6c737-1622-40da-9ac3-ed59bf0374b8 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:20.169877 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6c737-1622-40da-9ac3-ed59bf0374b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:20.234980 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-e8e6c737-1622-40da-9ac3-ed59bf0374b8 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:24:20.236182 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-e8e6c737-1622-40da-9ac3-ed59bf0374b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:20.264908 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:24:20.332094 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 568/1132] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 20:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:24:20.619167 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031552d1-f53b-43a6-8465-9ce9c597283d None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:24:20.620740 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-031552d1-f53b-43a6-8465-9ce9c597283d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:20.725264 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031552d1-f53b-43a6-8465-9ce9c597283d None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:24:20.754230 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:24:20.798875 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7013e-dfba-4d9c-84df-a4a6016fb342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:24:20.799406 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7013e-dfba-4d9c-84df-a4a6016fb342 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:20.799681 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7013e-dfba-4d9c-84df-a4a6016fb342 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:20.799951 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7013e-dfba-4d9c-84df-a4a6016fb342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:20.801614 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-15c7013e-dfba-4d9c-84df-a4a6016fb342 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:20.908645 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7013e-dfba-4d9c-84df-a4a6016fb342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:24:20.910067 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7013e-dfba-4d9c-84df-a4a6016fb342 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:24:20.927749 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 565/1133] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:24:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:24:23.107498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13313f-1c07-46bd-a56f-62e3fc68f180 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:23.107997 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13313f-1c07-46bd-a56f-62e3fc68f180 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:23.108109 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13313f-1c07-46bd-a56f-62e3fc68f180 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:23.109393 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 569/1134] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 20:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:24:23.114534 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d3f37-6069-4418-a06e-98d30edb9dbe None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:23.114960 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d3f37-6069-4418-a06e-98d30edb9dbe None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:23.115064 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d3f37-6069-4418-a06e-98d30edb9dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:23.178889 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-497d3f37-6069-4418-a06e-98d30edb9dbe None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:24:23.180165 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-497d3f37-6069-4418-a06e-98d30edb9dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:23.188190 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:24:23.275592 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 566/1135] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 20:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:24:23.555401 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13313f-1c07-46bd-a56f-62e3fc68f180 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:24:23.556994 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-1c13313f-1c07-46bd-a56f-62e3fc68f180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:23.658276 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13313f-1c07-46bd-a56f-62e3fc68f180 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:24:23.713006 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:24:23.730559 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721cf171-b34b-4ef2-a5f4-75e6457fee30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:24:23.731162 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721cf171-b34b-4ef2-a5f4-75e6457fee30 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:23.731441 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721cf171-b34b-4ef2-a5f4-75e6457fee30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:23.731714 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721cf171-b34b-4ef2-a5f4-75e6457fee30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:23.733316 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-721cf171-b34b-4ef2-a5f4-75e6457fee30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:23.840537 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721cf171-b34b-4ef2-a5f4-75e6457fee30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:24:23.841984 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721cf171-b34b-4ef2-a5f4-75e6457fee30 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:24:23.859908 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 570/1136] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:24:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:24:26.060325 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f983ca-d734-4d45-a84c-18e91a2a7dec None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:26.060923 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f983ca-d734-4d45-a84c-18e91a2a7dec None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:26.060923 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f983ca-d734-4d45-a84c-18e91a2a7dec None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:26.062250 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 567/1137] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 20:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:24:26.067483 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68d337-7a38-41f0-b89a-23cb00708085 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:26.067909 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68d337-7a38-41f0-b89a-23cb00708085 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:26.068017 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68d337-7a38-41f0-b89a-23cb00708085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:26.133659 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-9c68d337-7a38-41f0-b89a-23cb00708085 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:24:26.134866 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-9c68d337-7a38-41f0-b89a-23cb00708085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:26.172741 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:24:26.230288 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 571/1138] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 20:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:24:26.514268 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f983ca-d734-4d45-a84c-18e91a2a7dec None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:24:26.515806 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-b5f983ca-d734-4d45-a84c-18e91a2a7dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:26.619687 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f983ca-d734-4d45-a84c-18e91a2a7dec None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:24:26.657117 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:24:26.692937 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbb364-e7ba-4846-a69c-71507406a149 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:24:26.693543 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbb364-e7ba-4846-a69c-71507406a149 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:26.694082 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbb364-e7ba-4846-a69c-71507406a149 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:26.694363 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbb364-e7ba-4846-a69c-71507406a149 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:26.695989 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-80fbb364-e7ba-4846-a69c-71507406a149 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:26.803379 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fbb364-e7ba-4846-a69c-71507406a149 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:24:26.804775 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fbb364-e7ba-4846-a69c-71507406a149 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:24:26.823409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 568/1139] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:24:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:24:28.982118 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35b5cc-d6ee-48c1-925b-bd3bafbadde3 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:28.982696 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35b5cc-d6ee-48c1-925b-bd3bafbadde3 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:28.982696 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35b5cc-d6ee-48c1-925b-bd3bafbadde3 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:28.984009 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 572/1140] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 20:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:24:28.989512 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bc79c-6782-4e23-9df0-f0f8b58cf639 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:28.989932 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bc79c-6782-4e23-9df0-f0f8b58cf639 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:28.990053 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bc79c-6782-4e23-9df0-f0f8b58cf639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:29.056453 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-4d2bc79c-6782-4e23-9df0-f0f8b58cf639 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:24:29.057683 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-4d2bc79c-6782-4e23-9df0-f0f8b58cf639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:29.075482 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:24:29.155458 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 569/1141] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 20:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:24:29.435753 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35b5cc-d6ee-48c1-925b-bd3bafbadde3 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:24:29.437323 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-9f35b5cc-d6ee-48c1-925b-bd3bafbadde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:29.543141 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35b5cc-d6ee-48c1-925b-bd3bafbadde3 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:24:29.608913 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:24:29.616019 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf5624-fea5-4308-95f0-3e26d4ce22e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:24:29.616646 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf5624-fea5-4308-95f0-3e26d4ce22e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:29.616926 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf5624-fea5-4308-95f0-3e26d4ce22e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:29.617224 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf5624-fea5-4308-95f0-3e26d4ce22e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:29.618923 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-63bf5624-fea5-4308-95f0-3e26d4ce22e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:29.725775 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf5624-fea5-4308-95f0-3e26d4ce22e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:24:29.727180 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf5624-fea5-4308-95f0-3e26d4ce22e9 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:24:29.745143 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 573/1142] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:24:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:24:31.880323 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed30a0-3eee-4c1a-9501-a6b096a6ba83 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:31.880931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed30a0-3eee-4c1a-9501-a6b096a6ba83 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:31.880931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed30a0-3eee-4c1a-9501-a6b096a6ba83 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:31.882272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 570/1143] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 20:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:24:31.887921 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528b679-d4d5-4561-bae2-3fa3b6e6506d None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:31.888341 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528b679-d4d5-4561-bae2-3fa3b6e6506d None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:31.888478 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528b679-d4d5-4561-bae2-3fa3b6e6506d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:31.953273 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-b528b679-d4d5-4561-bae2-3fa3b6e6506d None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:24:31.954461 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-b528b679-d4d5-4561-bae2-3fa3b6e6506d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:32.002541 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:24:32.050630 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 574/1144] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 20:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:24:32.333932 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed30a0-3eee-4c1a-9501-a6b096a6ba83 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:24:32.335506 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-85ed30a0-3eee-4c1a-9501-a6b096a6ba83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:32.438161 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed30a0-3eee-4c1a-9501-a6b096a6ba83 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:24:32.485676 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:24:32.511979 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2097d9-9c7e-47d3-a692-a97a954c8bdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:24:32.512613 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2097d9-9c7e-47d3-a692-a97a954c8bdb service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:32.512892 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2097d9-9c7e-47d3-a692-a97a954c8bdb service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:32.513164 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2097d9-9c7e-47d3-a692-a97a954c8bdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:32.514742 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-bd2097d9-9c7e-47d3-a692-a97a954c8bdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:32.621653 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2097d9-9c7e-47d3-a692-a97a954c8bdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:24:32.622999 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2097d9-9c7e-47d3-a692-a97a954c8bdb service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:24:32.641352 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 571/1145] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:24:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:24:42.049141 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=22 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:24:42.639049 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=66 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:24:52.467882 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01bc43-243d-4413-a555-c398e90b59d7 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:52.468446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01bc43-243d-4413-a555-c398e90b59d7 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:52.468446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01bc43-243d-4413-a555-c398e90b59d7 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:52.469796 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 575/1146] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:24:52.475281 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b8983-e6ed-4722-91f5-c632d9802359 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:52.475694 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b8983-e6ed-4722-91f5-c632d9802359 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:52.475855 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b8983-e6ed-4722-91f5-c632d9802359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:52.543015 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-da3b8983-e6ed-4722-91f5-c632d9802359 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:24:52.544223 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-da3b8983-e6ed-4722-91f5-c632d9802359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:52.638524 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 572/1147] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:24:52.936511 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a74403-8cbb-4c94-9b4e-741fef832e71 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:52.936819 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a74403-8cbb-4c94-9b4e-741fef832e71 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:52.937094 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a74403-8cbb-4c94-9b4e-741fef832e71 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:52.938439 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 576/1148] 10.222.0.23 () {54 vars in 962 bytes} [Wed Nov 2 20:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:24:52.943256 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0232fbf-8caf-411a-89b5-93c7fe858344 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:52.943540 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0232fbf-8caf-411a-89b5-93c7fe858344 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:52.943811 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0232fbf-8caf-411a-89b5-93c7fe858344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:53.019083 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-a0232fbf-8caf-411a-89b5-93c7fe858344 None None] MFA Rules not processed for user `62ca656e59ff46b08661385d8ec79846`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:24:53.020272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-a0232fbf-8caf-411a-89b5-93c7fe858344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:53.041098 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:24:53.095897 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 573/1149] 10.222.0.23 () {58 vars in 1059 bytes} [Wed Nov 2 20:24:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:24:53.104237 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a74403-8cbb-4c94-9b4e-741fef832e71 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:24:53.105787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-c5a74403-8cbb-4c94-9b4e-741fef832e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:53.207553 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a74403-8cbb-4c94-9b4e-741fef832e71 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:24:53.278806 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3ca62-7dd3-4ac0-b791-b25811c5dcc8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62ca656e59ff46b08661385d8ec79846', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:24:53.279418 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3ca62-7dd3-4ac0-b791-b25811c5dcc8 service glance] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:53.279681 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3ca62-7dd3-4ac0-b791-b25811c5dcc8 service glance] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:53.279957 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3ca62-7dd3-4ac0-b791-b25811c5dcc8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:53.281552 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-36a3ca62-7dd3-4ac0-b791-b25811c5dcc8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:53.334211 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:24:53.388941 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3ca62-7dd3-4ac0-b791-b25811c5dcc8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:24:53.390362 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3ca62-7dd3-4ac0-b791-b25811c5dcc8 service glance] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:24:53.408782 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 577/1150] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:24:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:24:55.668514 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb1b1a-dbac-46b0-a520-ba14a40f8d48 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:55.669126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb1b1a-dbac-46b0-a520-ba14a40f8d48 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:55.669126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb1b1a-dbac-46b0-a520-ba14a40f8d48 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:55.670449 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 574/1151] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:24:55.675733 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf273ea-7f14-4ec2-be5d-4acb463e5dc7 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:55.676140 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf273ea-7f14-4ec2-be5d-4acb463e5dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:55.676297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf273ea-7f14-4ec2-be5d-4acb463e5dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:55.743238 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-ebf273ea-7f14-4ec2-be5d-4acb463e5dc7 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:24:55.744442 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-ebf273ea-7f14-4ec2-be5d-4acb463e5dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:55.839391 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 578/1152] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:24:56.116032 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb1b1a-dbac-46b0-a520-ba14a40f8d48 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:24:56.118149 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-79cb1b1a-dbac-46b0-a520-ba14a40f8d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:56.243237 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb1b1a-dbac-46b0-a520-ba14a40f8d48 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:24:56.292033 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:24:56.335736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc9702-97b5-4885-a0a6-b98178ed9b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:24:56.336348 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc9702-97b5-4885-a0a6-b98178ed9b82 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:56.336658 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc9702-97b5-4885-a0a6-b98178ed9b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:56.336937 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc9702-97b5-4885-a0a6-b98178ed9b82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:56.337580 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc9702-97b5-4885-a0a6-b98178ed9b82 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:24:56.338687 dv-cinder-862365-5-smb devstack@keystone.service[81403]: WARNING py.warnings [None req-11dc9702-97b5-4885-a0a6-b98178ed9b82 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 20:24:56.338687 dv-cinder-862365-5-smb devstack@keystone.service[81403]: warnings.warn(msg) Nov 02 20:24:56.338687 dv-cinder-862365-5-smb devstack@keystone.service[81403]: Nov 02 20:24:56.339828 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc9702-97b5-4885-a0a6-b98178ed9b82 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:24:56.359086 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 575/1153] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Nov 2 20:24:56 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:24:58.512163 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da0089-c4da-4878-92bb-ff67874c2371 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:58.512777 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da0089-c4da-4878-92bb-ff67874c2371 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:58.512777 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da0089-c4da-4878-92bb-ff67874c2371 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:58.514110 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 579/1154] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:24:58.519956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe021ce7-f1a7-4134-9a31-94f8670765db None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:58.519956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe021ce7-f1a7-4134-9a31-94f8670765db None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:58.520428 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe021ce7-f1a7-4134-9a31-94f8670765db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:58.585297 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-fe021ce7-f1a7-4134-9a31-94f8670765db None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:24:58.587065 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-fe021ce7-f1a7-4134-9a31-94f8670765db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:58.680981 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 576/1155] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:24:58.974667 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da0089-c4da-4878-92bb-ff67874c2371 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:24:58.976731 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-a1da0089-c4da-4878-92bb-ff67874c2371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:58.986525 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:24:59.121783 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da0089-c4da-4878-92bb-ff67874c2371 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:24:59.201649 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:24:59.234817 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88a338-3891-4fd7-8664-2fee0298c9fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:24:59.235357 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88a338-3891-4fd7-8664-2fee0298c9fc service nova] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:24:59.235639 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88a338-3891-4fd7-8664-2fee0298c9fc service nova] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:24:59.235915 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88a338-3891-4fd7-8664-2fee0298c9fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:24:59.237531 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-fb88a338-3891-4fd7-8664-2fee0298c9fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:24:59.325922 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88a338-3891-4fd7-8664-2fee0298c9fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:24:59.327531 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88a338-3891-4fd7-8664-2fee0298c9fc service nova] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:24:59.345482 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 580/1156] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:24:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:25:01.650712 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b99bc5-c667-48b8-a2a3-92831a8a404b None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:25:01.651245 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b99bc5-c667-48b8-a2a3-92831a8a404b None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:25:01.651362 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b99bc5-c667-48b8-a2a3-92831a8a404b None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:25:01.652638 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 577/1157] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:25:01.657897 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad538d-8178-4034-8e67-9e94a36cfe43 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:25:01.658278 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad538d-8178-4034-8e67-9e94a36cfe43 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:25:01.658442 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad538d-8178-4034-8e67-9e94a36cfe43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:25:01.722577 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-a1ad538d-8178-4034-8e67-9e94a36cfe43 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:25:01.723761 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-a1ad538d-8178-4034-8e67-9e94a36cfe43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:25:01.768461 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:25:01.817457 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 581/1158] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:25:02.104981 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b99bc5-c667-48b8-a2a3-92831a8a404b None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:25:02.106550 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-66b99bc5-c667-48b8-a2a3-92831a8a404b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:25:02.130700 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:25:02.209112 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b99bc5-c667-48b8-a2a3-92831a8a404b None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:25:02.281665 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1880eb5-93c6-4412-a164-893455432dbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:25:02.282265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1880eb5-93c6-4412-a164-893455432dbc service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:25:02.282545 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1880eb5-93c6-4412-a164-893455432dbc service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:25:02.282817 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1880eb5-93c6-4412-a164-893455432dbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:25:02.284518 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-f1880eb5-93c6-4412-a164-893455432dbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:25:02.358697 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:25:02.392870 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1880eb5-93c6-4412-a164-893455432dbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:25:02.394289 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1880eb5-93c6-4412-a164-893455432dbc service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:25:02.412325 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 578/1159] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:25:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:25:04.623834 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b23378-3565-49c4-b6ae-87a5a66656dd None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:25:04.624419 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b23378-3565-49c4-b6ae-87a5a66656dd None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:25:04.624419 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b23378-3565-49c4-b6ae-87a5a66656dd None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:25:04.625781 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 582/1160] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:25:04.630933 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacd4e9-91a0-474e-8d8e-468f0cbfe9a4 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:25:04.631337 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacd4e9-91a0-474e-8d8e-468f0cbfe9a4 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:25:04.631499 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacd4e9-91a0-474e-8d8e-468f0cbfe9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:25:04.697169 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-3cacd4e9-91a0-474e-8d8e-468f0cbfe9a4 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:25:04.698385 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-3cacd4e9-91a0-474e-8d8e-468f0cbfe9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:25:04.793345 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 579/1161] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:25:05.090867 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b23378-3565-49c4-b6ae-87a5a66656dd None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:25:05.092395 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-56b23378-3565-49c4-b6ae-87a5a66656dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:25:05.192859 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b23378-3565-49c4-b6ae-87a5a66656dd None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:25:05.266813 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:25:05.268707 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6284c4-f2e6-401e-86fe-7fdd4fc87701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:25:05.269412 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6284c4-f2e6-401e-86fe-7fdd4fc87701 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:25:05.269883 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6284c4-f2e6-401e-86fe-7fdd4fc87701 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:25:05.270366 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6284c4-f2e6-401e-86fe-7fdd4fc87701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:25:05.272231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-4f6284c4-f2e6-401e-86fe-7fdd4fc87701 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:25:05.379583 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6284c4-f2e6-401e-86fe-7fdd4fc87701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:25:05.380979 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6284c4-f2e6-401e-86fe-7fdd4fc87701 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:25:05.399425 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 583/1162] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:25:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:25:07.619363 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a51aa-08f6-4c14-9ff6-8d4746053518 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:25:07.619951 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a51aa-08f6-4c14-9ff6-8d4746053518 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:25:07.619951 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a51aa-08f6-4c14-9ff6-8d4746053518 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:25:07.621278 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 580/1163] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:25:07.626774 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2717dcb-ea5e-4ce1-877a-b419cbbfc7a6 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:25:07.627212 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2717dcb-ea5e-4ce1-877a-b419cbbfc7a6 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:25:07.627318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2717dcb-ea5e-4ce1-877a-b419cbbfc7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:25:07.692527 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-d2717dcb-ea5e-4ce1-877a-b419cbbfc7a6 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:25:07.693749 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-d2717dcb-ea5e-4ce1-877a-b419cbbfc7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:25:07.745525 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:25:07.789888 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 584/1164] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:25:08.082408 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a51aa-08f6-4c14-9ff6-8d4746053518 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:25:08.083946 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-185a51aa-08f6-4c14-9ff6-8d4746053518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:25:08.119603 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:25:08.186002 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a51aa-08f6-4c14-9ff6-8d4746053518 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:25:08.258598 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6873686-40bf-42e8-a5ba-3e2aa2767a73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:25:08.259204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6873686-40bf-42e8-a5ba-3e2aa2767a73 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:25:08.259484 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6873686-40bf-42e8-a5ba-3e2aa2767a73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:25:08.259759 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6873686-40bf-42e8-a5ba-3e2aa2767a73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:25:08.261390 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-e6873686-40bf-42e8-a5ba-3e2aa2767a73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:25:08.342267 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:25:08.370578 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6873686-40bf-42e8-a5ba-3e2aa2767a73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:25:08.372002 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6873686-40bf-42e8-a5ba-3e2aa2767a73 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:25:08.389933 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 581/1165] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:25:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:25:10.689340 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef3c08-2548-4389-a0ab-b05c8bb4b5dd None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:25:10.689893 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef3c08-2548-4389-a0ab-b05c8bb4b5dd None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:25:10.689893 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef3c08-2548-4389-a0ab-b05c8bb4b5dd None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:25:10.691232 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 585/1166] 10.222.0.23 () {54 vars in 927 bytes} [Wed Nov 2 20:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:25:10.696795 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252b310-88e1-482f-923b-8a1d4df3bbc0 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:25:10.697219 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252b310-88e1-482f-923b-8a1d4df3bbc0 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:25:10.697352 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252b310-88e1-482f-923b-8a1d4df3bbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:25:10.761697 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-8252b310-88e1-482f-923b-8a1d4df3bbc0 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:25:10.762895 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-8252b310-88e1-482f-923b-8a1d4df3bbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:25:10.857102 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 582/1167] 10.222.0.23 () {58 vars in 1024 bytes} [Wed Nov 2 20:25:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:25:11.143084 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef3c08-2548-4389-a0ab-b05c8bb4b5dd None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:25:11.144797 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-3cef3c08-2548-4389-a0ab-b05c8bb4b5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:25:11.249362 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef3c08-2548-4389-a0ab-b05c8bb4b5dd None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:25:11.321592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6cf77-0dbb-411e-a4bd-fdcd6353f699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:25:11.322191 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6cf77-0dbb-411e-a4bd-fdcd6353f699 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:25:11.322471 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6cf77-0dbb-411e-a4bd-fdcd6353f699 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:25:11.322741 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6cf77-0dbb-411e-a4bd-fdcd6353f699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:25:11.324333 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-a6d6cf77-0dbb-411e-a4bd-fdcd6353f699 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:25:11.332570 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:25:11.433518 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6cf77-0dbb-411e-a4bd-fdcd6353f699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:25:11.434867 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6cf77-0dbb-411e-a4bd-fdcd6353f699 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:25:11.453428 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 586/1168] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:25:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:25:20.855560 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=82 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:25:21.451219 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=50 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:26:31.532416 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd08cb-b976-4d1f-abb7-3df3d4fac759 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:26:31.532945 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd08cb-b976-4d1f-abb7-3df3d4fac759 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:26:31.533042 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd08cb-b976-4d1f-abb7-3df3d4fac759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:26:31.608571 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-cadd08cb-b976-4d1f-abb7-3df3d4fac759 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:26:31.609799 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-cadd08cb-b976-4d1f-abb7-3df3d4fac759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:26:31.707434 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 583/1169] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:26:31.715391 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7c0f6-59da-4b62-acaf-04e268e3d983 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:26:31.715900 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7c0f6-59da-4b62-acaf-04e268e3d983 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:26:31.716030 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7c0f6-59da-4b62-acaf-04e268e3d983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:26:31.790211 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-16e7c0f6-59da-4b62-acaf-04e268e3d983 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:26:31.791332 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-16e7c0f6-59da-4b62-acaf-04e268e3d983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:26:31.886985 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 587/1170] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:26:31.891573 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd08cb-b976-4d1f-abb7-3df3d4fac759 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:26:31.892809 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-cadd08cb-b976-4d1f-abb7-3df3d4fac759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:26:31.904024 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd08cb-b976-4d1f-abb7-3df3d4fac759 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:26:31.964148 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:26:31.998879 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898b51a-0220-4d19-a3b2-6a0501cb949f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:26:31.999483 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898b51a-0220-4d19-a3b2-6a0501cb949f admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:26:31.999766 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898b51a-0220-4d19-a3b2-6a0501cb949f admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:26:32.000042 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898b51a-0220-4d19-a3b2-6a0501cb949f admin admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:26:32.000724 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0898b51a-0220-4d19-a3b2-6a0501cb949f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:26:32.001030 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0898b51a-0220-4d19-a3b2-6a0501cb949f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:26:32.002037 dv-cinder-862365-5-smb devstack@keystone.service[81403]: WARNING py.warnings [None req-0898b51a-0220-4d19-a3b2-6a0501cb949f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 20:26:32.002037 dv-cinder-862365-5-smb devstack@keystone.service[81403]: warnings.warn(msg) Nov 02 20:26:32.002037 dv-cinder-862365-5-smb devstack@keystone.service[81403]: Nov 02 20:26:32.002935 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0898b51a-0220-4d19-a3b2-6a0501cb949f admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:26:32.014413 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 584/1171] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:26:32.023735 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7c0f6-59da-4b62-acaf-04e268e3d983 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:26:32.032851 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7c0f6-59da-4b62-acaf-04e268e3d983 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:26:32.094473 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:26:32.127370 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938ec0d-761c-4540-a3d4-6413b057e256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:26:32.127967 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938ec0d-761c-4540-a3d4-6413b057e256 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:26:32.128248 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938ec0d-761c-4540-a3d4-6413b057e256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:26:32.128523 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938ec0d-761c-4540-a3d4-6413b057e256 admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:26:32.129193 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3938ec0d-761c-4540-a3d4-6413b057e256 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:26:32.130213 dv-cinder-862365-5-smb devstack@keystone.service[81402]: WARNING py.warnings [None req-3938ec0d-761c-4540-a3d4-6413b057e256 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 20:26:32.130213 dv-cinder-862365-5-smb devstack@keystone.service[81402]: warnings.warn(msg) Nov 02 20:26:32.130213 dv-cinder-862365-5-smb devstack@keystone.service[81402]: Nov 02 20:26:32.131918 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3938ec0d-761c-4540-a3d4-6413b057e256 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:26:32.186009 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 588/1172] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:26:32 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:26:32.190200 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898b51a-0220-4d19-a3b2-6a0501cb949f admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:26:32.191729 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-0898b51a-0220-4d19-a3b2-6a0501cb949f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:26:32.225609 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898b51a-0220-4d19-a3b2-6a0501cb949f admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:26:32.316283 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62d7f0-2433-4c16-ab34-aba13961a1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:26:32.316905 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62d7f0-2433-4c16-ab34-aba13961a1ed admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:26:32.317186 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62d7f0-2433-4c16-ab34-aba13961a1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:26:32.317460 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62d7f0-2433-4c16-ab34-aba13961a1ed admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:26:32.318093 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62d7f0-2433-4c16-ab34-aba13961a1ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:26:32.319649 dv-cinder-862365-5-smb devstack@keystone.service[81403]: WARNING py.warnings [None req-8b62d7f0-2433-4c16-ab34-aba13961a1ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 20:26:32.319649 dv-cinder-862365-5-smb devstack@keystone.service[81403]: warnings.warn(msg) Nov 02 20:26:32.319649 dv-cinder-862365-5-smb devstack@keystone.service[81403]: Nov 02 20:26:32.321151 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62d7f0-2433-4c16-ab34-aba13961a1ed admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:26:32.362160 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 585/1173] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:26:32 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:26:32.366176 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938ec0d-761c-4540-a3d4-6413b057e256 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:26:32.367711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-3938ec0d-761c-4540-a3d4-6413b057e256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:26:32.429604 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938ec0d-761c-4540-a3d4-6413b057e256 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:26:32.512828 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:26:32.525454 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fec68-cc2b-4eda-b5ef-bcd1237f4abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:26:32.526063 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fec68-cc2b-4eda-b5ef-bcd1237f4abe admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:26:32.526338 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fec68-cc2b-4eda-b5ef-bcd1237f4abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:26:32.526608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fec68-cc2b-4eda-b5ef-bcd1237f4abe admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:26:32.527256 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345fec68-cc2b-4eda-b5ef-bcd1237f4abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:26:32.528922 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345fec68-cc2b-4eda-b5ef-bcd1237f4abe admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:26:32.541286 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 589/1174] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:26:32.545207 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62d7f0-2433-4c16-ab34-aba13961a1ed admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:26:32.546706 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-8b62d7f0-2433-4c16-ab34-aba13961a1ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:26:32.558357 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62d7f0-2433-4c16-ab34-aba13961a1ed admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:26:32.583710 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:26:32.653877 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a5b5f-7528-44cb-9129-7420d77035d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:26:32.654410 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a5b5f-7528-44cb-9129-7420d77035d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:26:32.654691 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a5b5f-7528-44cb-9129-7420d77035d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:26:32.654967 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a5b5f-7528-44cb-9129-7420d77035d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:26:32.655611 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a5b5f-7528-44cb-9129-7420d77035d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:26:32.657251 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a5b5f-7528-44cb-9129-7420d77035d3 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:26:32.669827 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 586/1175] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:26:32.673969 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fec68-cc2b-4eda-b5ef-bcd1237f4abe admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:26:32.675478 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-345fec68-cc2b-4eda-b5ef-bcd1237f4abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:26:32.708821 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fec68-cc2b-4eda-b5ef-bcd1237f4abe admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:26:32.802521 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae5939-5e25-4fbb-8ad9-746938f5d912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:26:32.803738 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae5939-5e25-4fbb-8ad9-746938f5d912 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:26:32.803966 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae5939-5e25-4fbb-8ad9-746938f5d912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:26:32.804242 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae5939-5e25-4fbb-8ad9-746938f5d912 admin admin] PATH_INFO: `/v3/projects/6b485d5f28964532969123f135934164/users/99d91c8ab0ab4e1c82a0cc2287956f5a/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:26:32.826774 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae5939-5e25-4fbb-8ad9-746938f5d912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b485d5f28964532969123f135934164, user_id=99d91c8ab0ab4e1c82a0cc2287956f5a, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:26:32.829468 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae5939-5e25-4fbb-8ad9-746938f5d912 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:26:32.854159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 590/1176] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:26:32 2022] PUT /identity/v3/projects/6b485d5f28964532969123f135934164/users/99d91c8ab0ab4e1c82a0cc2287956f5a/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:26:32.865233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103c470-3eeb-4f21-93fa-ea9050e50d3b None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:26:32.866093 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103c470-3eeb-4f21-93fa-ea9050e50d3b None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:26:32.866392 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103c470-3eeb-4f21-93fa-ea9050e50d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:26:32.922128 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-e103c470-3eeb-4f21-93fa-ea9050e50d3b None None] MFA Rules not processed for user `99d91c8ab0ab4e1c82a0cc2287956f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:26:32.923264 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-e103c470-3eeb-4f21-93fa-ea9050e50d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:26:32.999374 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 587/1177] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:26:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:26:33.012872 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888c7f2-845c-45d8-943e-ab57854d8ffd None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:26:33.013166 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888c7f2-845c-45d8-943e-ab57854d8ffd None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:26:33.013443 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888c7f2-845c-45d8-943e-ab57854d8ffd None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:26:33.014773 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 591/1178] 10.222.0.23 () {54 vars in 963 bytes} [Wed Nov 2 20:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:26:33.019417 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75beef36-8b3a-4033-b679-39677db270a8 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:26:33.019713 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75beef36-8b3a-4033-b679-39677db270a8 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:26:33.019998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75beef36-8b3a-4033-b679-39677db270a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:26:33.051475 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:26:33.097174 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-75beef36-8b3a-4033-b679-39677db270a8 None None] MFA Rules not processed for user `3860ca67d4c446ac9d7617fb4608408f`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:26:33.098378 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-75beef36-8b3a-4033-b679-39677db270a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:26:33.172450 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 588/1179] 10.222.0.23 () {58 vars in 1060 bytes} [Wed Nov 2 20:26:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:26:33.180656 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888c7f2-845c-45d8-943e-ab57854d8ffd None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:26:33.182179 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-6888c7f2-845c-45d8-943e-ab57854d8ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:26:33.231567 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:26:33.285136 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888c7f2-845c-45d8-943e-ab57854d8ffd None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:26:33.356539 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95b0e7-9eba-4f8e-a04c-ee3db72bf493 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:26:33.357193 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95b0e7-9eba-4f8e-a04c-ee3db72bf493 service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:26:33.357478 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95b0e7-9eba-4f8e-a04c-ee3db72bf493 service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:26:33.357758 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95b0e7-9eba-4f8e-a04c-ee3db72bf493 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:26:33.359374 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-fa95b0e7-9eba-4f8e-a04c-ee3db72bf493 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:26:33.457248 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95b0e7-9eba-4f8e-a04c-ee3db72bf493 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:26:33.458604 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95b0e7-9eba-4f8e-a04c-ee3db72bf493 service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:26:33.464067 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:26:33.480491 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 592/1180] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:26:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:26:33.526234 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7651a0-da0b-476b-8b84-f36ba61f33e0 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:26:33.526527 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7651a0-da0b-476b-8b84-f36ba61f33e0 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:26:33.526808 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7651a0-da0b-476b-8b84-f36ba61f33e0 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:26:33.528079 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 589/1181] 10.222.0.23 () {52 vars in 830 bytes} [Wed Nov 2 20:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:26:33.531667 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95b0e7-9eba-4f8e-a04c-ee3db72bf493 service cinder] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:26:33.532904 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-fa95b0e7-9eba-4f8e-a04c-ee3db72bf493 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:26:33.629534 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95b0e7-9eba-4f8e-a04c-ee3db72bf493 service cinder] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:26:33.719744 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a65f5-d56b-4875-a381-934c3abac192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:26:33.720310 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a65f5-d56b-4875-a381-934c3abac192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:26:33.720612 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a65f5-d56b-4875-a381-934c3abac192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:26:33.720889 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a65f5-d56b-4875-a381-934c3abac192 admin admin] PATH_INFO: `/v3/users/99d91c8ab0ab4e1c82a0cc2287956f5a` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:26:33.733888 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a65f5-d56b-4875-a381-934c3abac192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99d91c8ab0ab4e1c82a0cc2287956f5a)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:26:33.734901 dv-cinder-862365-5-smb devstack@keystone.service[81402]: WARNING py.warnings [None req-d91a65f5-d56b-4875-a381-934c3abac192 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 20:26:33.734901 dv-cinder-862365-5-smb devstack@keystone.service[81402]: warnings.warn(msg) Nov 02 20:26:33.734901 dv-cinder-862365-5-smb devstack@keystone.service[81402]: Nov 02 20:26:33.736093 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a65f5-d56b-4875-a381-934c3abac192 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:26:33.746070 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:26:33.801032 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-d91a65f5-d56b-4875-a381-934c3abac192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99d91c8ab0ab4e1c82a0cc2287956f5a'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:26:33.801574 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-d91a65f5-d56b-4875-a381-934c3abac192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99d91c8ab0ab4e1c82a0cc2287956f5a'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:26:33.824412 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-d91a65f5-d56b-4875-a381-934c3abac192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99d91c8ab0ab4e1c82a0cc2287956f5a'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:26:33.825029 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-d91a65f5-d56b-4875-a381-934c3abac192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99d91c8ab0ab4e1c82a0cc2287956f5a'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:26:33.838663 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-d91a65f5-d56b-4875-a381-934c3abac192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99d91c8ab0ab4e1c82a0cc2287956f5a'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:26:33.854066 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 593/1182] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:26:33 2022] DELETE /identity/v3/users/99d91c8ab0ab4e1c82a0cc2287956f5a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:26:33.858578 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822100b-4b4f-4d4b-b483-71f4d3fbbe0d None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:26:33.859039 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822100b-4b4f-4d4b-b483-71f4d3fbbe0d None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:26:33.859135 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822100b-4b4f-4d4b-b483-71f4d3fbbe0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:26:33.915239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-9822100b-4b4f-4d4b-b483-71f4d3fbbe0d None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:26:33.916429 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-9822100b-4b4f-4d4b-b483-71f4d3fbbe0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:26:33.989965 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:26:34.003443 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 590/1183] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:26:34.013233 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a65f5-d56b-4875-a381-934c3abac192 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:26:34.014468 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-d91a65f5-d56b-4875-a381-934c3abac192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:26:34.113521 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a65f5-d56b-4875-a381-934c3abac192 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:26:34.167510 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:26:34.187951 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e467b-7f4d-4ddc-840d-1c3ff698c2ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:26:34.188568 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e467b-7f4d-4ddc-840d-1c3ff698c2ce service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:26:34.188872 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e467b-7f4d-4ddc-840d-1c3ff698c2ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:26:34.189148 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e467b-7f4d-4ddc-840d-1c3ff698c2ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:26:34.190757 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-c64e467b-7f4d-4ddc-840d-1c3ff698c2ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:26:34.297530 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e467b-7f4d-4ddc-840d-1c3ff698c2ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:26:34.298897 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e467b-7f4d-4ddc-840d-1c3ff698c2ce service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:26:34.316297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 594/1184] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:26:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:26:35.038609 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822100b-4b4f-4d4b-b483-71f4d3fbbe0d None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:26:35.039867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-9822100b-4b4f-4d4b-b483-71f4d3fbbe0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:26:35.051155 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822100b-4b4f-4d4b-b483-71f4d3fbbe0d None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:26:35.149466 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296fe821-6272-4e83-86f7-a1fe468581a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:26:35.150099 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fe821-6272-4e83-86f7-a1fe468581a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:26:35.150381 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fe821-6272-4e83-86f7-a1fe468581a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:26:35.150656 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fe821-6272-4e83-86f7-a1fe468581a9 admin admin] PATH_INFO: `/v3/projects/6b485d5f28964532969123f135934164` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:26:35.160448 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296fe821-6272-4e83-86f7-a1fe468581a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b485d5f28964532969123f135934164)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:26:35.161556 dv-cinder-862365-5-smb devstack@keystone.service[81403]: WARNING py.warnings [None req-296fe821-6272-4e83-86f7-a1fe468581a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 20:26:35.161556 dv-cinder-862365-5-smb devstack@keystone.service[81403]: warnings.warn(msg) Nov 02 20:26:35.161556 dv-cinder-862365-5-smb devstack@keystone.service[81403]: Nov 02 20:26:35.163247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296fe821-6272-4e83-86f7-a1fe468581a9 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:26:35.220865 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-296fe821-6272-4e83-86f7-a1fe468581a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b485d5f28964532969123f135934164', 'request_id': 'req-296fe821-6272-4e83-86f7-a1fe468581a9'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:26:35.234763 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-296fe821-6272-4e83-86f7-a1fe468581a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b485d5f28964532969123f135934164', 'request_id': 'req-296fe821-6272-4e83-86f7-a1fe468581a9'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:26:35.244109 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-296fe821-6272-4e83-86f7-a1fe468581a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b485d5f28964532969123f135934164', 'request_id': 'req-296fe821-6272-4e83-86f7-a1fe468581a9'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:26:35.268155 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-296fe821-6272-4e83-86f7-a1fe468581a9 admin admin] The token cache is being invalidate because project 6b485d5f28964532969123f135934164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:26:35.268445 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-296fe821-6272-4e83-86f7-a1fe468581a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:26:35.268905 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-296fe821-6272-4e83-86f7-a1fe468581a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:26:35.270277 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 591/1185] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:26:35 2022] DELETE /identity/v3/projects/6b485d5f28964532969123f135934164 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:26:44.314104 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=62 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:26:45.266138 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:28:08.274426 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52734b23-d0f3-4e56-adeb-04a2d5a12613 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:28:08.275028 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52734b23-d0f3-4e56-adeb-04a2d5a12613 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:28:08.275028 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52734b23-d0f3-4e56-adeb-04a2d5a12613 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:28:08.276377 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 595/1186] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 20:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:28:08.281906 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea3f0a-e86b-4be7-9c8d-1b8cced6d169 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:28:08.282320 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea3f0a-e86b-4be7-9c8d-1b8cced6d169 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:28:08.282455 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea3f0a-e86b-4be7-9c8d-1b8cced6d169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:28:08.362962 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-4aea3f0a-e86b-4be7-9c8d-1b8cced6d169 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:28:08.364179 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-4aea3f0a-e86b-4be7-9c8d-1b8cced6d169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:28:08.465336 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 592/1187] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 20:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:28:08.622763 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52734b23-d0f3-4e56-adeb-04a2d5a12613 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:28:08.624917 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-52734b23-d0f3-4e56-adeb-04a2d5a12613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:28:08.741638 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52734b23-d0f3-4e56-adeb-04a2d5a12613 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:28:08.747159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4b35d-6e1b-4efa-be37-3d98c7336007 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:28:08.747761 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4b35d-6e1b-4efa-be37-3d98c7336007 service nova] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:28:08.748044 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4b35d-6e1b-4efa-be37-3d98c7336007 service nova] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:28:08.748345 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4b35d-6e1b-4efa-be37-3d98c7336007 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:28:08.756352 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4b35d-6e1b-4efa-be37-3d98c7336007 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:28:08.757968 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4b35d-6e1b-4efa-be37-3d98c7336007 service nova] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:28:08.767898 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 596/1188] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:28:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:28:09.832968 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98963b7-c779-42c7-9cab-5970768e6751 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:28:09.833559 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98963b7-c779-42c7-9cab-5970768e6751 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:28:09.833559 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98963b7-c779-42c7-9cab-5970768e6751 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:28:09.834928 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 593/1189] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 20:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:28:09.839662 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61caa3c6-988b-4e8d-b9be-692a01da0063 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:28:09.840069 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61caa3c6-988b-4e8d-b9be-692a01da0063 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:28:09.840222 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61caa3c6-988b-4e8d-b9be-692a01da0063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:28:09.860842 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-61caa3c6-988b-4e8d-b9be-692a01da0063 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:28:09.862050 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-61caa3c6-988b-4e8d-b9be-692a01da0063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:28:09.869944 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 597/1190] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 20:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:28:10.024600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98963b7-c779-42c7-9cab-5970768e6751 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:28:10.039070 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98963b7-c779-42c7-9cab-5970768e6751 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:28:10.044795 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd335446-0e63-4090-bc26-dfd83fc0bfa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:28:10.045934 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd335446-0e63-4090-bc26-dfd83fc0bfa7 service nova] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:28:10.046215 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd335446-0e63-4090-bc26-dfd83fc0bfa7 service nova] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:28:10.046485 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd335446-0e63-4090-bc26-dfd83fc0bfa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:28:10.054968 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd335446-0e63-4090-bc26-dfd83fc0bfa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:28:10.056576 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd335446-0e63-4090-bc26-dfd83fc0bfa7 service nova] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:28:10.066331 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 594/1191] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:28:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:28:10.335713 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fff7c3-69ea-4fef-8c49-11022cda7ae6 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:28:10.335999 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fff7c3-69ea-4fef-8c49-11022cda7ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:28:10.336282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fff7c3-69ea-4fef-8c49-11022cda7ae6 None None] PATH_INFO: `/v3` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:28:10.337660 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 598/1192] 10.222.0.15 () {54 vars in 925 bytes} [Wed Nov 2 20:28:10 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:28:10.369114 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd05ae-fccd-4f05-9289-93ec9d7e94b1 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:28:10.369349 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd05ae-fccd-4f05-9289-93ec9d7e94b1 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:28:10.369632 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd05ae-fccd-4f05-9289-93ec9d7e94b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:28:10.428343 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-5bcd05ae-fccd-4f05-9289-93ec9d7e94b1 None None] MFA Rules not processed for user `603a9f31ae814003a2cbd02f964f4ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:28:10.429581 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-5bcd05ae-fccd-4f05-9289-93ec9d7e94b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:28:10.446976 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:28:10.501911 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 595/1193] 10.222.0.15 () {58 vars in 1015 bytes} [Wed Nov 2 20:28:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:28:14.082608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a1ca6-76ac-4f07-b142-426b04d83d3f None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:28:14.083147 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a1ca6-76ac-4f07-b142-426b04d83d3f None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:28:14.083147 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a1ca6-76ac-4f07-b142-426b04d83d3f None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:28:14.084517 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 599/1194] 10.222.0.23 () {54 vars in 961 bytes} [Wed Nov 2 20:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:28:14.089547 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e2346-debb-4a1a-8fe0-e63c42798e01 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:28:14.089999 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e2346-debb-4a1a-8fe0-e63c42798e01 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:28:14.090099 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e2346-debb-4a1a-8fe0-e63c42798e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:28:14.110776 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-ae0e2346-debb-4a1a-8fe0-e63c42798e01 None None] MFA Rules not processed for user `603a9f31ae814003a2cbd02f964f4ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:28:14.111997 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-ae0e2346-debb-4a1a-8fe0-e63c42798e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:28:14.120604 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 596/1195] 10.222.0.23 () {58 vars in 1058 bytes} [Wed Nov 2 20:28:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:28:14.128080 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a1ca6-76ac-4f07-b142-426b04d83d3f None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:28:14.142567 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a1ca6-76ac-4f07-b142-426b04d83d3f None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:28:14.148133 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f887f16-0ce7-4dd3-965b-f3dde2c8be0b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603a9f31ae814003a2cbd02f964f4ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:28:14.148759 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f887f16-0ce7-4dd3-965b-f3dde2c8be0b service placement] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:28:14.149042 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f887f16-0ce7-4dd3-965b-f3dde2c8be0b service placement] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:28:14.149348 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f887f16-0ce7-4dd3-965b-f3dde2c8be0b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:28:14.159265 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f887f16-0ce7-4dd3-965b-f3dde2c8be0b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:28:14.161070 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f887f16-0ce7-4dd3-965b-f3dde2c8be0b service placement] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:28:14.171057 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 600/1196] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:28:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:28:21.514395 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec079eb-6936-449a-8e93-efee7ec86b51 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:28:21.514936 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec079eb-6936-449a-8e93-efee7ec86b51 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:28:21.514936 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec079eb-6936-449a-8e93-efee7ec86b51 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:28:21.516723 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 597/1197] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 20:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:28:21.521755 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210ad8f-af30-45f4-8a84-c18edeef5b38 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:28:21.522190 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210ad8f-af30-45f4-8a84-c18edeef5b38 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:28:21.522373 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210ad8f-af30-45f4-8a84-c18edeef5b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:28:21.542491 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-e210ad8f-af30-45f4-8a84-c18edeef5b38 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:28:21.543678 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-e210ad8f-af30-45f4-8a84-c18edeef5b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:28:21.552033 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 601/1198] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 20:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:28:21.706192 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec079eb-6936-449a-8e93-efee7ec86b51 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:28:21.720631 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec079eb-6936-449a-8e93-efee7ec86b51 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:28:21.726047 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0ebde-ae83-401a-9733-fa2909d61bd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:28:21.726673 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0ebde-ae83-401a-9733-fa2909d61bd1 service nova] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:28:21.726959 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0ebde-ae83-401a-9733-fa2909d61bd1 service nova] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:28:21.727238 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0ebde-ae83-401a-9733-fa2909d61bd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:28:21.735268 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0ebde-ae83-401a-9733-fa2909d61bd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:28:21.736869 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0ebde-ae83-401a-9733-fa2909d61bd1 service nova] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:28:21.746022 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 598/1199] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:28:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:28:22.798656 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c894021-fb63-421c-8580-f073f4ef808e None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:28:22.799167 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c894021-fb63-421c-8580-f073f4ef808e None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:28:22.799167 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c894021-fb63-421c-8580-f073f4ef808e None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:28:22.800506 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 602/1200] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 20:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:28:22.805418 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a126fd-fd82-42e8-8fec-a8f5e0af6525 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:28:22.805873 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a126fd-fd82-42e8-8fec-a8f5e0af6525 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:28:22.805985 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a126fd-fd82-42e8-8fec-a8f5e0af6525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:28:22.825271 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-a7a126fd-fd82-42e8-8fec-a8f5e0af6525 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:28:22.826457 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-a7a126fd-fd82-42e8-8fec-a8f5e0af6525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:28:22.834771 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 599/1201] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 20:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:28:22.985941 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c894021-fb63-421c-8580-f073f4ef808e None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:28:23.000823 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c894021-fb63-421c-8580-f073f4ef808e None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:28:23.006252 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2438e28-af5c-4f08-b1f5-b283c97b4230 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:28:23.006844 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2438e28-af5c-4f08-b1f5-b283c97b4230 service nova] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:28:23.007129 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2438e28-af5c-4f08-b1f5-b283c97b4230 service nova] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:28:23.007406 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2438e28-af5c-4f08-b1f5-b283c97b4230 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:28:23.015473 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2438e28-af5c-4f08-b1f5-b283c97b4230 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:28:23.017171 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2438e28-af5c-4f08-b1f5-b283c97b4230 service nova] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:28:23.026447 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 603/1202] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:28:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:28:27.110813 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c9352-6cb0-4e33-b829-83e99c6fe422 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:28:27.111417 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c9352-6cb0-4e33-b829-83e99c6fe422 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:28:27.111417 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c9352-6cb0-4e33-b829-83e99c6fe422 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:28:27.112749 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 600/1203] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 20:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:28:27.118080 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c833307-efd6-43d4-8a47-f614b8125bc4 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:28:27.118473 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c833307-efd6-43d4-8a47-f614b8125bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:28:27.118625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c833307-efd6-43d4-8a47-f614b8125bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:28:27.137959 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-3c833307-efd6-43d4-8a47-f614b8125bc4 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:28:27.139135 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-3c833307-efd6-43d4-8a47-f614b8125bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:28:27.147323 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 604/1204] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 20:28:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:28:27.435656 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd004f-0f7c-4d9f-b0e4-7064aac66eb5 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:28:27.435946 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd004f-0f7c-4d9f-b0e4-7064aac66eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:28:27.436229 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd004f-0f7c-4d9f-b0e4-7064aac66eb5 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:28:27.438228 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 601/1205] 10.222.0.23 () {54 vars in 965 bytes} [Wed Nov 2 20:28:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:28:27.443543 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cff212-e3a1-4f40-bab1-e9986053e3b7 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:28:27.443831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cff212-e3a1-4f40-bab1-e9986053e3b7 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:28:27.444224 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cff212-e3a1-4f40-bab1-e9986053e3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:28:27.493203 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-10cff212-e3a1-4f40-bab1-e9986053e3b7 None None] MFA Rules not processed for user `fdb57cba49ce43ad95096047859dfe1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:28:27.494406 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-10cff212-e3a1-4f40-bab1-e9986053e3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:28:27.524000 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:28:27.555297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 605/1206] 10.222.0.23 () {58 vars in 1062 bytes} [Wed Nov 2 20:28:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:28:27.565491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd004f-0f7c-4d9f-b0e4-7064aac66eb5 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:28:27.576389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd004f-0f7c-4d9f-b0e4-7064aac66eb5 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:28:27.580406 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac95d10-90ef-4851-9784-dce9d8fa009c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:28:27.581030 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac95d10-90ef-4851-9784-dce9d8fa009c service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:28:27.581313 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac95d10-90ef-4851-9784-dce9d8fa009c service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:28:27.581591 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac95d10-90ef-4851-9784-dce9d8fa009c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:28:27.591953 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac95d10-90ef-4851-9784-dce9d8fa009c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:28:27.593481 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac95d10-90ef-4851-9784-dce9d8fa009c service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:28:27.602635 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 602/1207] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:28:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:28:29.737190 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaee7ae-3760-47d9-8d71-676d999b677c None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:28:29.737725 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaee7ae-3760-47d9-8d71-676d999b677c None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:28:29.737725 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaee7ae-3760-47d9-8d71-676d999b677c None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:28:29.739009 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 606/1208] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 20:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:28:29.744727 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8097604-dfad-4aaf-886e-f881d29ee19e None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:28:29.745126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8097604-dfad-4aaf-886e-f881d29ee19e None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:28:29.745286 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8097604-dfad-4aaf-886e-f881d29ee19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:28:29.764925 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-b8097604-dfad-4aaf-886e-f881d29ee19e None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:28:29.766741 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-b8097604-dfad-4aaf-886e-f881d29ee19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:28:29.774586 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 603/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 20:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:28:30.060573 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaee7ae-3760-47d9-8d71-676d999b677c None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:28:30.062781 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-eeaee7ae-3760-47d9-8d71-676d999b677c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:28:30.076762 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaee7ae-3760-47d9-8d71-676d999b677c None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:28:30.081531 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285643c5-a10b-4f89-a2f0-5fa13e07a37d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:28:30.082191 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285643c5-a10b-4f89-a2f0-5fa13e07a37d service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:28:30.082705 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285643c5-a10b-4f89-a2f0-5fa13e07a37d service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:28:30.083198 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285643c5-a10b-4f89-a2f0-5fa13e07a37d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:28:30.092365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285643c5-a10b-4f89-a2f0-5fa13e07a37d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:28:30.093866 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285643c5-a10b-4f89-a2f0-5fa13e07a37d service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:28:30.103171 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 607/1210] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:28:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:28:33.599917 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db551f-29a6-4ad8-84e5-d015ba8c6f9e None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:28:33.600489 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db551f-29a6-4ad8-84e5-d015ba8c6f9e None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:28:33.600489 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db551f-29a6-4ad8-84e5-d015ba8c6f9e None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:28:33.601881 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 604/1211] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 20:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:28:33.606987 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cbfe2-9343-4bde-95ee-3225523c5e5b None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:28:33.607433 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cbfe2-9343-4bde-95ee-3225523c5e5b None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:28:33.607548 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cbfe2-9343-4bde-95ee-3225523c5e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:28:33.626948 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-506cbfe2-9343-4bde-95ee-3225523c5e5b None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:28:33.628125 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-506cbfe2-9343-4bde-95ee-3225523c5e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:28:33.637135 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 608/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 20:28:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:28:33.934747 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db551f-29a6-4ad8-84e5-d015ba8c6f9e None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:28:33.936568 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-d4db551f-29a6-4ad8-84e5-d015ba8c6f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:28:34.013008 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db551f-29a6-4ad8-84e5-d015ba8c6f9e None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:28:34.017038 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64727ed-76e5-4d36-ba0f-50138c6124e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:28:34.017634 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64727ed-76e5-4d36-ba0f-50138c6124e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:28:34.017912 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64727ed-76e5-4d36-ba0f-50138c6124e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:28:34.018190 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64727ed-76e5-4d36-ba0f-50138c6124e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:28:34.026808 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64727ed-76e5-4d36-ba0f-50138c6124e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:28:34.028235 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64727ed-76e5-4d36-ba0f-50138c6124e3 service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:28:34.037387 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 605/1213] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:28:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:28:36.183658 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4511e96-264c-4837-8150-969da8f8bbea None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:28:36.184201 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4511e96-264c-4837-8150-969da8f8bbea None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:28:36.184201 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4511e96-264c-4837-8150-969da8f8bbea None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:28:36.185581 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 609/1214] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 20:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:28:36.191266 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da301dc-9ba9-4665-bfed-1487be5051f1 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:28:36.191696 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da301dc-9ba9-4665-bfed-1487be5051f1 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:28:36.191794 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da301dc-9ba9-4665-bfed-1487be5051f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:28:36.211874 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-0da301dc-9ba9-4665-bfed-1487be5051f1 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:28:36.213387 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-0da301dc-9ba9-4665-bfed-1487be5051f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:28:36.221091 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 606/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 20:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:28:36.518575 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4511e96-264c-4837-8150-969da8f8bbea None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:28:36.520642 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-c4511e96-264c-4837-8150-969da8f8bbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:28:36.532951 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4511e96-264c-4837-8150-969da8f8bbea None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:28:36.536371 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b05285-5337-46a3-baf0-e82fe8358873 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:28:36.537002 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b05285-5337-46a3-baf0-e82fe8358873 service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:28:36.537282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b05285-5337-46a3-baf0-e82fe8358873 service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:28:36.537552 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b05285-5337-46a3-baf0-e82fe8358873 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:28:36.546114 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b05285-5337-46a3-baf0-e82fe8358873 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:28:36.548035 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b05285-5337-46a3-baf0-e82fe8358873 service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:28:36.557251 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 610/1216] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:28:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:28:46.207126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=82 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:28:46.553084 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=27 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:05.710784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7c0b0-c104-416d-8023-302a1dd87ba9 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:05.711425 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7c0b0-c104-416d-8023-302a1dd87ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:05.711425 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7c0b0-c104-416d-8023-302a1dd87ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:05.736210 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39a86b-2a8a-4fbe-98d8-df2878d669ee None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:05.736842 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39a86b-2a8a-4fbe-98d8-df2878d669ee None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:05.736842 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39a86b-2a8a-4fbe-98d8-df2878d669ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:05.740786 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-e6b7c0b0-c104-416d-8023-302a1dd87ba9 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:05.742024 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-e6b7c0b0-c104-416d-8023-302a1dd87ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:05.756375 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 607/1217] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:30:05.768321 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-1b39a86b-2a8a-4fbe-98d8-df2878d669ee None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:05.769588 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-1b39a86b-2a8a-4fbe-98d8-df2878d669ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:05.783317 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 611/1218] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:30:05.785198 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32ed04-2bbf-4f8e-8482-59112a8436c9 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:05.785589 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32ed04-2bbf-4f8e-8482-59112a8436c9 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:05.785873 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32ed04-2bbf-4f8e-8482-59112a8436c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:05.794925 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4820172-5c17-4086-95cb-d9a8a72247f5 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:05.795337 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4820172-5c17-4086-95cb-d9a8a72247f5 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:05.795528 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4820172-5c17-4086-95cb-d9a8a72247f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:05.822134 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-fd32ed04-2bbf-4f8e-8482-59112a8436c9 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:05.822383 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-f4820172-5c17-4086-95cb-d9a8a72247f5 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:05.823344 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-fd32ed04-2bbf-4f8e-8482-59112a8436c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:05.823568 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-f4820172-5c17-4086-95cb-d9a8a72247f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:05.839384 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 612/1219] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:30:05.845095 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4820172-5c17-4086-95cb-d9a8a72247f5 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:05.847857 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 608/1220] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:05.849154 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201c4ab-236f-441d-b23c-4ac47e495b61 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:05.849443 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201c4ab-236f-441d-b23c-4ac47e495b61 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:05.849716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201c4ab-236f-441d-b23c-4ac47e495b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:05.855035 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4820172-5c17-4086-95cb-d9a8a72247f5 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:05.867485 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2657861-3264-4447-bba3-0bb566f509c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:05.868122 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2657861-3264-4447-bba3-0bb566f509c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:05.868407 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2657861-3264-4447-bba3-0bb566f509c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:05.868712 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2657861-3264-4447-bba3-0bb566f509c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:05.869373 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2657861-3264-4447-bba3-0bb566f509c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:30:05.869681 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2657861-3264-4447-bba3-0bb566f509c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:05.870711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: WARNING py.warnings [None req-c2657861-3264-4447-bba3-0bb566f509c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 20:30:05.870711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: warnings.warn(msg) Nov 02 20:30:05.870711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: Nov 02 20:30:05.871607 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2657861-3264-4447-bba3-0bb566f509c8 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:05.888281 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-4201c4ab-236f-441d-b23c-4ac47e495b61 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:05.889545 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-4201c4ab-236f-441d-b23c-4ac47e495b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:05.889738 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 613/1221] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:30:05.890577 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2657861-3264-4447-bba3-0bb566f509c8 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:05.905688 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2657861-3264-4447-bba3-0bb566f509c8 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:05.916978 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958a6fc-8708-48c5-a238-c5b6eb069067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:05.917700 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958a6fc-8708-48c5-a238-c5b6eb069067 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:05.917991 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958a6fc-8708-48c5-a238-c5b6eb069067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:05.918272 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958a6fc-8708-48c5-a238-c5b6eb069067 admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:05.918930 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958a6fc-8708-48c5-a238-c5b6eb069067 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:30:05.919242 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958a6fc-8708-48c5-a238-c5b6eb069067 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:05.920874 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958a6fc-8708-48c5-a238-c5b6eb069067 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:05.922381 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 609/1222] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:05.922933 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201c4ab-236f-441d-b23c-4ac47e495b61 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:05.937748 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 614/1223] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:30:05.939628 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87623ce6-cd7d-42be-86c6-71fd68835c43 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:05.939772 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201c4ab-236f-441d-b23c-4ac47e495b61 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:05.939997 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87623ce6-cd7d-42be-86c6-71fd68835c43 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:05.940197 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87623ce6-cd7d-42be-86c6-71fd68835c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:05.968512 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-87623ce6-cd7d-42be-86c6-71fd68835c43 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:05.970382 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-87623ce6-cd7d-42be-86c6-71fd68835c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:05.974761 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d9cfc-b2ce-4b1e-ad3d-d26e4cab96ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:05.976982 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d9cfc-b2ce-4b1e-ad3d-d26e4cab96ff admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:05.977276 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d9cfc-b2ce-4b1e-ad3d-d26e4cab96ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:05.977543 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d9cfc-b2ce-4b1e-ad3d-d26e4cab96ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:05.978194 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d9cfc-b2ce-4b1e-ad3d-d26e4cab96ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:05.979214 dv-cinder-862365-5-smb devstack@keystone.service[81403]: WARNING py.warnings [None req-1a5d9cfc-b2ce-4b1e-ad3d-d26e4cab96ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 20:30:05.979214 dv-cinder-862365-5-smb devstack@keystone.service[81403]: warnings.warn(msg) Nov 02 20:30:05.979214 dv-cinder-862365-5-smb devstack@keystone.service[81403]: Nov 02 20:30:05.980413 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d9cfc-b2ce-4b1e-ad3d-d26e4cab96ff admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:05.986953 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 615/1224] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:05.988210 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c191f-6c84-4594-87c9-2ca56dfa6b08 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:05.988496 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c191f-6c84-4594-87c9-2ca56dfa6b08 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:05.988804 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c191f-6c84-4594-87c9-2ca56dfa6b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:06.009274 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-992c191f-6c84-4594-87c9-2ca56dfa6b08 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:06.010476 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-992c191f-6c84-4594-87c9-2ca56dfa6b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:06.018829 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 616/1225] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:06.020035 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7378c-9863-4acc-8fdb-50231acbfd9a None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:06.020322 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7378c-9863-4acc-8fdb-50231acbfd9a None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:06.020624 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7378c-9863-4acc-8fdb-50231acbfd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:06.039264 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 610/1226] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:30:05 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:06.039871 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d9cfc-b2ce-4b1e-ad3d-d26e4cab96ff admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:06.043479 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-70f7378c-9863-4acc-8fdb-50231acbfd9a None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:06.044858 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-70f7378c-9863-4acc-8fdb-50231acbfd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:06.108134 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d9cfc-b2ce-4b1e-ad3d-d26e4cab96ff admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:06.112992 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152acb4b-a166-4008-a868-0dff767760b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:06.113610 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152acb4b-a166-4008-a868-0dff767760b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:06.113895 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152acb4b-a166-4008-a868-0dff767760b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:06.114170 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152acb4b-a166-4008-a868-0dff767760b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:06.121994 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 617/1227] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:06.122183 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152acb4b-a166-4008-a868-0dff767760b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:06.122270 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4fd26-e00e-4827-adbb-528020efb013 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:06.122270 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4fd26-e00e-4827-adbb-528020efb013 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:06.122270 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4fd26-e00e-4827-adbb-528020efb013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:06.122514 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152acb4b-a166-4008-a868-0dff767760b2 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:06.143601 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-e7e4fd26-e00e-4827-adbb-528020efb013 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:06.144846 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-e7e4fd26-e00e-4827-adbb-528020efb013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:06.148821 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 611/1228] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:30:06 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:06.149934 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991642c-5819-49ce-9841-48c339da0fa4 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:06.150228 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991642c-5819-49ce-9841-48c339da0fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:06.150506 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991642c-5819-49ce-9841-48c339da0fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:06.153271 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 618/1229] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:06.154213 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4fd26-e00e-4827-adbb-528020efb013 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:06.164813 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4fd26-e00e-4827-adbb-528020efb013 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:06.175403 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-4991642c-5819-49ce-9841-48c339da0fa4 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:06.176635 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-4991642c-5819-49ce-9841-48c339da0fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:06.222755 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82396dda-54ee-43e0-b940-52feaab38bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:06.223371 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82396dda-54ee-43e0-b940-52feaab38bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:06.223657 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82396dda-54ee-43e0-b940-52feaab38bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:06.223933 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82396dda-54ee-43e0-b940-52feaab38bd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:06.224602 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82396dda-54ee-43e0-b940-52feaab38bd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:30:06.224910 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82396dda-54ee-43e0-b940-52feaab38bd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:06.226546 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82396dda-54ee-43e0-b940-52feaab38bd7 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:06.234226 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 612/1230] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:06.235767 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991642c-5819-49ce-9841-48c339da0fa4 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:06.239847 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 619/1231] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:30:06.241852 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a350650-c2e6-420c-9770-1db8c517a63b None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:06.242149 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a350650-c2e6-420c-9770-1db8c517a63b None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:06.242430 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a350650-c2e6-420c-9770-1db8c517a63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:06.251382 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991642c-5819-49ce-9841-48c339da0fa4 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:06.256605 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518a1d7-6d4e-4865-9359-2b3faab03f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:06.257228 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518a1d7-6d4e-4865-9359-2b3faab03f2b admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:06.257514 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518a1d7-6d4e-4865-9359-2b3faab03f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:06.257792 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518a1d7-6d4e-4865-9359-2b3faab03f2b admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:06.258460 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518a1d7-6d4e-4865-9359-2b3faab03f2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:06.260394 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518a1d7-6d4e-4865-9359-2b3faab03f2b admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:06.264294 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-2a350650-c2e6-420c-9770-1db8c517a63b None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:06.265546 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-2a350650-c2e6-420c-9770-1db8c517a63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:06.275528 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 620/1232] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:06.276758 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fce9b3-b65d-4d2d-b036-3aacc49adada None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:06.277102 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fce9b3-b65d-4d2d-b036-3aacc49adada None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:06.277339 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fce9b3-b65d-4d2d-b036-3aacc49adada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:06.288301 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 613/1233] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:30:06 2022] POST /identity/v3/users => generated 294 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:06.289647 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d8aba-3093-4b05-9fc7-56d47b9450a8 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:06.289882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d8aba-3093-4b05-9fc7-56d47b9450a8 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:06.290167 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d8aba-3093-4b05-9fc7-56d47b9450a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:06.297964 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-41fce9b3-b65d-4d2d-b036-3aacc49adada None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:06.299159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-41fce9b3-b65d-4d2d-b036-3aacc49adada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:06.307056 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 621/1234] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:06.307809 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fce9b3-b65d-4d2d-b036-3aacc49adada None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:06.310116 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-a58d8aba-3093-4b05-9fc7-56d47b9450a8 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:06.311391 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-a58d8aba-3093-4b05-9fc7-56d47b9450a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:06.317060 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fce9b3-b65d-4d2d-b036-3aacc49adada None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:06.319588 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 614/1235] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:06.320884 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf7a5d-017f-4b24-8bec-0e3e9bcb3b2d None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:06.321081 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf7a5d-017f-4b24-8bec-0e3e9bcb3b2d None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:06.321359 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf7a5d-017f-4b24-8bec-0e3e9bcb3b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:06.322833 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d95c96-aa19-4213-aa4b-8c8671ef092f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:06.323493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d95c96-aa19-4213-aa4b-8c8671ef092f admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:06.323842 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d95c96-aa19-4213-aa4b-8c8671ef092f admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:06.324184 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d95c96-aa19-4213-aa4b-8c8671ef092f admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:06.324933 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d95c96-aa19-4213-aa4b-8c8671ef092f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:06.326249 dv-cinder-862365-5-smb devstack@keystone.service[81402]: WARNING py.warnings [None req-00d95c96-aa19-4213-aa4b-8c8671ef092f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 20:30:06.326249 dv-cinder-862365-5-smb devstack@keystone.service[81402]: warnings.warn(msg) Nov 02 20:30:06.326249 dv-cinder-862365-5-smb devstack@keystone.service[81402]: Nov 02 20:30:06.327568 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d95c96-aa19-4213-aa4b-8c8671ef092f admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:06.343384 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-8ebf7a5d-017f-4b24-8bec-0e3e9bcb3b2d None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:06.344822 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-8ebf7a5d-017f-4b24-8bec-0e3e9bcb3b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:06.354659 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 622/1236] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:30:06 2022] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:06.354659 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d95c96-aa19-4213-aa4b-8c8671ef092f admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:06.354952 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 615/1237] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:06.354952 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf7a5d-017f-4b24-8bec-0e3e9bcb3b2d None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:06.362747 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:06.363001 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:06.367407 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf7a5d-017f-4b24-8bec-0e3e9bcb3b2d None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:06.367704 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d95c96-aa19-4213-aa4b-8c8671ef092f admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:06.373731 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37d93f-c274-407f-b782-ee0aba8bbfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:06.373896 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b95fc4-5c98-408d-b7fd-f12676eb18d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:06.374587 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b95fc4-5c98-408d-b7fd-f12676eb18d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:06.374914 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37d93f-c274-407f-b782-ee0aba8bbfb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:06.375182 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b95fc4-5c98-408d-b7fd-f12676eb18d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:06.375555 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37d93f-c274-407f-b782-ee0aba8bbfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:06.375703 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b95fc4-5c98-408d-b7fd-f12676eb18d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:06.375899 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37d93f-c274-407f-b782-ee0aba8bbfb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:06.376364 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b95fc4-5c98-408d-b7fd-f12676eb18d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:30:06.376609 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b37d93f-c274-407f-b782-ee0aba8bbfb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:06.376728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b95fc4-5c98-408d-b7fd-f12676eb18d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:06.378303 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b95fc4-5c98-408d-b7fd-f12676eb18d3 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:06.378592 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b37d93f-c274-407f-b782-ee0aba8bbfb7 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:06.390681 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 623/1238] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:30:06.393222 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394a525-e749-4ded-88aa-eb133711d302 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:06.393510 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394a525-e749-4ded-88aa-eb133711d302 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:06.393790 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394a525-e749-4ded-88aa-eb133711d302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:06.409788 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 616/1239] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:30:06 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:06.410882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37d93f-c274-407f-b782-ee0aba8bbfb7 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:06.414023 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-6394a525-e749-4ded-88aa-eb133711d302 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:06.415224 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-6394a525-e749-4ded-88aa-eb133711d302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:06.473764 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37d93f-c274-407f-b782-ee0aba8bbfb7 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:06.476512 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 624/1240] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:06.477375 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394a525-e749-4ded-88aa-eb133711d302 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:06.478468 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a457e0-59e9-4387-b853-394469b23d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:06.479084 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a457e0-59e9-4387-b853-394469b23d73 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:06.479386 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a457e0-59e9-4387-b853-394469b23d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:06.479654 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a457e0-59e9-4387-b853-394469b23d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:06.480583 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a457e0-59e9-4387-b853-394469b23d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:06.482211 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a457e0-59e9-4387-b853-394469b23d73 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:06.487444 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394a525-e749-4ded-88aa-eb133711d302 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:06.492270 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65975b28-5ea6-4442-a4f8-21a71ae8b355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:06.492765 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 617/1241] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:06.493957 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e78b24-62c4-49e9-88e9-5135e65955ff None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:06.494245 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e78b24-62c4-49e9-88e9-5135e65955ff None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:06.494521 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e78b24-62c4-49e9-88e9-5135e65955ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:06.495924 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65975b28-5ea6-4442-a4f8-21a71ae8b355 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:06.496231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65975b28-5ea6-4442-a4f8-21a71ae8b355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:06.496513 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65975b28-5ea6-4442-a4f8-21a71ae8b355 admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:06.497191 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65975b28-5ea6-4442-a4f8-21a71ae8b355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:30:06.497502 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65975b28-5ea6-4442-a4f8-21a71ae8b355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:06.499094 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65975b28-5ea6-4442-a4f8-21a71ae8b355 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:06.510927 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 625/1242] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:30:06.511791 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65975b28-5ea6-4442-a4f8-21a71ae8b355 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:06.513602 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-d0e78b24-62c4-49e9-88e9-5135e65955ff None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:06.518425 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-d0e78b24-62c4-49e9-88e9-5135e65955ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:06.524204 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65975b28-5ea6-4442-a4f8-21a71ae8b355 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:06.526174 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 618/1243] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:06.527005 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e78b24-62c4-49e9-88e9-5135e65955ff None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:06.529005 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2d472-9601-4200-906b-c9050329866f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:06.529773 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2d472-9601-4200-906b-c9050329866f admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:06.530065 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2d472-9601-4200-906b-c9050329866f admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:06.530369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2d472-9601-4200-906b-c9050329866f admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:06.531043 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2d472-9601-4200-906b-c9050329866f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:06.532730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2d472-9601-4200-906b-c9050329866f admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:06.536927 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e78b24-62c4-49e9-88e9-5135e65955ff None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:06.542013 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491b025-b187-484f-a8b7-b8d3d7efbf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:06.542541 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491b025-b187-484f-a8b7-b8d3d7efbf7d admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:06.542826 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491b025-b187-484f-a8b7-b8d3d7efbf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:06.543172 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 626/1244] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:06.543270 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491b025-b187-484f-a8b7-b8d3d7efbf7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:06.543867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491b025-b187-484f-a8b7-b8d3d7efbf7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:30:06.543988 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2d472-9601-4200-906b-c9050329866f admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:06.544185 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491b025-b187-484f-a8b7-b8d3d7efbf7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:06.545806 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491b025-b187-484f-a8b7-b8d3d7efbf7d admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:06.554335 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2d472-9601-4200-906b-c9050329866f admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:06.558909 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdc276-75fe-44f0-b00d-dc2b97ce6451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:06.559768 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdc276-75fe-44f0-b00d-dc2b97ce6451 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:06.559895 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 619/1245] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:30:06.559990 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdc276-75fe-44f0-b00d-dc2b97ce6451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:06.560080 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdc276-75fe-44f0-b00d-dc2b97ce6451 admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:06.560396 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491b025-b187-484f-a8b7-b8d3d7efbf7d admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:06.560821 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bdc276-75fe-44f0-b00d-dc2b97ce6451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:06.562802 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bdc276-75fe-44f0-b00d-dc2b97ce6451 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:06.570153 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491b025-b187-484f-a8b7-b8d3d7efbf7d admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:06.574810 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac947ced-1557-48b2-ab66-a90cfe64b8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:06.575397 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac947ced-1557-48b2-ab66-a90cfe64b8b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:06.575682 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac947ced-1557-48b2-ab66-a90cfe64b8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:06.576212 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac947ced-1557-48b2-ab66-a90cfe64b8b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:06.576871 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac947ced-1557-48b2-ab66-a90cfe64b8b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:06.579278 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac947ced-1557-48b2-ab66-a90cfe64b8b0 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:06.594309 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 627/1246] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:30:06 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:06.594309 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdc276-75fe-44f0-b00d-dc2b97ce6451 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:06.603846 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 620/1247] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:30:06 2022] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:06.604913 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac947ced-1557-48b2-ab66-a90cfe64b8b0 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:06.615206 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac947ced-1557-48b2-ab66-a90cfe64b8b0 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:06.656329 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdc276-75fe-44f0-b00d-dc2b97ce6451 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:06.661226 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6970da-e666-49e3-a350-f1d2c61b2ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:06.661829 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6970da-e666-49e3-a350-f1d2c61b2ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:06.662110 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6970da-e666-49e3-a350-f1d2c61b2ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:06.662379 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6970da-e666-49e3-a350-f1d2c61b2ca4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:06.663017 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6970da-e666-49e3-a350-f1d2c61b2ca4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:30:06.663318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6970da-e666-49e3-a350-f1d2c61b2ca4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:06.664978 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6970da-e666-49e3-a350-f1d2c61b2ca4 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:06.671542 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b65cf-2bbf-46f3-9dbe-2bdb2d4a0bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:06.672147 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b65cf-2bbf-46f3-9dbe-2bdb2d4a0bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:06.672483 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b65cf-2bbf-46f3-9dbe-2bdb2d4a0bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:06.672796 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b65cf-2bbf-46f3-9dbe-2bdb2d4a0bc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:06.673468 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b65cf-2bbf-46f3-9dbe-2bdb2d4a0bc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:06.675073 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b65cf-2bbf-46f3-9dbe-2bdb2d4a0bc1 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:06.676082 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 628/1248] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:30:06.676940 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6970da-e666-49e3-a350-f1d2c61b2ca4 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:06.686336 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6970da-e666-49e3-a350-f1d2c61b2ca4 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:06.693388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 621/1249] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:06.693388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b65cf-2bbf-46f3-9dbe-2bdb2d4a0bc1 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:06.693636 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3418045-ba84-4de4-8030-6c88bab7a29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:06.693636 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3418045-ba84-4de4-8030-6c88bab7a29c admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:06.693636 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3418045-ba84-4de4-8030-6c88bab7a29c admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:06.693636 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3418045-ba84-4de4-8030-6c88bab7a29c admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:06.694020 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3418045-ba84-4de4-8030-6c88bab7a29c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:06.695436 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3418045-ba84-4de4-8030-6c88bab7a29c admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:06.701102 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b65cf-2bbf-46f3-9dbe-2bdb2d4a0bc1 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:06.705796 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32022e17-18b3-40b2-a86c-a8b45c7a6a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:06.706382 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32022e17-18b3-40b2-a86c-a8b45c7a6a83 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:06.706666 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32022e17-18b3-40b2-a86c-a8b45c7a6a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:06.706944 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32022e17-18b3-40b2-a86c-a8b45c7a6a83 admin admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:06.707583 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32022e17-18b3-40b2-a86c-a8b45c7a6a83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:30:06.707888 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32022e17-18b3-40b2-a86c-a8b45c7a6a83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:06.709486 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32022e17-18b3-40b2-a86c-a8b45c7a6a83 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:06.724586 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 622/1250] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:30:06.724586 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32022e17-18b3-40b2-a86c-a8b45c7a6a83 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:06.728111 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 629/1251] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:30:06 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:06.728111 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3418045-ba84-4de4-8030-6c88bab7a29c admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:06.734872 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32022e17-18b3-40b2-a86c-a8b45c7a6a83 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:06.747199 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:06.756800 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:06.791041 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3418045-ba84-4de4-8030-6c88bab7a29c admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:06.795696 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12555e8-b0ae-4bb0-8d4e-22525c1cf507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:06.796141 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff00971-b69a-4473-b8f3-88db6dbefce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:06.796286 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12555e8-b0ae-4bb0-8d4e-22525c1cf507 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:06.796567 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12555e8-b0ae-4bb0-8d4e-22525c1cf507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:06.796783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff00971-b69a-4473-b8f3-88db6dbefce9 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:06.796898 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12555e8-b0ae-4bb0-8d4e-22525c1cf507 admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:06.797068 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff00971-b69a-4473-b8f3-88db6dbefce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:06.797346 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff00971-b69a-4473-b8f3-88db6dbefce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:06.798031 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12555e8-b0ae-4bb0-8d4e-22525c1cf507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:06.798514 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff00971-b69a-4473-b8f3-88db6dbefce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:06.799953 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12555e8-b0ae-4bb0-8d4e-22525c1cf507 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:06.800061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff00971-b69a-4473-b8f3-88db6dbefce9 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:06.809958 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 623/1252] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:06.810721 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff00971-b69a-4473-b8f3-88db6dbefce9 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:06.820221 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff00971-b69a-4473-b8f3-88db6dbefce9 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:06.824944 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a863c7-8ef5-41e5-bec7-8d734b723014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:06.825535 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a863c7-8ef5-41e5-bec7-8d734b723014 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:06.826074 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a863c7-8ef5-41e5-bec7-8d734b723014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:06.826356 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a863c7-8ef5-41e5-bec7-8d734b723014 admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:06.826983 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a863c7-8ef5-41e5-bec7-8d734b723014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:06.831289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 630/1253] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:30:06 2022] POST /identity/v3/projects => generated 393 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:06.831289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12555e8-b0ae-4bb0-8d4e-22525c1cf507 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:06.831531 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a863c7-8ef5-41e5-bec7-8d734b723014 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:06.853892 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 624/1254] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:30:06 2022] POST /identity/v3/users => generated 288 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:06.853892 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a863c7-8ef5-41e5-bec7-8d734b723014 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:06.861105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a863c7-8ef5-41e5-bec7-8d734b723014 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:06.902114 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12555e8-b0ae-4bb0-8d4e-22525c1cf507 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:06.907067 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4b564-4387-4e58-8d48-3f16549042c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:06.907679 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4b564-4387-4e58-8d48-3f16549042c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:06.907965 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4b564-4387-4e58-8d48-3f16549042c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:06.908245 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4b564-4387-4e58-8d48-3f16549042c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:06.908932 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4b564-4387-4e58-8d48-3f16549042c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:06.910578 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4b564-4387-4e58-8d48-3f16549042c7 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:06.920529 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 631/1255] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:06.920714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ed4e9-ec8c-49aa-80c3-d2071c8b67f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:06.921305 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ed4e9-ec8c-49aa-80c3-d2071c8b67f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:06.921407 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4b564-4387-4e58-8d48-3f16549042c7 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:06.921656 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ed4e9-ec8c-49aa-80c3-d2071c8b67f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:06.921861 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ed4e9-ec8c-49aa-80c3-d2071c8b67f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:06.922523 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ed4e9-ec8c-49aa-80c3-d2071c8b67f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:06.924406 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ed4e9-ec8c-49aa-80c3-d2071c8b67f6 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:06.930607 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4b564-4387-4e58-8d48-3f16549042c7 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:06.935494 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba56e2c-e676-4c69-a478-4d5272326880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:06.936128 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba56e2c-e676-4c69-a478-4d5272326880 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:06.936413 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba56e2c-e676-4c69-a478-4d5272326880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:06.936731 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba56e2c-e676-4c69-a478-4d5272326880 admin admin] PATH_INFO: `/v3/projects/75583f05294e4e5d87ac76c0352d290c/users/469b5cd3abf74c7984dd02faa1abfcd8/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:06.951816 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 625/1256] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:30:06 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:06.955266 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba56e2c-e676-4c69-a478-4d5272326880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75583f05294e4e5d87ac76c0352d290c, user_id=469b5cd3abf74c7984dd02faa1abfcd8, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:06.955390 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ed4e9-ec8c-49aa-80c3-d2071c8b67f6 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:06.955500 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba56e2c-e676-4c69-a478-4d5272326880 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:06.967607 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 632/1257] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:06 2022] PUT /identity/v3/projects/75583f05294e4e5d87ac76c0352d290c/users/469b5cd3abf74c7984dd02faa1abfcd8/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:06.968377 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba56e2c-e676-4c69-a478-4d5272326880 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:07.017301 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ed4e9-ec8c-49aa-80c3-d2071c8b67f6 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:07.029642 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba56e2c-e676-4c69-a478-4d5272326880 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:07.034395 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75dd2ef-3fea-4631-86d2-15cc0cdb9d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:07.035004 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75dd2ef-3fea-4631-86d2-15cc0cdb9d57 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:07.035286 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75dd2ef-3fea-4631-86d2-15cc0cdb9d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:07.035561 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75dd2ef-3fea-4631-86d2-15cc0cdb9d57 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:07.036195 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75dd2ef-3fea-4631-86d2-15cc0cdb9d57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:07.038181 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75dd2ef-3fea-4631-86d2-15cc0cdb9d57 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:07.049095 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:07.064423 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 633/1258] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:30:06 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:07.064423 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75dd2ef-3fea-4631-86d2-15cc0cdb9d57 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:07.069079 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:07.072632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75dd2ef-3fea-4631-86d2-15cc0cdb9d57 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:07.077353 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6304b83-ad38-4dad-9981-56bd0b3ba18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:07.077977 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6304b83-ad38-4dad-9981-56bd0b3ba18f admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:07.078267 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6304b83-ad38-4dad-9981-56bd0b3ba18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:07.078414 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d8a58-e48e-4795-8d13-b099f4a62617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:07.078575 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6304b83-ad38-4dad-9981-56bd0b3ba18f admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:07.079493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d8a58-e48e-4795-8d13-b099f4a62617 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:07.079779 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d8a58-e48e-4795-8d13-b099f4a62617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:07.079887 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6304b83-ad38-4dad-9981-56bd0b3ba18f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:07.080149 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d8a58-e48e-4795-8d13-b099f4a62617 admin admin] PATH_INFO: `/v3/projects/1478682ac7d14626af7191f30ae1f08b/users/f3d134d3ee554ddbbbf22644945b93cd/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:07.081817 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6304b83-ad38-4dad-9981-56bd0b3ba18f admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:07.095097 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d8a58-e48e-4795-8d13-b099f4a62617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1478682ac7d14626af7191f30ae1f08b, user_id=f3d134d3ee554ddbbbf22644945b93cd, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:07.097789 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d8a58-e48e-4795-8d13-b099f4a62617 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:07.113551 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 626/1259] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:30:06 2022] POST /identity/v3/projects => generated 405 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:07.113551 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6304b83-ad38-4dad-9981-56bd0b3ba18f admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:07.113847 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 634/1260] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:07 2022] PUT /identity/v3/projects/1478682ac7d14626af7191f30ae1f08b/users/f3d134d3ee554ddbbbf22644945b93cd/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:07.113847 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d8a58-e48e-4795-8d13-b099f4a62617 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:07.175438 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6304b83-ad38-4dad-9981-56bd0b3ba18f admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:07.177425 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d8a58-e48e-4795-8d13-b099f4a62617 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:07.180031 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93d4bf-2ee5-41b1-8845-a4bb2726adbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:07.180677 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93d4bf-2ee5-41b1-8845-a4bb2726adbf admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:07.180962 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93d4bf-2ee5-41b1-8845-a4bb2726adbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:07.181241 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93d4bf-2ee5-41b1-8845-a4bb2726adbf admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:07.181875 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b93d4bf-2ee5-41b1-8845-a4bb2726adbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:07.182013 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c604b-75f3-443d-bfe4-eac919138ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:07.182605 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c604b-75f3-443d-bfe4-eac919138ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:07.182884 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c604b-75f3-443d-bfe4-eac919138ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:07.183158 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c604b-75f3-443d-bfe4-eac919138ea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:07.183788 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c604b-75f3-443d-bfe4-eac919138ea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:07.183891 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b93d4bf-2ee5-41b1-8845-a4bb2726adbf admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:07.185413 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c604b-75f3-443d-bfe4-eac919138ea2 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:07.195767 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 635/1261] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:07.197007 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c604b-75f3-443d-bfe4-eac919138ea2 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:07.207218 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 627/1262] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:30:07 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:07.208095 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93d4bf-2ee5-41b1-8845-a4bb2726adbf admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:07.208955 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c604b-75f3-443d-bfe4-eac919138ea2 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:07.214061 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6509b7-c4ee-467b-bbb6-49bcd7ea7fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:07.215229 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6509b7-c4ee-467b-bbb6-49bcd7ea7fee admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:07.215509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6509b7-c4ee-467b-bbb6-49bcd7ea7fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:07.215939 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6509b7-c4ee-467b-bbb6-49bcd7ea7fee admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:07.216598 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6509b7-c4ee-467b-bbb6-49bcd7ea7fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:07.217935 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93d4bf-2ee5-41b1-8845-a4bb2726adbf admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:07.218173 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6509b7-c4ee-467b-bbb6-49bcd7ea7fee admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:07.222899 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd3c19-a155-4bd2-9248-7305604ab8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:07.223484 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd3c19-a155-4bd2-9248-7305604ab8de admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:07.223768 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd3c19-a155-4bd2-9248-7305604ab8de admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:07.224068 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd3c19-a155-4bd2-9248-7305604ab8de admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:07.224734 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd3c19-a155-4bd2-9248-7305604ab8de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:07.226640 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd3c19-a155-4bd2-9248-7305604ab8de admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:07.231345 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 636/1263] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:07.231345 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2a914-fd26-4dee-a08f-39c3246149bf None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:07.231345 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2a914-fd26-4dee-a08f-39c3246149bf None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:07.231345 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2a914-fd26-4dee-a08f-39c3246149bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:07.249541 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-86b2a914-fd26-4dee-a08f-39c3246149bf None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:07.250866 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-86b2a914-fd26-4dee-a08f-39c3246149bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:07.250998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 628/1264] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:30:07 2022] POST /identity/v3/users => generated 286 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:07.251725 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd3c19-a155-4bd2-9248-7305604ab8de admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:07.260339 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 637/1265] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:07.261147 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2a914-fd26-4dee-a08f-39c3246149bf None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:07.264455 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd3c19-a155-4bd2-9248-7305604ab8de admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:07.270153 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a425b-6ca2-4607-96be-b48a3f7c42c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:07.270669 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a425b-6ca2-4607-96be-b48a3f7c42c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:07.270945 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a425b-6ca2-4607-96be-b48a3f7c42c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:07.271054 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2a914-fd26-4dee-a08f-39c3246149bf None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:07.271219 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a425b-6ca2-4607-96be-b48a3f7c42c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:07.271853 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a425b-6ca2-4607-96be-b48a3f7c42c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:07.273491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a425b-6ca2-4607-96be-b48a3f7c42c6 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:07.275691 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ac0b2-50ea-48d5-8122-0a4beafbf85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:07.276284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ac0b2-50ea-48d5-8122-0a4beafbf85d admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:07.276587 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ac0b2-50ea-48d5-8122-0a4beafbf85d admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:07.276868 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ac0b2-50ea-48d5-8122-0a4beafbf85d admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:07.277501 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ac0b2-50ea-48d5-8122-0a4beafbf85d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:07.279407 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ac0b2-50ea-48d5-8122-0a4beafbf85d admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:07.285448 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 629/1266] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:07.286708 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729241e-e8f2-4e0d-bd8a-ff5a132db276 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:07.286999 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729241e-e8f2-4e0d-bd8a-ff5a132db276 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:07.287273 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729241e-e8f2-4e0d-bd8a-ff5a132db276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:07.307146 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 638/1267] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:30:07 2022] POST /identity/v3/users => generated 303 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:07.307146 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ac0b2-50ea-48d5-8122-0a4beafbf85d admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:07.308447 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-7729241e-e8f2-4e0d-bd8a-ff5a132db276 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:07.309675 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-7729241e-e8f2-4e0d-bd8a-ff5a132db276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:07.316564 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ac0b2-50ea-48d5-8122-0a4beafbf85d admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:07.317340 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 630/1268] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:07.318222 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729241e-e8f2-4e0d-bd8a-ff5a132db276 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:07.329356 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729241e-e8f2-4e0d-bd8a-ff5a132db276 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:07.331410 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f781f8d-35b6-4a66-8633-88ca94c12578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:07.332033 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f781f8d-35b6-4a66-8633-88ca94c12578 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:07.332325 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f781f8d-35b6-4a66-8633-88ca94c12578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:07.332674 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f781f8d-35b6-4a66-8633-88ca94c12578 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:07.333612 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f781f8d-35b6-4a66-8633-88ca94c12578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:07.334464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e94e6-3061-46f1-8833-be022e095aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:07.335069 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e94e6-3061-46f1-8833-be022e095aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:07.335288 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f781f8d-35b6-4a66-8633-88ca94c12578 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:07.335401 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e94e6-3061-46f1-8833-be022e095aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:07.335614 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e94e6-3061-46f1-8833-be022e095aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:07.336259 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e94e6-3061-46f1-8833-be022e095aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:07.337872 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e94e6-3061-46f1-8833-be022e095aa4 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:07.349724 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 639/1269] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:07.349724 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f781f8d-35b6-4a66-8633-88ca94c12578 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:07.350017 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 631/1270] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:07.350017 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e94e6-3061-46f1-8833-be022e095aa4 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:07.357147 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f781f8d-35b6-4a66-8633-88ca94c12578 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:07.361089 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e94e6-3061-46f1-8833-be022e095aa4 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:07.361810 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c88f9-5ac8-45cc-8201-b6f55d350936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:07.362449 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c88f9-5ac8-45cc-8201-b6f55d350936 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:07.362730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c88f9-5ac8-45cc-8201-b6f55d350936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:07.363009 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c88f9-5ac8-45cc-8201-b6f55d350936 admin admin] PATH_INFO: `/v3/projects/215e8300c2554f64b835b48c0d22c4d5/users/6147bac8e2104d04b727c1e3bc7fff6c/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:07.367134 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa023d-0d06-46b5-a263-31aa6b24c2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:07.367730 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa023d-0d06-46b5-a263-31aa6b24c2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:07.368010 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa023d-0d06-46b5-a263-31aa6b24c2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:07.368284 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa023d-0d06-46b5-a263-31aa6b24c2e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:07.368952 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa023d-0d06-46b5-a263-31aa6b24c2e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:07.370524 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa023d-0d06-46b5-a263-31aa6b24c2e7 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:07.377727 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c88f9-5ac8-45cc-8201-b6f55d350936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=215e8300c2554f64b835b48c0d22c4d5, user_id=6147bac8e2104d04b727c1e3bc7fff6c, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:07.380340 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c88f9-5ac8-45cc-8201-b6f55d350936 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:07.381521 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 632/1271] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:07.382302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa023d-0d06-46b5-a263-31aa6b24c2e7 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:07.396857 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 640/1272] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:07 2022] PUT /identity/v3/projects/215e8300c2554f64b835b48c0d22c4d5/users/6147bac8e2104d04b727c1e3bc7fff6c/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:07.400731 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c88f9-5ac8-45cc-8201-b6f55d350936 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:07.437115 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa023d-0d06-46b5-a263-31aa6b24c2e7 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:07.442934 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:07.462617 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c88f9-5ac8-45cc-8201-b6f55d350936 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:07.467423 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aafc4d6-e6e6-4bec-aafb-77b6fc741c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:07.468024 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafc4d6-e6e6-4bec-aafb-77b6fc741c4e admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:07.468309 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafc4d6-e6e6-4bec-aafb-77b6fc741c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:07.468614 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafc4d6-e6e6-4bec-aafb-77b6fc741c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:07.469776 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aafc4d6-e6e6-4bec-aafb-77b6fc741c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:07.471373 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aafc4d6-e6e6-4bec-aafb-77b6fc741c4e admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:07.481279 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 641/1273] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:07.482152 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aafc4d6-e6e6-4bec-aafb-77b6fc741c4e admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:07.487280 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:07.493669 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9800fc-9d98-4df8-bb49-f4b6a5642bd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:07.493847 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aafc4d6-e6e6-4bec-aafb-77b6fc741c4e admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:07.494286 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9800fc-9d98-4df8-bb49-f4b6a5642bd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:07.494800 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9800fc-9d98-4df8-bb49-f4b6a5642bd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:07.495110 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9800fc-9d98-4df8-bb49-f4b6a5642bd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:07.498796 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95b496-f60c-4adc-9346-f0ae5aeb684c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:07.499380 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95b496-f60c-4adc-9346-f0ae5aeb684c admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:07.499664 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95b496-f60c-4adc-9346-f0ae5aeb684c admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:07.499941 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95b496-f60c-4adc-9346-f0ae5aeb684c admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:07.501131 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95b496-f60c-4adc-9346-f0ae5aeb684c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:07.502754 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95b496-f60c-4adc-9346-f0ae5aeb684c admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:07.505633 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9800fc-9d98-4df8-bb49-f4b6a5642bd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:07.507061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9800fc-9d98-4df8-bb49-f4b6a5642bd1 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:07.513454 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 642/1274] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:07.514275 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95b496-f60c-4adc-9346-f0ae5aeb684c admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:07.519226 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 633/1275] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:07.519226 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9800fc-9d98-4df8-bb49-f4b6a5642bd1 service neutron] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:07.525601 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95b496-f60c-4adc-9346-f0ae5aeb684c admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:07.529340 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9800fc-9d98-4df8-bb49-f4b6a5642bd1 service neutron] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:07.529488 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d5df4-8041-4fde-9eab-6c1b56c4152b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:07.530023 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d5df4-8041-4fde-9eab-6c1b56c4152b service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:07.530309 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d5df4-8041-4fde-9eab-6c1b56c4152b service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:07.530786 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d5df4-8041-4fde-9eab-6c1b56c4152b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:07.535796 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6beca9-d494-4f0e-bec9-ad700f5305cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:07.536582 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6beca9-d494-4f0e-bec9-ad700f5305cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:07.537112 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6beca9-d494-4f0e-bec9-ad700f5305cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:07.537112 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6beca9-d494-4f0e-bec9-ad700f5305cd admin admin] PATH_INFO: `/v3/projects/aa680622d2734ab59a1b81646fa6113d/users/59c541f62cfe49a8b750e4ae067c63e9/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:07.542014 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d5df4-8041-4fde-9eab-6c1b56c4152b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:07.543602 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d5df4-8041-4fde-9eab-6c1b56c4152b service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:07.553637 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6beca9-d494-4f0e-bec9-ad700f5305cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa680622d2734ab59a1b81646fa6113d, user_id=59c541f62cfe49a8b750e4ae067c63e9, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:07.555733 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 643/1276] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:07.556588 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d5df4-8041-4fde-9eab-6c1b56c4152b service neutron] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:07.556931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6beca9-d494-4f0e-bec9-ad700f5305cd admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:07.568590 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d5df4-8041-4fde-9eab-6c1b56c4152b service neutron] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:07.572127 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 634/1277] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:07 2022] PUT /identity/v3/projects/aa680622d2734ab59a1b81646fa6113d/users/59c541f62cfe49a8b750e4ae067c63e9/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:07.573249 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6beca9-d494-4f0e-bec9-ad700f5305cd admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:07.636127 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb49f2f-081b-4f39-b6aa-53be7388da14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:07.636893 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb49f2f-081b-4f39-b6aa-53be7388da14 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:07.637488 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb49f2f-081b-4f39-b6aa-53be7388da14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:07.637806 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb49f2f-081b-4f39-b6aa-53be7388da14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:07.638488 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb49f2f-081b-4f39-b6aa-53be7388da14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:07.640136 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb49f2f-081b-4f39-b6aa-53be7388da14 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:07.647934 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6beca9-d494-4f0e-bec9-ad700f5305cd admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:07.654659 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 644/1278] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:07.654659 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaab466-bcee-4e30-8dc7-ed5bee58555a None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:07.654659 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaab466-bcee-4e30-8dc7-ed5bee58555a None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:07.654659 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaab466-bcee-4e30-8dc7-ed5bee58555a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:07.657764 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed676bcc-1f95-4f44-ae30-b64707fd7354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:07.658576 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed676bcc-1f95-4f44-ae30-b64707fd7354 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:07.659033 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed676bcc-1f95-4f44-ae30-b64707fd7354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:07.659392 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed676bcc-1f95-4f44-ae30-b64707fd7354 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:07.660104 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed676bcc-1f95-4f44-ae30-b64707fd7354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:07.661832 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed676bcc-1f95-4f44-ae30-b64707fd7354 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:07.676444 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 635/1279] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:07.676694 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-caaab466-bcee-4e30-8dc7-ed5bee58555a None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:07.677992 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-caaab466-bcee-4e30-8dc7-ed5bee58555a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:07.680710 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed676bcc-1f95-4f44-ae30-b64707fd7354 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:07.686399 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 645/1280] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:07.687081 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaab466-bcee-4e30-8dc7-ed5bee58555a None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:07.696664 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed676bcc-1f95-4f44-ae30-b64707fd7354 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:07.697717 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaab466-bcee-4e30-8dc7-ed5bee58555a None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:07.702707 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d6cda-44aa-4ca4-bd5c-2e75806a1c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:07.703550 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be41e3-010a-40bb-a85f-94363330b6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:07.703762 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d6cda-44aa-4ca4-bd5c-2e75806a1c32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:07.704824 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d6cda-44aa-4ca4-bd5c-2e75806a1c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:07.705002 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be41e3-010a-40bb-a85f-94363330b6e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:07.705180 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d6cda-44aa-4ca4-bd5c-2e75806a1c32 admin admin] PATH_INFO: `/v3/projects/183faacdc7124d9887adfdf95e1aaae8/users/3dc51a71d6dc4f6aa33f7436efaeb5b1/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:07.705429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be41e3-010a-40bb-a85f-94363330b6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:07.705793 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be41e3-010a-40bb-a85f-94363330b6e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:07.706509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be41e3-010a-40bb-a85f-94363330b6e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:07.708256 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be41e3-010a-40bb-a85f-94363330b6e3 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:07.718875 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 646/1281] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:07.720267 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbebb5f-d89c-4c51-8bee-ca1ae0c99c5a None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:07.720787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbebb5f-d89c-4c51-8bee-ca1ae0c99c5a None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:07.720932 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbebb5f-d89c-4c51-8bee-ca1ae0c99c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:07.724242 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d6cda-44aa-4ca4-bd5c-2e75806a1c32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=183faacdc7124d9887adfdf95e1aaae8, user_id=3dc51a71d6dc4f6aa33f7436efaeb5b1, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:07.727437 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d6cda-44aa-4ca4-bd5c-2e75806a1c32 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:07.744456 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 636/1282] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:07 2022] PUT /identity/v3/projects/183faacdc7124d9887adfdf95e1aaae8/users/3dc51a71d6dc4f6aa33f7436efaeb5b1/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:07.745718 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d6cda-44aa-4ca4-bd5c-2e75806a1c32 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:07.761188 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-9cbebb5f-d89c-4c51-8bee-ca1ae0c99c5a None None] MFA Rules not processed for user `59c541f62cfe49a8b750e4ae067c63e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:07.762529 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-9cbebb5f-d89c-4c51-8bee-ca1ae0c99c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:07.839661 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 647/1283] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:07.840300 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbebb5f-d89c-4c51-8bee-ca1ae0c99c5a None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:07.842996 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d6cda-44aa-4ca4-bd5c-2e75806a1c32 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:07.849971 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00418eb-df0a-48a5-af6a-9c04a4d7ef90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:07.850652 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00418eb-df0a-48a5-af6a-9c04a4d7ef90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:07.850986 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00418eb-df0a-48a5-af6a-9c04a4d7ef90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:07.851373 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00418eb-df0a-48a5-af6a-9c04a4d7ef90 admin admin] PATH_INFO: `/v3/projects/bca6de3f1c6e42eb95efeb8a9a39b001/users/4bd602c085ad406eab3705dc8500a003/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:07.854153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbebb5f-d89c-4c51-8bee-ca1ae0c99c5a None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:07.854491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:07.859531 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699c419-42e5-4c1b-8310-b2c8723356de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:07.860995 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699c419-42e5-4c1b-8310-b2c8723356de admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:07.861245 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699c419-42e5-4c1b-8310-b2c8723356de admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:07.861776 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699c419-42e5-4c1b-8310-b2c8723356de admin admin] PATH_INFO: `/v3/projects/949af41049344b56811b82f94c427ab6/users/d29e2c0e8aab45a38964be7c806bc1d6/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:07.873921 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00418eb-df0a-48a5-af6a-9c04a4d7ef90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bca6de3f1c6e42eb95efeb8a9a39b001, user_id=4bd602c085ad406eab3705dc8500a003, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:07.877513 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00418eb-df0a-48a5-af6a-9c04a4d7ef90 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:07.878145 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699c419-42e5-4c1b-8310-b2c8723356de admin admin] RBAC: Authorizing `identity:create_grant(project_id=949af41049344b56811b82f94c427ab6, user_id=d29e2c0e8aab45a38964be7c806bc1d6, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:07.880856 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699c419-42e5-4c1b-8310-b2c8723356de admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:07.893834 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 637/1284] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:07 2022] PUT /identity/v3/projects/bca6de3f1c6e42eb95efeb8a9a39b001/users/4bd602c085ad406eab3705dc8500a003/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:07.894869 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00418eb-df0a-48a5-af6a-9c04a4d7ef90 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:07.899781 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 648/1285] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:07 2022] PUT /identity/v3/projects/949af41049344b56811b82f94c427ab6/users/d29e2c0e8aab45a38964be7c806bc1d6/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:07.908378 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699c419-42e5-4c1b-8310-b2c8723356de admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:07.937516 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:07.986346 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00418eb-df0a-48a5-af6a-9c04a4d7ef90 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:07.996155 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699c419-42e5-4c1b-8310-b2c8723356de admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:08.003650 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230d4c1-57ff-4386-8ba9-c602102ba852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:08.005412 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230d4c1-57ff-4386-8ba9-c602102ba852 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:08.005827 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230d4c1-57ff-4386-8ba9-c602102ba852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:08.006253 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230d4c1-57ff-4386-8ba9-c602102ba852 admin admin] PATH_INFO: `/v3/projects/f6252d1e8b37462d8c62528523ace40f/users/02dd1dbe72c144af99ea60c39b392239/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:08.027758 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5230d4c1-57ff-4386-8ba9-c602102ba852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6252d1e8b37462d8c62528523ace40f, user_id=02dd1dbe72c144af99ea60c39b392239, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:08.031089 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5230d4c1-57ff-4386-8ba9-c602102ba852 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:08.060843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46355500-1238-44a5-b024-7968d76e6673 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:08.061655 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46355500-1238-44a5-b024-7968d76e6673 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:08.062110 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46355500-1238-44a5-b024-7968d76e6673 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:08.062444 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46355500-1238-44a5-b024-7968d76e6673 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:08.063439 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 649/1286] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:07 2022] PUT /identity/v3/projects/f6252d1e8b37462d8c62528523ace40f/users/02dd1dbe72c144af99ea60c39b392239/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:08.067954 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20094d-4b51-466b-8c53-f3dcd857957c None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:08.068182 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20094d-4b51-466b-8c53-f3dcd857957c None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:08.071068 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20094d-4b51-466b-8c53-f3dcd857957c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:08.081694 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46355500-1238-44a5-b024-7968d76e6673 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:08.083353 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46355500-1238-44a5-b024-7968d76e6673 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:08.095248 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 638/1287] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:08.096170 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46355500-1238-44a5-b024-7968d76e6673 service neutron] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:08.106561 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46355500-1238-44a5-b024-7968d76e6673 service neutron] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:08.138253 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-0d20094d-4b51-466b-8c53-f3dcd857957c None None] MFA Rules not processed for user `3dc51a71d6dc4f6aa33f7436efaeb5b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:08.139879 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-0d20094d-4b51-466b-8c53-f3dcd857957c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:08.179837 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07321b-fcf1-4b68-bb77-9a6b3ca5820e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:08.180528 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07321b-fcf1-4b68-bb77-9a6b3ca5820e admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:08.181823 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07321b-fcf1-4b68-bb77-9a6b3ca5820e admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:08.181823 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07321b-fcf1-4b68-bb77-9a6b3ca5820e admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:08.181823 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07321b-fcf1-4b68-bb77-9a6b3ca5820e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:08.184103 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07321b-fcf1-4b68-bb77-9a6b3ca5820e admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:08.235619 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 639/1288] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:30:08 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:08.239241 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5541c2-1b0b-4468-99f5-df34c73990c2 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:08.240215 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5541c2-1b0b-4468-99f5-df34c73990c2 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:08.242605 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5541c2-1b0b-4468-99f5-df34c73990c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:08.279088 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-dc5541c2-1b0b-4468-99f5-df34c73990c2 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:08.280579 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 650/1289] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:08.280719 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-dc5541c2-1b0b-4468-99f5-df34c73990c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:08.287719 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4958ec9-aa90-4dca-a26e-cf09efae55c2 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:08.288065 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4958ec9-aa90-4dca-a26e-cf09efae55c2 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:08.288419 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4958ec9-aa90-4dca-a26e-cf09efae55c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:08.309407 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:08.324959 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-a4958ec9-aa90-4dca-a26e-cf09efae55c2 None None] MFA Rules not processed for user `d29e2c0e8aab45a38964be7c806bc1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:08.327307 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-a4958ec9-aa90-4dca-a26e-cf09efae55c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:08.390020 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 640/1290] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:08.392780 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bdbbc-a77d-4e17-ab61-92d48338663e None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:08.393362 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bdbbc-a77d-4e17-ab61-92d48338663e None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:08.393702 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bdbbc-a77d-4e17-ab61-92d48338663e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:08.411177 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 651/1291] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:08.412250 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4958ec9-aa90-4dca-a26e-cf09efae55c2 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:08.424600 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4958ec9-aa90-4dca-a26e-cf09efae55c2 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:08.430119 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5888fd8-b88d-441b-83ef-b455016c3868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:08.430856 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5888fd8-b88d-441b-83ef-b455016c3868 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:08.431898 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5888fd8-b88d-441b-83ef-b455016c3868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:08.432283 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5888fd8-b88d-441b-83ef-b455016c3868 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:08.433044 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5888fd8-b88d-441b-83ef-b455016c3868 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:08.434020 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-046bdbbc-a77d-4e17-ab61-92d48338663e None None] MFA Rules not processed for user `02dd1dbe72c144af99ea60c39b392239`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:08.435240 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5888fd8-b88d-441b-83ef-b455016c3868 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:08.436590 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-046bdbbc-a77d-4e17-ab61-92d48338663e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:08.469182 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 652/1292] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:30:08 2022] POST /identity/v3/users => generated 294 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:08.469182 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7aa1d-966b-436a-8660-1952e6e8890d None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:08.469182 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7aa1d-966b-436a-8660-1952e6e8890d None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:08.469182 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7aa1d-966b-436a-8660-1952e6e8890d None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:08.471146 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 653/1293] 10.222.0.23 () {54 vars in 961 bytes} [Wed Nov 2 20:30:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:30:08.471931 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7aa1d-966b-436a-8660-1952e6e8890d None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:08.487011 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7aa1d-966b-436a-8660-1952e6e8890d None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:08.492222 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06a18e-5b9e-44ad-a394-b97d064c1ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:08.492932 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06a18e-5b9e-44ad-a394-b97d064c1ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:08.493356 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06a18e-5b9e-44ad-a394-b97d064c1ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:08.493606 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06a18e-5b9e-44ad-a394-b97d064c1ed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:08.494370 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a06a18e-5b9e-44ad-a394-b97d064c1ed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:08.497054 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a06a18e-5b9e-44ad-a394-b97d064c1ed5 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:08.502603 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:08.546579 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 654/1294] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:30:08 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:08.548170 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06a18e-5b9e-44ad-a394-b97d064c1ed5 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:08.557507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 641/1295] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:08 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:08.561548 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046bdbbc-a77d-4e17-ab61-92d48338663e None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:08.576603 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046bdbbc-a77d-4e17-ab61-92d48338663e None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:08.629886 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06a18e-5b9e-44ad-a394-b97d064c1ed5 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:08.634584 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76686d-a11d-4340-a41b-529a3d60e6af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:08.635253 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76686d-a11d-4340-a41b-529a3d60e6af service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:08.635542 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76686d-a11d-4340-a41b-529a3d60e6af service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:08.636014 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76686d-a11d-4340-a41b-529a3d60e6af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:08.685534 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd3466-f083-4e81-a97d-aef2ed6764ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:08.686616 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd3466-f083-4e81-a97d-aef2ed6764ae admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:08.687100 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd3466-f083-4e81-a97d-aef2ed6764ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:08.687990 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd3466-f083-4e81-a97d-aef2ed6764ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:08.689611 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd3466-f083-4e81-a97d-aef2ed6764ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:08.692141 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd3466-f083-4e81-a97d-aef2ed6764ae admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:08.717229 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 642/1296] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:08.719520 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4f7a4-fe54-462a-8835-b0c72eefdb48 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:08.720143 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4f7a4-fe54-462a-8835-b0c72eefdb48 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:08.720942 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4f7a4-fe54-462a-8835-b0c72eefdb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:08.808899 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76686d-a11d-4340-a41b-529a3d60e6af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:08.811625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-46d4f7a4-fe54-462a-8835-b0c72eefdb48 None None] MFA Rules not processed for user `f906fd11db004026a78eb3d69fa5b298`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:08.816912 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-46d4f7a4-fe54-462a-8835-b0c72eefdb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:08.817321 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76686d-a11d-4340-a41b-529a3d60e6af service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:08.850683 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 655/1297] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:08.851548 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76686d-a11d-4340-a41b-529a3d60e6af service neutron] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:08.871150 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76686d-a11d-4340-a41b-529a3d60e6af service neutron] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:08.879036 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab432298-8e0d-4c62-812c-ca230a1e2bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:08.879666 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab432298-8e0d-4c62-812c-ca230a1e2bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:08.879952 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab432298-8e0d-4c62-812c-ca230a1e2bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:08.880233 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab432298-8e0d-4c62-812c-ca230a1e2bc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:08.880903 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab432298-8e0d-4c62-812c-ca230a1e2bc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:08.882855 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab432298-8e0d-4c62-812c-ca230a1e2bc5 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:08.894666 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:08.971002 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 656/1298] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:30:08 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:08.971002 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab432298-8e0d-4c62-812c-ca230a1e2bc5 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:08.988058 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 643/1299] 10.222.0.23 () {58 vars in 1058 bytes} [Wed Nov 2 20:30:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:08.990665 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4f7a4-fe54-462a-8835-b0c72eefdb48 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:08.992423 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab432298-8e0d-4c62-812c-ca230a1e2bc5 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:09.001877 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4602c-d29d-44f2-9c37-b265bb81fbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:09.002630 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4602c-d29d-44f2-9c37-b265bb81fbf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:09.003016 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4602c-d29d-44f2-9c37-b265bb81fbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:09.004489 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4602c-d29d-44f2-9c37-b265bb81fbf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:09.005269 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4602c-d29d-44f2-9c37-b265bb81fbf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:09.008537 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4602c-d29d-44f2-9c37-b265bb81fbf8 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:09.038530 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4f7a4-fe54-462a-8835-b0c72eefdb48 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:09.046313 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53597cc6-d6fe-4a27-ac79-f441c3398413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:09.047455 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53597cc6-d6fe-4a27-ac79-f441c3398413 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:09.048022 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53597cc6-d6fe-4a27-ac79-f441c3398413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:09.048593 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53597cc6-d6fe-4a27-ac79-f441c3398413 admin admin] PATH_INFO: `/v3/projects/05e2245b5d7b4201a92dff1796866111/users/376f7abd349e46d49c53336dade1dc27/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:09.055839 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 657/1300] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:30:08 2022] POST /identity/v3/projects => generated 403 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:09.057909 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4602c-d29d-44f2-9c37-b265bb81fbf8 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:09.069763 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53597cc6-d6fe-4a27-ac79-f441c3398413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05e2245b5d7b4201a92dff1796866111, user_id=376f7abd349e46d49c53336dade1dc27, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:09.073564 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53597cc6-d6fe-4a27-ac79-f441c3398413 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:09.094847 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 644/1301] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:08 2022] PUT /identity/v3/projects/05e2245b5d7b4201a92dff1796866111/users/376f7abd349e46d49c53336dade1dc27/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:09.096684 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53597cc6-d6fe-4a27-ac79-f441c3398413 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:09.160518 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:09.169773 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4602c-d29d-44f2-9c37-b265bb81fbf8 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:09.185303 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53597cc6-d6fe-4a27-ac79-f441c3398413 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:09.192214 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58258464-8323-4b53-b942-c3dc3a683562 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:09.192871 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58258464-8323-4b53-b942-c3dc3a683562 service nova] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:09.193215 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58258464-8323-4b53-b942-c3dc3a683562 service nova] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:09.193430 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58258464-8323-4b53-b942-c3dc3a683562 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:09.263891 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58258464-8323-4b53-b942-c3dc3a683562 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:09.265546 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58258464-8323-4b53-b942-c3dc3a683562 service nova] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:09.269756 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfbd5b-8a40-4943-927b-97f1cb15868c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:09.270105 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfbd5b-8a40-4943-927b-97f1cb15868c admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:09.270778 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfbd5b-8a40-4943-927b-97f1cb15868c admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:09.271230 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfbd5b-8a40-4943-927b-97f1cb15868c admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:09.272114 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cfbd5b-8a40-4943-927b-97f1cb15868c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:09.274908 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cfbd5b-8a40-4943-927b-97f1cb15868c admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:09.277524 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 645/1302] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:09.278532 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58258464-8323-4b53-b942-c3dc3a683562 service nova] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:09.291158 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58258464-8323-4b53-b942-c3dc3a683562 service nova] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:09.292030 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 658/1303] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:09.293706 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfbd5b-8a40-4943-927b-97f1cb15868c admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:09.301994 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30afb75-6d01-43a2-a2e7-8039f6f85c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:09.302732 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30afb75-6d01-43a2-a2e7-8039f6f85c01 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:09.303144 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30afb75-6d01-43a2-a2e7-8039f6f85c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:09.303480 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30afb75-6d01-43a2-a2e7-8039f6f85c01 admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:09.304419 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30afb75-6d01-43a2-a2e7-8039f6f85c01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:09.306831 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30afb75-6d01-43a2-a2e7-8039f6f85c01 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:09.310459 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfbd5b-8a40-4943-927b-97f1cb15868c admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:09.316822 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef1c34-7c7c-410b-be19-7b935a96da68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:09.317252 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef1c34-7c7c-410b-be19-7b935a96da68 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:09.317674 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef1c34-7c7c-410b-be19-7b935a96da68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:09.317958 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef1c34-7c7c-410b-be19-7b935a96da68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:09.318917 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef1c34-7c7c-410b-be19-7b935a96da68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:09.321323 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef1c34-7c7c-410b-be19-7b935a96da68 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:09.334657 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 646/1304] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:30:09 2022] POST /identity/v3/users => generated 308 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:09.335502 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30afb75-6d01-43a2-a2e7-8039f6f85c01 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:09.350302 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 659/1305] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:09.350302 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef1c34-7c7c-410b-be19-7b935a96da68 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:09.350589 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30afb75-6d01-43a2-a2e7-8039f6f85c01 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:09.357700 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf6ac7-5f75-4444-a595-3c544d7aabc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:09.358605 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf6ac7-5f75-4444-a595-3c544d7aabc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:09.358899 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf6ac7-5f75-4444-a595-3c544d7aabc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:09.359178 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf6ac7-5f75-4444-a595-3c544d7aabc9 admin admin] PATH_INFO: `/v3/projects/1c3190060b924a8caf4f3a5ecbf40151/users/e010d18e48d042ccb8b9d9b0c411461f/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:09.376252 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef1c34-7c7c-410b-be19-7b935a96da68 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:09.380020 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf6ac7-5f75-4444-a595-3c544d7aabc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c3190060b924a8caf4f3a5ecbf40151, user_id=e010d18e48d042ccb8b9d9b0c411461f, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:09.383406 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf6ac7-5f75-4444-a595-3c544d7aabc9 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:09.387516 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165954e7-fb7d-419a-85b2-759d17e20387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:09.388143 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165954e7-fb7d-419a-85b2-759d17e20387 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:09.388673 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165954e7-fb7d-419a-85b2-759d17e20387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:09.388964 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165954e7-fb7d-419a-85b2-759d17e20387 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:09.389661 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165954e7-fb7d-419a-85b2-759d17e20387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:09.392445 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165954e7-fb7d-419a-85b2-759d17e20387 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:09.406333 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 647/1306] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:09 2022] PUT /identity/v3/projects/1c3190060b924a8caf4f3a5ecbf40151/users/e010d18e48d042ccb8b9d9b0c411461f/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:09.407744 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 660/1307] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:09.411068 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165954e7-fb7d-419a-85b2-759d17e20387 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:09.411308 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf6ac7-5f75-4444-a595-3c544d7aabc9 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:09.421628 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:09.424965 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165954e7-fb7d-419a-85b2-759d17e20387 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:09.527784 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228c336-6d12-43f2-b923-a48215c43b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:09.528480 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228c336-6d12-43f2-b923-a48215c43b4e admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:09.528792 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228c336-6d12-43f2-b923-a48215c43b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:09.529065 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228c336-6d12-43f2-b923-a48215c43b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:09.530962 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228c336-6d12-43f2-b923-a48215c43b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:09.532990 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228c336-6d12-43f2-b923-a48215c43b4e admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:09.552528 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 661/1308] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:30:09.553616 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228c336-6d12-43f2-b923-a48215c43b4e admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:09.567618 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228c336-6d12-43f2-b923-a48215c43b4e admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:09.574282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d2875-11f4-4c4c-b890-4fefcadff6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:09.575064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d2875-11f4-4c4c-b890-4fefcadff6d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:09.575414 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d2875-11f4-4c4c-b890-4fefcadff6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:09.575797 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d2875-11f4-4c4c-b890-4fefcadff6d3 admin admin] PATH_INFO: `/v3/projects/cef30597097c4416b78d0c60269a2192/users/1d97af303cfa448f8a56e9f16563220a/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:09.594664 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf6ac7-5f75-4444-a595-3c544d7aabc9 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:09.598228 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d2875-11f4-4c4c-b890-4fefcadff6d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cef30597097c4416b78d0c60269a2192, user_id=1d97af303cfa448f8a56e9f16563220a, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:09.601337 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d2875-11f4-4c4c-b890-4fefcadff6d3 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:09.609215 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036cba0-cd04-4ae5-8472-04305b7f1a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:09.610747 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036cba0-cd04-4ae5-8472-04305b7f1a3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:09.611034 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036cba0-cd04-4ae5-8472-04305b7f1a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:09.611358 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036cba0-cd04-4ae5-8472-04305b7f1a3d admin admin] PATH_INFO: `/v3/projects/05e2245b5d7b4201a92dff1796866111/users/376f7abd349e46d49c53336dade1dc27/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:09.615744 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5036cba0-cd04-4ae5-8472-04305b7f1a3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=05e2245b5d7b4201a92dff1796866111, user_id=376f7abd349e46d49c53336dade1dc27, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:09.618443 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5036cba0-cd04-4ae5-8472-04305b7f1a3d admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:09.621196 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 662/1309] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:09 2022] PUT /identity/v3/projects/cef30597097c4416b78d0c60269a2192/users/1d97af303cfa448f8a56e9f16563220a/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:09.622532 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d2875-11f4-4c4c-b890-4fefcadff6d3 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:09.648449 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 648/1310] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:09 2022] PUT /identity/v3/projects/05e2245b5d7b4201a92dff1796866111/users/376f7abd349e46d49c53336dade1dc27/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:09.658130 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036cba0-cd04-4ae5-8472-04305b7f1a3d admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:09.692513 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:09.714367 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d2875-11f4-4c4c-b890-4fefcadff6d3 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:09.806896 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb212177-e42b-4191-8dfb-c74df301e866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:09.807878 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb212177-e42b-4191-8dfb-c74df301e866 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:09.808831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb212177-e42b-4191-8dfb-c74df301e866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:09.809268 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb212177-e42b-4191-8dfb-c74df301e866 admin admin] PATH_INFO: `/v3/projects/1c3190060b924a8caf4f3a5ecbf40151/users/e010d18e48d042ccb8b9d9b0c411461f/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:09.812742 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb212177-e42b-4191-8dfb-c74df301e866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c3190060b924a8caf4f3a5ecbf40151, user_id=e010d18e48d042ccb8b9d9b0c411461f, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:09.817445 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb212177-e42b-4191-8dfb-c74df301e866 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:09.819180 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036cba0-cd04-4ae5-8472-04305b7f1a3d admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:09.824926 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777ec57-f07b-4388-960f-7d43db76ffa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:09.827881 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777ec57-f07b-4388-960f-7d43db76ffa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:09.828859 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777ec57-f07b-4388-960f-7d43db76ffa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:09.829302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777ec57-f07b-4388-960f-7d43db76ffa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:09.830120 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8777ec57-f07b-4388-960f-7d43db76ffa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:09.844015 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8777ec57-f07b-4388-960f-7d43db76ffa3 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:09.863365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 663/1311] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:09 2022] PUT /identity/v3/projects/1c3190060b924a8caf4f3a5ecbf40151/users/e010d18e48d042ccb8b9d9b0c411461f/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:09.866168 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce551c-524d-4472-8f7c-e164270c1f4d None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:09.867373 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce551c-524d-4472-8f7c-e164270c1f4d None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:09.867811 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce551c-524d-4472-8f7c-e164270c1f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:09.877410 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 649/1312] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:09.879907 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc661c-ab2b-455e-9a57-29377008122a None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:09.881157 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc661c-ab2b-455e-9a57-29377008122a None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:09.883382 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc661c-ab2b-455e-9a57-29377008122a None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:09.884891 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 650/1313] 10.222.0.23 () {54 vars in 912 bytes} [Wed Nov 2 20:30:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:30:09.893751 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70af8d-1f9e-48d6-ab20-733bec755086 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:09.897007 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70af8d-1f9e-48d6-ab20-733bec755086 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:09.897479 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70af8d-1f9e-48d6-ab20-733bec755086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:09.945380 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-35ce551c-524d-4472-8f7c-e164270c1f4d None None] MFA Rules not processed for user `376f7abd349e46d49c53336dade1dc27`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:09.946852 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-35ce551c-524d-4472-8f7c-e164270c1f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:09.973881 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-9a70af8d-1f9e-48d6-ab20-733bec755086 None None] MFA Rules not processed for user `e010d18e48d042ccb8b9d9b0c411461f`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:09.979431 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-9a70af8d-1f9e-48d6-ab20-733bec755086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:10.119118 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 664/1314] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:10.124773 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce551c-524d-4472-8f7c-e164270c1f4d None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:10.134594 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 651/1315] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:10.135900 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9c019-3001-41e4-856d-51ab4539bc65 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:10.136239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9c019-3001-41e4-856d-51ab4539bc65 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:10.136520 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9c019-3001-41e4-856d-51ab4539bc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:10.175789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-03f9c019-3001-41e4-856d-51ab4539bc65 None None] MFA Rules not processed for user `f906fd11db004026a78eb3d69fa5b298`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:10.179875 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-03f9c019-3001-41e4-856d-51ab4539bc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:10.215867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:10.248739 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce551c-524d-4472-8f7c-e164270c1f4d None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:10.257383 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2efb27f-361a-47b8-9c0f-7189edb89665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:10.258780 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2efb27f-361a-47b8-9c0f-7189edb89665 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:10.259129 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2efb27f-361a-47b8-9c0f-7189edb89665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:10.259702 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2efb27f-361a-47b8-9c0f-7189edb89665 admin admin] PATH_INFO: `/v3/projects/cef30597097c4416b78d0c60269a2192/users/1d97af303cfa448f8a56e9f16563220a/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:10.262730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2efb27f-361a-47b8-9c0f-7189edb89665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cef30597097c4416b78d0c60269a2192, user_id=1d97af303cfa448f8a56e9f16563220a, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:10.267148 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2efb27f-361a-47b8-9c0f-7189edb89665 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:10.291427 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 665/1316] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:10 2022] PUT /identity/v3/projects/cef30597097c4416b78d0c60269a2192/users/1d97af303cfa448f8a56e9f16563220a/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:10.292629 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2efb27f-361a-47b8-9c0f-7189edb89665 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:10.316329 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:10.333257 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 652/1317] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Nov 2 20:30:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:10.334755 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9c019-3001-41e4-856d-51ab4539bc65 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:10.419644 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9c019-3001-41e4-856d-51ab4539bc65 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:10.435559 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2efb27f-361a-47b8-9c0f-7189edb89665 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:10.442800 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a6953-5ea8-47ef-a496-7cfa0d21ef9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:10.445155 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a6953-5ea8-47ef-a496-7cfa0d21ef9b service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:10.445441 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a6953-5ea8-47ef-a496-7cfa0d21ef9b service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:10.447155 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a6953-5ea8-47ef-a496-7cfa0d21ef9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:10.502707 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddc0fd-5aee-4d8f-8316-bc3636ad2443 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:10.503477 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddc0fd-5aee-4d8f-8316-bc3636ad2443 service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:10.504442 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddc0fd-5aee-4d8f-8316-bc3636ad2443 service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:10.504711 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddc0fd-5aee-4d8f-8316-bc3636ad2443 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:10.565277 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a6953-5ea8-47ef-a496-7cfa0d21ef9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:10.566982 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a6953-5ea8-47ef-a496-7cfa0d21ef9b service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:10.579280 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 666/1318] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:10.580790 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d95d5b-55c7-4b64-8b29-580ad14e829a None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:10.581085 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d95d5b-55c7-4b64-8b29-580ad14e829a None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:10.581364 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d95d5b-55c7-4b64-8b29-580ad14e829a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:10.621554 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-a4d95d5b-55c7-4b64-8b29-580ad14e829a None None] MFA Rules not processed for user `1d97af303cfa448f8a56e9f16563220a`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:10.623114 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-a4d95d5b-55c7-4b64-8b29-580ad14e829a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:10.634838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ddc0fd-5aee-4d8f-8316-bc3636ad2443 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:10.636611 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ddc0fd-5aee-4d8f-8316-bc3636ad2443 service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:10.650153 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 653/1319] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:10.721052 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddc0fd-5aee-4d8f-8316-bc3636ad2443 service cinder] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:10.732343 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddc0fd-5aee-4d8f-8316-bc3636ad2443 service cinder] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:10.742141 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2679d-feb7-41c5-8400-9dff178b5f2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:10.742770 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2679d-feb7-41c5-8400-9dff178b5f2d service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:10.743051 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2679d-feb7-41c5-8400-9dff178b5f2d service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:10.743333 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2679d-feb7-41c5-8400-9dff178b5f2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:10.770908 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 667/1320] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:10 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:10.779413 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:10.855765 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2679d-feb7-41c5-8400-9dff178b5f2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:10.857459 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2679d-feb7-41c5-8400-9dff178b5f2d service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:10.872604 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 654/1321] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 20:30:11.806031 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d95d5b-55c7-4b64-8b29-580ad14e829a None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:11.823712 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d95d5b-55c7-4b64-8b29-580ad14e829a None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:11.833231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84c3ba-a968-4cb4-b337-dda6c8b6ff78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:11.833915 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84c3ba-a968-4cb4-b337-dda6c8b6ff78 service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:11.834201 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84c3ba-a968-4cb4-b337-dda6c8b6ff78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:11.834474 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84c3ba-a968-4cb4-b337-dda6c8b6ff78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:11.852941 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84c3ba-a968-4cb4-b337-dda6c8b6ff78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:11.854510 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84c3ba-a968-4cb4-b337-dda6c8b6ff78 service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:11.893612 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 668/1322] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:11 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:12.072594 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2679d-feb7-41c5-8400-9dff178b5f2d service cinder] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:12.089628 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2679d-feb7-41c5-8400-9dff178b5f2d service cinder] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:12.101583 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d37c76-518b-480c-8213-933b152e5c84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:12.102610 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d37c76-518b-480c-8213-933b152e5c84 service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:12.103112 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d37c76-518b-480c-8213-933b152e5c84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:12.103728 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d37c76-518b-480c-8213-933b152e5c84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:12.261528 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d37c76-518b-480c-8213-933b152e5c84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:12.267126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d37c76-518b-480c-8213-933b152e5c84 service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:12.282702 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 655/1323] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:12.567355 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84c3ba-a968-4cb4-b337-dda6c8b6ff78 service cinder] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:12.725508 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:12.779933 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3af5f-ea9d-47be-a25a-e730337e2f62 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:12.780991 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3af5f-ea9d-47be-a25a-e730337e2f62 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:12.781346 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3af5f-ea9d-47be-a25a-e730337e2f62 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:12.784253 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 656/1324] 10.222.0.23 () {54 vars in 961 bytes} [Wed Nov 2 20:30:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:30:12.795081 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84c3ba-a968-4cb4-b337-dda6c8b6ff78 service cinder] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:12.809751 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64660075-8dda-4e38-b4a2-87e590392af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:12.811976 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac68c1-08d0-4b55-bcf3-bfaf6d6a0afc None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:12.812370 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac68c1-08d0-4b55-bcf3-bfaf6d6a0afc None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:12.814348 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac68c1-08d0-4b55-bcf3-bfaf6d6a0afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:12.819118 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64660075-8dda-4e38-b4a2-87e590392af5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:12.820432 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64660075-8dda-4e38-b4a2-87e590392af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:12.821258 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64660075-8dda-4e38-b4a2-87e590392af5 admin admin] PATH_INFO: `/v3/users/02dd1dbe72c144af99ea60c39b392239` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:12.832091 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64660075-8dda-4e38-b4a2-87e590392af5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02dd1dbe72c144af99ea60c39b392239)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:12.840145 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64660075-8dda-4e38-b4a2-87e590392af5 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:12.885240 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-c4ac68c1-08d0-4b55-bcf3-bfaf6d6a0afc None None] MFA Rules not processed for user `f906fd11db004026a78eb3d69fa5b298`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:12.892236 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-c4ac68c1-08d0-4b55-bcf3-bfaf6d6a0afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:12.933252 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 657/1325] 10.222.0.23 () {58 vars in 1058 bytes} [Wed Nov 2 20:30:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:30:12.939522 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d2b76-1c6f-416c-a1c3-86ac8d58aed3 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:12.939814 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d2b76-1c6f-416c-a1c3-86ac8d58aed3 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:12.940094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d2b76-1c6f-416c-a1c3-86ac8d58aed3 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:12.945716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 658/1326] 10.222.0.23 () {54 vars in 912 bytes} [Wed Nov 2 20:30:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:30:12.948617 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb78b38-94ff-41aa-9cf2-fc6dac7223c7 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:12.949167 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb78b38-94ff-41aa-9cf2-fc6dac7223c7 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:12.949517 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb78b38-94ff-41aa-9cf2-fc6dac7223c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:12.953303 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-64660075-8dda-4e38-b4a2-87e590392af5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02dd1dbe72c144af99ea60c39b392239'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:12.954162 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-64660075-8dda-4e38-b4a2-87e590392af5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02dd1dbe72c144af99ea60c39b392239'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:12.987893 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-64660075-8dda-4e38-b4a2-87e590392af5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02dd1dbe72c144af99ea60c39b392239'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:12.988644 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-64660075-8dda-4e38-b4a2-87e590392af5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02dd1dbe72c144af99ea60c39b392239'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:13.006944 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-64660075-8dda-4e38-b4a2-87e590392af5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02dd1dbe72c144af99ea60c39b392239'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:13.019204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-ddb78b38-94ff-41aa-9cf2-fc6dac7223c7 None None] MFA Rules not processed for user `f906fd11db004026a78eb3d69fa5b298`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:13.020590 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-ddb78b38-94ff-41aa-9cf2-fc6dac7223c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:13.037191 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 669/1327] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:30:12 2022] DELETE /identity/v3/users/02dd1dbe72c144af99ea60c39b392239 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:13.040208 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355a404-6061-48ad-baeb-41a0bbf90382 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:13.040598 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355a404-6061-48ad-baeb-41a0bbf90382 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:13.040802 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355a404-6061-48ad-baeb-41a0bbf90382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:13.052741 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 659/1328] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Nov 2 20:30:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:13.063351 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb78b38-94ff-41aa-9cf2-fc6dac7223c7 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:13.064814 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-ddb78b38-94ff-41aa-9cf2-fc6dac7223c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:13.081958 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb78b38-94ff-41aa-9cf2-fc6dac7223c7 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:13.094716 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-8355a404-6061-48ad-baeb-41a0bbf90382 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:13.095859 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-8355a404-6061-48ad-baeb-41a0bbf90382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:13.233093 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03292ed-9c5c-4983-b2f8-7c7045810651 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:13.233990 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03292ed-9c5c-4983-b2f8-7c7045810651 service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:13.236833 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03292ed-9c5c-4983-b2f8-7c7045810651 service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:13.237192 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03292ed-9c5c-4983-b2f8-7c7045810651 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:13.324708 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 670/1329] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:13.400381 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:13.417928 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355a404-6061-48ad-baeb-41a0bbf90382 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:13.420111 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-8355a404-6061-48ad-baeb-41a0bbf90382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:13.515053 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03292ed-9c5c-4983-b2f8-7c7045810651 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:13.516743 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03292ed-9c5c-4983-b2f8-7c7045810651 service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:13.558770 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 660/1330] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:13.595384 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355a404-6061-48ad-baeb-41a0bbf90382 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:13.602217 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c735c95-47b0-4294-99cc-6ec6f00131d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:13.603565 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c735c95-47b0-4294-99cc-6ec6f00131d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:13.603955 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c735c95-47b0-4294-99cc-6ec6f00131d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:13.604508 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c735c95-47b0-4294-99cc-6ec6f00131d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:13.619422 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c735c95-47b0-4294-99cc-6ec6f00131d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:13.621301 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c735c95-47b0-4294-99cc-6ec6f00131d5 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:13.645469 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:13.647461 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 671/1331] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:15.108880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03292ed-9c5c-4983-b2f8-7c7045810651 service cinder] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:15.119492 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03292ed-9c5c-4983-b2f8-7c7045810651 service cinder] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:15.134566 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819cf4c-a9c6-4191-b423-1eb6d8495cff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:15.135609 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819cf4c-a9c6-4191-b423-1eb6d8495cff service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:15.136101 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819cf4c-a9c6-4191-b423-1eb6d8495cff service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:15.136629 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819cf4c-a9c6-4191-b423-1eb6d8495cff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:15.138972 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-d819cf4c-a9c6-4191-b423-1eb6d8495cff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:15.301283 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819cf4c-a9c6-4191-b423-1eb6d8495cff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:15.303409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819cf4c-a9c6-4191-b423-1eb6d8495cff service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:15.319337 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 661/1332] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:15.343696 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c735c95-47b0-4294-99cc-6ec6f00131d5 service neutron] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:15.344171 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-1c735c95-47b0-4294-99cc-6ec6f00131d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:15.406395 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c735c95-47b0-4294-99cc-6ec6f00131d5 service neutron] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:15.428118 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e725e0-7b16-4ca2-aca4-f6f3aee180b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:15.429601 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e725e0-7b16-4ca2-aca4-f6f3aee180b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:15.430032 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e725e0-7b16-4ca2-aca4-f6f3aee180b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:15.430500 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e725e0-7b16-4ca2-aca4-f6f3aee180b5 admin admin] PATH_INFO: `/v3/users/3dc51a71d6dc4f6aa33f7436efaeb5b1` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:15.439321 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e725e0-7b16-4ca2-aca4-f6f3aee180b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dc51a71d6dc4f6aa33f7436efaeb5b1)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:15.442359 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e725e0-7b16-4ca2-aca4-f6f3aee180b5 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:15.588456 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-58e725e0-7b16-4ca2-aca4-f6f3aee180b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dc51a71d6dc4f6aa33f7436efaeb5b1'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:15.589771 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-58e725e0-7b16-4ca2-aca4-f6f3aee180b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dc51a71d6dc4f6aa33f7436efaeb5b1'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:15.606466 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-58e725e0-7b16-4ca2-aca4-f6f3aee180b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dc51a71d6dc4f6aa33f7436efaeb5b1'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:15.608791 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-58e725e0-7b16-4ca2-aca4-f6f3aee180b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dc51a71d6dc4f6aa33f7436efaeb5b1'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:15.620617 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-58e725e0-7b16-4ca2-aca4-f6f3aee180b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dc51a71d6dc4f6aa33f7436efaeb5b1'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:15.652538 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 672/1333] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:30:15 2022] DELETE /identity/v3/users/3dc51a71d6dc4f6aa33f7436efaeb5b1 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:15.666161 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a31fb8-2760-463d-95d6-ba23dcccb534 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:15.668104 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a31fb8-2760-463d-95d6-ba23dcccb534 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:15.668691 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a31fb8-2760-463d-95d6-ba23dcccb534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:15.737903 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-13a31fb8-2760-463d-95d6-ba23dcccb534 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:15.739380 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-13a31fb8-2760-463d-95d6-ba23dcccb534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:15.752800 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e725e0-7b16-4ca2-aca4-f6f3aee180b5 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:15.754542 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-58e725e0-7b16-4ca2-aca4-f6f3aee180b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:15.933988 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 662/1334] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:15.939572 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e725e0-7b16-4ca2-aca4-f6f3aee180b5 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:15.946243 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1708283-6923-4fa7-bbfa-16d07164bbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:15.946931 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1708283-6923-4fa7-bbfa-16d07164bbc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:15.947344 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1708283-6923-4fa7-bbfa-16d07164bbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:15.947684 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1708283-6923-4fa7-bbfa-16d07164bbc4 admin admin] PATH_INFO: `/v3/projects/f6252d1e8b37462d8c62528523ace40f` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:15.949086 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1708283-6923-4fa7-bbfa-16d07164bbc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6252d1e8b37462d8c62528523ace40f)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:15.950747 dv-cinder-862365-5-smb devstack@keystone.service[81402]: WARNING py.warnings [None req-c1708283-6923-4fa7-bbfa-16d07164bbc4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 20:30:15.950747 dv-cinder-862365-5-smb devstack@keystone.service[81402]: warnings.warn(msg) Nov 02 20:30:15.950747 dv-cinder-862365-5-smb devstack@keystone.service[81402]: Nov 02 20:30:15.952589 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1708283-6923-4fa7-bbfa-16d07164bbc4 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:16.036770 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a31fb8-2760-463d-95d6-ba23dcccb534 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:16.039202 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-13a31fb8-2760-463d-95d6-ba23dcccb534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:16.054409 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-c1708283-6923-4fa7-bbfa-16d07164bbc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6252d1e8b37462d8c62528523ace40f', 'request_id': 'req-c1708283-6923-4fa7-bbfa-16d07164bbc4'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:16.071284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-c1708283-6923-4fa7-bbfa-16d07164bbc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6252d1e8b37462d8c62528523ace40f', 'request_id': 'req-c1708283-6923-4fa7-bbfa-16d07164bbc4'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:16.088207 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-c1708283-6923-4fa7-bbfa-16d07164bbc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6252d1e8b37462d8c62528523ace40f', 'request_id': 'req-c1708283-6923-4fa7-bbfa-16d07164bbc4'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:16.100961 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:16.109256 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-c1708283-6923-4fa7-bbfa-16d07164bbc4 admin admin] The token cache is being invalidate because project f6252d1e8b37462d8c62528523ace40f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:30:16.110705 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-c1708283-6923-4fa7-bbfa-16d07164bbc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:16.116824 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-c1708283-6923-4fa7-bbfa-16d07164bbc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:16.121854 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 673/1335] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:30:15 2022] DELETE /identity/v3/projects/f6252d1e8b37462d8c62528523ace40f => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:16.125866 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1708283-6923-4fa7-bbfa-16d07164bbc4 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:16.128597 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-c1708283-6923-4fa7-bbfa-16d07164bbc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:16.155721 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a31fb8-2760-463d-95d6-ba23dcccb534 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:16.177312 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:16.243739 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ceec1-73e9-44ec-8282-f83c4e938703 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:16.244735 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ceec1-73e9-44ec-8282-f83c4e938703 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:16.245192 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ceec1-73e9-44ec-8282-f83c4e938703 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:16.245670 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ceec1-73e9-44ec-8282-f83c4e938703 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:16.248003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-c34ceec1-73e9-44ec-8282-f83c4e938703 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:16.309672 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1708283-6923-4fa7-bbfa-16d07164bbc4 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:16.323662 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcab87a-0c29-4a75-95f6-d35f87e21927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:16.326761 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcab87a-0c29-4a75-95f6-d35f87e21927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:16.327235 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcab87a-0c29-4a75-95f6-d35f87e21927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:16.327527 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcab87a-0c29-4a75-95f6-d35f87e21927 admin admin] PATH_INFO: `/v3/users/1d97af303cfa448f8a56e9f16563220a` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:16.330731 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcab87a-0c29-4a75-95f6-d35f87e21927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d97af303cfa448f8a56e9f16563220a)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:16.335268 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcab87a-0c29-4a75-95f6-d35f87e21927 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:16.355626 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ceec1-73e9-44ec-8282-f83c4e938703 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:16.358872 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ceec1-73e9-44ec-8282-f83c4e938703 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:16.379809 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 663/1336] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 20:30:16.488301 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4fcab87a-0c29-4a75-95f6-d35f87e21927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d97af303cfa448f8a56e9f16563220a'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:16.490736 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4fcab87a-0c29-4a75-95f6-d35f87e21927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d97af303cfa448f8a56e9f16563220a'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:16.565262 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4fcab87a-0c29-4a75-95f6-d35f87e21927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d97af303cfa448f8a56e9f16563220a'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:16.582866 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4fcab87a-0c29-4a75-95f6-d35f87e21927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d97af303cfa448f8a56e9f16563220a'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:16.601741 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4fcab87a-0c29-4a75-95f6-d35f87e21927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d97af303cfa448f8a56e9f16563220a'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:16.630347 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 674/1337] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:30:16 2022] DELETE /identity/v3/users/1d97af303cfa448f8a56e9f16563220a => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:17.484942 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ceec1-73e9-44ec-8282-f83c4e938703 service neutron] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:17.495881 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ceec1-73e9-44ec-8282-f83c4e938703 service neutron] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:17.766034 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202278f-0461-4f3b-80dd-6d9674ca832d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:17.768331 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202278f-0461-4f3b-80dd-6d9674ca832d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:17.769781 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202278f-0461-4f3b-80dd-6d9674ca832d admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:17.772982 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202278f-0461-4f3b-80dd-6d9674ca832d admin admin] PATH_INFO: `/v3/projects/cef30597097c4416b78d0c60269a2192` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:17.775286 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202278f-0461-4f3b-80dd-6d9674ca832d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cef30597097c4416b78d0c60269a2192)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:17.779491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202278f-0461-4f3b-80dd-6d9674ca832d admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:17.952049 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-3202278f-0461-4f3b-80dd-6d9674ca832d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cef30597097c4416b78d0c60269a2192', 'request_id': 'req-3202278f-0461-4f3b-80dd-6d9674ca832d'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:17.966338 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-3202278f-0461-4f3b-80dd-6d9674ca832d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cef30597097c4416b78d0c60269a2192', 'request_id': 'req-3202278f-0461-4f3b-80dd-6d9674ca832d'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:17.985349 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-3202278f-0461-4f3b-80dd-6d9674ca832d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cef30597097c4416b78d0c60269a2192', 'request_id': 'req-3202278f-0461-4f3b-80dd-6d9674ca832d'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:18.003633 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:18.013608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-3202278f-0461-4f3b-80dd-6d9674ca832d admin admin] The token cache is being invalidate because project cef30597097c4416b78d0c60269a2192 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:30:18.015370 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-3202278f-0461-4f3b-80dd-6d9674ca832d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:18.017271 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-3202278f-0461-4f3b-80dd-6d9674ca832d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:18.025600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 664/1338] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:30:17 2022] DELETE /identity/v3/projects/cef30597097c4416b78d0c60269a2192 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:18.027287 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e94f7-6d7f-43f2-8fd8-8e59f4c7ad27 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:18.027771 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e94f7-6d7f-43f2-8fd8-8e59f4c7ad27 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:18.027873 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e94f7-6d7f-43f2-8fd8-8e59f4c7ad27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:18.062361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-a59e94f7-6d7f-43f2-8fd8-8e59f4c7ad27 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:18.064595 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-a59e94f7-6d7f-43f2-8fd8-8e59f4c7ad27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:18.178858 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 675/1339] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:18.187843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13da433-6cc7-4833-9837-153a1a9a46ac None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:18.188932 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13da433-6cc7-4833-9837-153a1a9a46ac None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:18.189316 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13da433-6cc7-4833-9837-153a1a9a46ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:18.224442 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-a13da433-6cc7-4833-9837-153a1a9a46ac None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:18.225915 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-a13da433-6cc7-4833-9837-153a1a9a46ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:18.241584 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 665/1340] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:18.242613 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e94f7-6d7f-43f2-8fd8-8e59f4c7ad27 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:18.256887 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e94f7-6d7f-43f2-8fd8-8e59f4c7ad27 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:18.281511 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e0221-eacb-4721-a81e-6c720ff6270a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:18.282971 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e0221-eacb-4721-a81e-6c720ff6270a admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:18.283474 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e0221-eacb-4721-a81e-6c720ff6270a admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:18.284262 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e0221-eacb-4721-a81e-6c720ff6270a admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:18.285762 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e0221-eacb-4721-a81e-6c720ff6270a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:30:18.286486 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e0221-eacb-4721-a81e-6c720ff6270a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:18.292169 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e0221-eacb-4721-a81e-6c720ff6270a admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:18.333423 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 676/1341] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:30:18.336100 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13da433-6cc7-4833-9837-153a1a9a46ac None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:18.354591 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13da433-6cc7-4833-9837-153a1a9a46ac None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:18.369671 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add97781-b332-435e-81a4-7e5c0d5f58c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:18.370316 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add97781-b332-435e-81a4-7e5c0d5f58c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:18.370605 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add97781-b332-435e-81a4-7e5c0d5f58c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:18.376233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add97781-b332-435e-81a4-7e5c0d5f58c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:18.377250 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add97781-b332-435e-81a4-7e5c0d5f58c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:18.380109 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add97781-b332-435e-81a4-7e5c0d5f58c2 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:18.449264 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 666/1342] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:30:18 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:18.449633 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e0221-eacb-4721-a81e-6c720ff6270a admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:18.466369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e0221-eacb-4721-a81e-6c720ff6270a admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:18.475797 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:18.629801 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8f9cb-d0bb-40b7-b78e-e4f117dd9e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:18.631264 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8f9cb-d0bb-40b7-b78e-e4f117dd9e42 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:18.631566 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8f9cb-d0bb-40b7-b78e-e4f117dd9e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:18.631853 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8f9cb-d0bb-40b7-b78e-e4f117dd9e42 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:18.632517 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8f9cb-d0bb-40b7-b78e-e4f117dd9e42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:18.648940 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8f9cb-d0bb-40b7-b78e-e4f117dd9e42 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:18.704459 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 677/1343] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:30:18 2022] POST /identity/v3/users => generated 291 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:18.709821 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add97781-b332-435e-81a4-7e5c0d5f58c2 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:18.731243 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add97781-b332-435e-81a4-7e5c0d5f58c2 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:18.755835 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e3257-5f02-4bfa-8cff-4beb4e9b3f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:18.759571 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e3257-5f02-4bfa-8cff-4beb4e9b3f66 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:18.760273 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e3257-5f02-4bfa-8cff-4beb4e9b3f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:18.760922 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e3257-5f02-4bfa-8cff-4beb4e9b3f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:18.769383 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e3257-5f02-4bfa-8cff-4beb4e9b3f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:18.771947 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e3257-5f02-4bfa-8cff-4beb4e9b3f66 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:18.795860 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 667/1344] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:18.801219 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8f9cb-d0bb-40b7-b78e-e4f117dd9e42 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:18.814558 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8f9cb-d0bb-40b7-b78e-e4f117dd9e42 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:18.835917 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c6e2d-03fd-4b13-a817-1a71a32388ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:18.840374 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c6e2d-03fd-4b13-a817-1a71a32388ed admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:18.848274 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c6e2d-03fd-4b13-a817-1a71a32388ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:18.848875 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c6e2d-03fd-4b13-a817-1a71a32388ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:18.849750 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c6e2d-03fd-4b13-a817-1a71a32388ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:18.851596 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c6e2d-03fd-4b13-a817-1a71a32388ed admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:18.886592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 678/1345] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:18.894868 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e3257-5f02-4bfa-8cff-4beb4e9b3f66 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:18.912710 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e3257-5f02-4bfa-8cff-4beb4e9b3f66 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:18.921458 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c6e2d-03fd-4b13-a817-1a71a32388ed admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:18.923826 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-a51c6e2d-03fd-4b13-a817-1a71a32388ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:18.945767 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b966be4-33fc-41ee-829b-66aecad5ed69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:18.951918 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b966be4-33fc-41ee-829b-66aecad5ed69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:18.952310 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b966be4-33fc-41ee-829b-66aecad5ed69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:18.953096 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b966be4-33fc-41ee-829b-66aecad5ed69 admin admin] PATH_INFO: `/v3/projects/7f4427351c82438c9c7b399c83173f1b/users/6aec3fd14e95418abd3ce9083c032e8f/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:18.987244 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c6e2d-03fd-4b13-a817-1a71a32388ed admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:18.996447 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b966be4-33fc-41ee-829b-66aecad5ed69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4427351c82438c9c7b399c83173f1b, user_id=6aec3fd14e95418abd3ce9083c032e8f, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:19.004912 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b966be4-33fc-41ee-829b-66aecad5ed69 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:19.025139 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39303f15-d40c-4e65-b96b-cebdbaa01da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:19.025795 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39303f15-d40c-4e65-b96b-cebdbaa01da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:19.026076 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39303f15-d40c-4e65-b96b-cebdbaa01da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:19.026355 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39303f15-d40c-4e65-b96b-cebdbaa01da4 admin admin] PATH_INFO: `/v3/projects/183faacdc7124d9887adfdf95e1aaae8` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:19.032846 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 668/1346] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:18 2022] PUT /identity/v3/projects/7f4427351c82438c9c7b399c83173f1b/users/6aec3fd14e95418abd3ce9083c032e8f/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:19.033080 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39303f15-d40c-4e65-b96b-cebdbaa01da4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=183faacdc7124d9887adfdf95e1aaae8)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:19.035031 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39303f15-d40c-4e65-b96b-cebdbaa01da4 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:19.060504 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e397a-c36c-4b83-83f6-8b313296d3ae None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:19.060979 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e397a-c36c-4b83-83f6-8b313296d3ae None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:19.061362 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e397a-c36c-4b83-83f6-8b313296d3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:19.163480 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-e13e397a-c36c-4b83-83f6-8b313296d3ae None None] MFA Rules not processed for user `6aec3fd14e95418abd3ce9083c032e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:19.164487 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-e13e397a-c36c-4b83-83f6-8b313296d3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:19.203246 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-39303f15-d40c-4e65-b96b-cebdbaa01da4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '183faacdc7124d9887adfdf95e1aaae8', 'request_id': 'req-39303f15-d40c-4e65-b96b-cebdbaa01da4'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:19.215226 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-39303f15-d40c-4e65-b96b-cebdbaa01da4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '183faacdc7124d9887adfdf95e1aaae8', 'request_id': 'req-39303f15-d40c-4e65-b96b-cebdbaa01da4'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:19.229509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-39303f15-d40c-4e65-b96b-cebdbaa01da4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '183faacdc7124d9887adfdf95e1aaae8', 'request_id': 'req-39303f15-d40c-4e65-b96b-cebdbaa01da4'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:19.268664 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-39303f15-d40c-4e65-b96b-cebdbaa01da4 admin admin] The token cache is being invalidate because project 183faacdc7124d9887adfdf95e1aaae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:30:19.269197 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-39303f15-d40c-4e65-b96b-cebdbaa01da4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:19.270531 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-39303f15-d40c-4e65-b96b-cebdbaa01da4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:19.281816 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 679/1347] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:30:18 2022] DELETE /identity/v3/projects/183faacdc7124d9887adfdf95e1aaae8 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:19.283527 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66aaa66-dce2-4a20-bdfb-b40aab351e0a None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:19.283906 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66aaa66-dce2-4a20-bdfb-b40aab351e0a None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:19.284260 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66aaa66-dce2-4a20-bdfb-b40aab351e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:19.345690 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-f66aaa66-dce2-4a20-bdfb-b40aab351e0a None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:19.353966 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-f66aaa66-dce2-4a20-bdfb-b40aab351e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:19.442247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 669/1348] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:30:19.445716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e397a-c36c-4b83-83f6-8b313296d3ae None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:19.450912 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-e13e397a-c36c-4b83-83f6-8b313296d3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:19.570262 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 680/1349] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:19.578503 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625d6ef-c731-4a13-9f8f-295790c8ca9d None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:19.579796 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625d6ef-c731-4a13-9f8f-295790c8ca9d None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:19.580085 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625d6ef-c731-4a13-9f8f-295790c8ca9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:19.630360 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-2625d6ef-c731-4a13-9f8f-295790c8ca9d None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:19.633430 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-2625d6ef-c731-4a13-9f8f-295790c8ca9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:19.637645 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e397a-c36c-4b83-83f6-8b313296d3ae None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:19.647349 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26a76a-6da9-4e51-84ed-a0e3a5566f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:19.647989 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26a76a-6da9-4e51-84ed-a0e3a5566f84 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:19.648368 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26a76a-6da9-4e51-84ed-a0e3a5566f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:19.648716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26a76a-6da9-4e51-84ed-a0e3a5566f84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:19.649572 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26a76a-6da9-4e51-84ed-a0e3a5566f84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:19.655031 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 681/1350] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:19.661095 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625d6ef-c731-4a13-9f8f-295790c8ca9d None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:19.661930 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26a76a-6da9-4e51-84ed-a0e3a5566f84 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:19.672720 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:19.683590 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625d6ef-c731-4a13-9f8f-295790c8ca9d None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:19.696399 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28262e40-da02-4438-abe6-945fa231c265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:19.698380 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28262e40-da02-4438-abe6-945fa231c265 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:19.698680 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28262e40-da02-4438-abe6-945fa231c265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:19.699955 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28262e40-da02-4438-abe6-945fa231c265 admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:19.701745 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28262e40-da02-4438-abe6-945fa231c265 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:30:19.706304 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28262e40-da02-4438-abe6-945fa231c265 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:19.710725 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28262e40-da02-4438-abe6-945fa231c265 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:19.730114 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 670/1351] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:30:19 2022] POST /identity/v3/projects => generated 379 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:19.733919 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26a76a-6da9-4e51-84ed-a0e3a5566f84 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:19.746204 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 682/1352] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:30:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:30:19.751189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28262e40-da02-4438-abe6-945fa231c265 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:19.752884 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:19.785029 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28262e40-da02-4438-abe6-945fa231c265 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:19.842746 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26a76a-6da9-4e51-84ed-a0e3a5566f84 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:19.862307 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a29aec-053d-49c2-9cb8-09a34ba0b725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:19.862952 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a29aec-053d-49c2-9cb8-09a34ba0b725 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:19.863352 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a29aec-053d-49c2-9cb8-09a34ba0b725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:19.863553 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a29aec-053d-49c2-9cb8-09a34ba0b725 admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:19.864140 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a29aec-053d-49c2-9cb8-09a34ba0b725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:19.869046 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a29aec-053d-49c2-9cb8-09a34ba0b725 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:19.916350 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 671/1353] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:30:19 2022] POST /identity/v3/users => generated 296 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:30:19.923496 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9d33b-e233-4243-a2ae-a774a79d9652 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:19.925279 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9d33b-e233-4243-a2ae-a774a79d9652 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:19.925805 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9d33b-e233-4243-a2ae-a774a79d9652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:19.950177 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87cbf2-017e-4d97-bdc4-607c3f1f3ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:19.951485 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87cbf2-017e-4d97-bdc4-607c3f1f3ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:19.951999 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87cbf2-017e-4d97-bdc4-607c3f1f3ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:19.952479 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87cbf2-017e-4d97-bdc4-607c3f1f3ef1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:19.953355 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87cbf2-017e-4d97-bdc4-607c3f1f3ef1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:19.956258 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87cbf2-017e-4d97-bdc4-607c3f1f3ef1 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:20.020319 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-49d9d33b-e233-4243-a2ae-a774a79d9652 None None] MFA Rules not processed for user `469b5cd3abf74c7984dd02faa1abfcd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:20.021593 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-49d9d33b-e233-4243-a2ae-a774a79d9652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:20.056999 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 683/1354] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:30:19 2022] POST /identity/v3/projects => generated 355 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:20.056999 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87cbf2-017e-4d97-bdc4-607c3f1f3ef1 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:20.256035 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 672/1355] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:20.256937 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9d33b-e233-4243-a2ae-a774a79d9652 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:20.268581 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87cbf2-017e-4d97-bdc4-607c3f1f3ef1 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:20.292059 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9d33b-e233-4243-a2ae-a774a79d9652 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:20.295269 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4210e-13ff-46af-afa2-40d9b5a94ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:20.295908 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4210e-13ff-46af-afa2-40d9b5a94ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:20.296183 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4210e-13ff-46af-afa2-40d9b5a94ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:20.296461 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4210e-13ff-46af-afa2-40d9b5a94ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:20.297216 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4210e-13ff-46af-afa2-40d9b5a94ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:20.298933 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4210e-13ff-46af-afa2-40d9b5a94ff0 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:20.305753 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905ef0b-447d-4ada-8a33-39ef2fd034e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:20.305753 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905ef0b-447d-4ada-8a33-39ef2fd034e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:20.306089 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905ef0b-447d-4ada-8a33-39ef2fd034e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:20.306297 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905ef0b-447d-4ada-8a33-39ef2fd034e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:20.306949 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905ef0b-447d-4ada-8a33-39ef2fd034e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:20.308973 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905ef0b-447d-4ada-8a33-39ef2fd034e3 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:20.327096 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 684/1356] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:20.327986 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4210e-13ff-46af-afa2-40d9b5a94ff0 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:20.331493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-80e4210e-13ff-46af-afa2-40d9b5a94ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:20.354830 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 673/1357] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:30:20 2022] POST /identity/v3/users => generated 278 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:20.355484 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905ef0b-447d-4ada-8a33-39ef2fd034e3 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:20.378170 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905ef0b-447d-4ada-8a33-39ef2fd034e3 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:20.391309 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be84a61-bb64-4567-9966-d70bd0496b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:20.391998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be84a61-bb64-4567-9966-d70bd0496b8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:20.392282 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be84a61-bb64-4567-9966-d70bd0496b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:20.392577 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be84a61-bb64-4567-9966-d70bd0496b8f admin admin] PATH_INFO: `/v3/projects/4e0b0a521fb54f459f8d0577fa4be7b3/users/01beca11cf5849849fd6126a264f7d4d/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:20.429008 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be84a61-bb64-4567-9966-d70bd0496b8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e0b0a521fb54f459f8d0577fa4be7b3, user_id=01beca11cf5849849fd6126a264f7d4d, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:20.431721 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be84a61-bb64-4567-9966-d70bd0496b8f admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:20.460855 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 674/1358] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:20 2022] PUT /identity/v3/projects/4e0b0a521fb54f459f8d0577fa4be7b3/users/01beca11cf5849849fd6126a264f7d4d/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:20.461923 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be84a61-bb64-4567-9966-d70bd0496b8f admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:20.519120 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4210e-13ff-46af-afa2-40d9b5a94ff0 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:20.531131 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:20.532224 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:20.573828 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be84a61-bb64-4567-9966-d70bd0496b8f admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:20.589048 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ef513-188b-4f4a-b651-f6c87e1c77c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:20.590758 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ef513-188b-4f4a-b651-f6c87e1c77c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:20.591886 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ef513-188b-4f4a-b651-f6c87e1c77c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:20.592511 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ef513-188b-4f4a-b651-f6c87e1c77c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:20.595025 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888ef513-188b-4f4a-b651-f6c87e1c77c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:20.599369 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888ef513-188b-4f4a-b651-f6c87e1c77c1 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:20.619442 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 675/1359] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:20.620956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ef513-188b-4f4a-b651-f6c87e1c77c1 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:20.646958 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ef513-188b-4f4a-b651-f6c87e1c77c1 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:20.672298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978ab5a-883c-4eb2-a659-83162e3b0519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:20.673645 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978ab5a-883c-4eb2-a659-83162e3b0519 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:20.673992 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978ab5a-883c-4eb2-a659-83162e3b0519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:20.674186 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978ab5a-883c-4eb2-a659-83162e3b0519 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:20.677911 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978ab5a-883c-4eb2-a659-83162e3b0519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:20.683601 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978ab5a-883c-4eb2-a659-83162e3b0519 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:20.710832 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 676/1360] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:20.718289 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978ab5a-883c-4eb2-a659-83162e3b0519 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:20.746617 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978ab5a-883c-4eb2-a659-83162e3b0519 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:20.774054 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcc78d-08e3-4306-9712-41a29c4be9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:20.777148 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcc78d-08e3-4306-9712-41a29c4be9cb admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:20.778216 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcc78d-08e3-4306-9712-41a29c4be9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:20.778679 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcc78d-08e3-4306-9712-41a29c4be9cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:20.780816 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bcc78d-08e3-4306-9712-41a29c4be9cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:20.786600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bcc78d-08e3-4306-9712-41a29c4be9cb admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:20.800853 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6ab3f-39f6-4be0-9256-c5fa90a3f12e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:20.805318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6ab3f-39f6-4be0-9256-c5fa90a3f12e service nova] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:20.806389 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6ab3f-39f6-4be0-9256-c5fa90a3f12e service nova] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:20.824684 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6ab3f-39f6-4be0-9256-c5fa90a3f12e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:20.848881 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 677/1361] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:20.860716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcc78d-08e3-4306-9712-41a29c4be9cb admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:20.893973 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcc78d-08e3-4306-9712-41a29c4be9cb admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:20.908411 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee0b7c-dc3e-4799-9306-c0a53f6cd3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:20.909144 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee0b7c-dc3e-4799-9306-c0a53f6cd3b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:20.909419 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee0b7c-dc3e-4799-9306-c0a53f6cd3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:20.909700 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee0b7c-dc3e-4799-9306-c0a53f6cd3b0 admin admin] PATH_INFO: `/v3/projects/4e0b0a521fb54f459f8d0577fa4be7b3/users/01beca11cf5849849fd6126a264f7d4d/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:20.914044 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee0b7c-dc3e-4799-9306-c0a53f6cd3b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e0b0a521fb54f459f8d0577fa4be7b3, user_id=01beca11cf5849849fd6126a264f7d4d, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:20.923314 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee0b7c-dc3e-4799-9306-c0a53f6cd3b0 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:20.980411 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 678/1362] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:20 2022] PUT /identity/v3/projects/4e0b0a521fb54f459f8d0577fa4be7b3/users/01beca11cf5849849fd6126a264f7d4d/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:20.981294 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee0b7c-dc3e-4799-9306-c0a53f6cd3b0 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:21.030213 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6ab3f-39f6-4be0-9256-c5fa90a3f12e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:21.032309 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6ab3f-39f6-4be0-9256-c5fa90a3f12e service nova] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:21.051936 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 685/1363] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:20 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 724 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:21.053363 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96541443-2a38-40d6-a2f9-bc04cf8db3cf None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:21.053558 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96541443-2a38-40d6-a2f9-bc04cf8db3cf None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:21.053991 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96541443-2a38-40d6-a2f9-bc04cf8db3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:21.177258 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-96541443-2a38-40d6-a2f9-bc04cf8db3cf None None] MFA Rules not processed for user `01beca11cf5849849fd6126a264f7d4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:21.178516 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-96541443-2a38-40d6-a2f9-bc04cf8db3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:21.217688 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee0b7c-dc3e-4799-9306-c0a53f6cd3b0 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:21.228475 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101eece-9ee3-4565-babc-e39a26e44b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:21.229581 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101eece-9ee3-4565-babc-e39a26e44b54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:21.230093 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101eece-9ee3-4565-babc-e39a26e44b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:21.230585 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101eece-9ee3-4565-babc-e39a26e44b54 admin admin] PATH_INFO: `/v3/projects/9723cf0574a2470586229fc76603cdb2/users/5662025c0d154c17843c58195cfb5422/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:21.273332 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101eece-9ee3-4565-babc-e39a26e44b54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9723cf0574a2470586229fc76603cdb2, user_id=5662025c0d154c17843c58195cfb5422, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:21.283078 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101eece-9ee3-4565-babc-e39a26e44b54 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:21.320273 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 679/1364] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:20 2022] PUT /identity/v3/projects/9723cf0574a2470586229fc76603cdb2/users/5662025c0d154c17843c58195cfb5422/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:21.334235 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8fcc5-1dc0-461d-bb49-49092f85ce30 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:21.334529 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8fcc5-1dc0-461d-bb49-49092f85ce30 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:21.334811 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8fcc5-1dc0-461d-bb49-49092f85ce30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:21.365760 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 686/1365] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:21 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:21.387838 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96541443-2a38-40d6-a2f9-bc04cf8db3cf None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:21.389974 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-96541443-2a38-40d6-a2f9-bc04cf8db3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:21.429383 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-9ef8fcc5-1dc0-461d-bb49-49092f85ce30 None None] MFA Rules not processed for user `5662025c0d154c17843c58195cfb5422`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:21.435393 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-9ef8fcc5-1dc0-461d-bb49-49092f85ce30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:21.505283 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:21.567168 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96541443-2a38-40d6-a2f9-bc04cf8db3cf None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:21.690555 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 680/1366] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:30:21.695665 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8fcc5-1dc0-461d-bb49-49092f85ce30 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:21.705886 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8ff24-0738-45bc-8b2f-b6b272d48e84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:21.706724 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8ff24-0738-45bc-8b2f-b6b272d48e84 service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:21.710426 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8ff24-0738-45bc-8b2f-b6b272d48e84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:21.712373 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8ff24-0738-45bc-8b2f-b6b272d48e84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:21.747238 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:21.882162 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8fcc5-1dc0-461d-bb49-49092f85ce30 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:21.904871 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8ff24-0738-45bc-8b2f-b6b272d48e84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:21.907776 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73396f79-3345-406d-8aa1-fbe5cb16bfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:21.908989 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73396f79-3345-406d-8aa1-fbe5cb16bfcf admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:21.909262 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8ff24-0738-45bc-8b2f-b6b272d48e84 service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:21.911976 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73396f79-3345-406d-8aa1-fbe5cb16bfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:21.913119 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73396f79-3345-406d-8aa1-fbe5cb16bfcf admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:21.916142 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73396f79-3345-406d-8aa1-fbe5cb16bfcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:21.922967 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73396f79-3345-406d-8aa1-fbe5cb16bfcf admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:21.943458 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 687/1367] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:21 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 20:30:22.074016 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 681/1368] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:30:21 2022] POST /identity/v3/projects => generated 357 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:22.078237 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8ff24-0738-45bc-8b2f-b6b272d48e84 service cinder] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:22.112168 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8ff24-0738-45bc-8b2f-b6b272d48e84 service cinder] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:22.261488 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db39e31-4801-4680-be53-a3c5b951c703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:22.263497 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db39e31-4801-4680-be53-a3c5b951c703 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:22.264019 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db39e31-4801-4680-be53-a3c5b951c703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:22.264532 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db39e31-4801-4680-be53-a3c5b951c703 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:22.265672 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db39e31-4801-4680-be53-a3c5b951c703 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:22.268903 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db39e31-4801-4680-be53-a3c5b951c703 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:22.318743 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 688/1369] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:30:22 2022] POST /identity/v3/users => generated 285 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:22.326921 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73396f79-3345-406d-8aa1-fbe5cb16bfcf admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:22.375593 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73396f79-3345-406d-8aa1-fbe5cb16bfcf admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:22.379961 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db39e31-4801-4680-be53-a3c5b951c703 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:22.406147 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af2691-1cd8-4457-a4a3-2daa32b78f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:22.415406 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af2691-1cd8-4457-a4a3-2daa32b78f46 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:22.415769 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af2691-1cd8-4457-a4a3-2daa32b78f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:22.416061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af2691-1cd8-4457-a4a3-2daa32b78f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:22.416803 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af2691-1cd8-4457-a4a3-2daa32b78f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:22.430872 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af2691-1cd8-4457-a4a3-2daa32b78f46 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:22.467948 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:22.512443 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 682/1370] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:22.521975 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af2691-1cd8-4457-a4a3-2daa32b78f46 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:22.557402 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db39e31-4801-4680-be53-a3c5b951c703 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:22.571603 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900e624-6a1c-49d5-a705-3120a703cea3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:22.572476 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900e624-6a1c-49d5-a705-3120a703cea3 service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:22.572993 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900e624-6a1c-49d5-a705-3120a703cea3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:22.573374 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900e624-6a1c-49d5-a705-3120a703cea3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:22.580782 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af2691-1cd8-4457-a4a3-2daa32b78f46 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:22.608871 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b8d32-a2d6-4918-a76d-5bea7f061d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:22.611375 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b8d32-a2d6-4918-a76d-5bea7f061d84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:22.611655 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b8d32-a2d6-4918-a76d-5bea7f061d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:22.620418 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b8d32-a2d6-4918-a76d-5bea7f061d84 admin admin] PATH_INFO: `/v3/projects/a332e5db39574e619d483b4710faf6c7/users/8a32ce215950453f980b27c7b83624f5/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:22.687397 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b8d32-a2d6-4918-a76d-5bea7f061d84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a332e5db39574e619d483b4710faf6c7, user_id=8a32ce215950453f980b27c7b83624f5, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:22.696853 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b8d32-a2d6-4918-a76d-5bea7f061d84 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:22.738050 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c900e624-6a1c-49d5-a705-3120a703cea3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:22.741641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c900e624-6a1c-49d5-a705-3120a703cea3 service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:22.765129 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 683/1371] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:22 2022] PUT /identity/v3/projects/a332e5db39574e619d483b4710faf6c7/users/8a32ce215950453f980b27c7b83624f5/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:22.768477 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 689/1372] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 20:30:22.772430 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b8d32-a2d6-4918-a76d-5bea7f061d84 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:23.172727 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b8d32-a2d6-4918-a76d-5bea7f061d84 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:23.192396 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797a062-f543-4202-8366-00e88f873d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:23.198412 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797a062-f543-4202-8366-00e88f873d24 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:23.198683 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797a062-f543-4202-8366-00e88f873d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:23.199366 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797a062-f543-4202-8366-00e88f873d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:23.206713 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797a062-f543-4202-8366-00e88f873d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:23.219892 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797a062-f543-4202-8366-00e88f873d24 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:23.259222 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 684/1373] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 487 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:23.260315 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900e624-6a1c-49d5-a705-3120a703cea3 service cinder] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:23.284810 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900e624-6a1c-49d5-a705-3120a703cea3 service cinder] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:23.300032 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d0950-5c47-4292-97e4-5cad31ea47fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:23.300782 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d0950-5c47-4292-97e4-5cad31ea47fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:23.301132 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d0950-5c47-4292-97e4-5cad31ea47fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:23.301398 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d0950-5c47-4292-97e4-5cad31ea47fc admin admin] PATH_INFO: `/v3/projects/a332e5db39574e619d483b4710faf6c7/users/8a32ce215950453f980b27c7b83624f5/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:23.310302 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d0950-5c47-4292-97e4-5cad31ea47fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a332e5db39574e619d483b4710faf6c7, user_id=8a32ce215950453f980b27c7b83624f5, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:23.320310 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d0950-5c47-4292-97e4-5cad31ea47fc admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:23.378076 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 690/1374] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:23 2022] PUT /identity/v3/projects/a332e5db39574e619d483b4710faf6c7/users/8a32ce215950453f980b27c7b83624f5/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:23.388774 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430795b-82e6-4730-9b15-318866faf788 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:23.389073 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430795b-82e6-4730-9b15-318866faf788 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:23.389365 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430795b-82e6-4730-9b15-318866faf788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:23.478439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-9430795b-82e6-4730-9b15-318866faf788 None None] MFA Rules not processed for user `8a32ce215950453f980b27c7b83624f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:23.484138 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-9430795b-82e6-4730-9b15-318866faf788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:23.765443 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:23.814033 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 685/1375] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:23 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:23.829277 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d0950-5c47-4292-97e4-5cad31ea47fc admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:23.960952 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d0950-5c47-4292-97e4-5cad31ea47fc admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:23.965067 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4177f5-7875-4390-896e-8d858b97796e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:23.965798 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4177f5-7875-4390-896e-8d858b97796e service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:23.971699 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4177f5-7875-4390-896e-8d858b97796e service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:23.972160 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4177f5-7875-4390-896e-8d858b97796e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:23.987694 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4177f5-7875-4390-896e-8d858b97796e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:23.989576 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4177f5-7875-4390-896e-8d858b97796e service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:24.020354 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 691/1376] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:23 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:24.172496 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430795b-82e6-4730-9b15-318866faf788 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:24.187642 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430795b-82e6-4730-9b15-318866faf788 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:24.196994 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925969f2-665e-4c09-87f3-1cf9eb94bee2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:24.197513 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925969f2-665e-4c09-87f3-1cf9eb94bee2 service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:24.197797 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925969f2-665e-4c09-87f3-1cf9eb94bee2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:24.198074 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925969f2-665e-4c09-87f3-1cf9eb94bee2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:24.377297 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925969f2-665e-4c09-87f3-1cf9eb94bee2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:24.382249 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925969f2-665e-4c09-87f3-1cf9eb94bee2 service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:24.407347 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 686/1377] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:24 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:25.193398 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a6884-4aa4-492d-a044-2fde87e035dc None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:25.194740 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a6884-4aa4-492d-a044-2fde87e035dc None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:25.196319 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a6884-4aa4-492d-a044-2fde87e035dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:25.258474 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-ef1a6884-4aa4-492d-a044-2fde87e035dc None None] MFA Rules not processed for user `f3d134d3ee554ddbbbf22644945b93cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:25.261903 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-ef1a6884-4aa4-492d-a044-2fde87e035dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:25.508849 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:25.532316 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 692/1378] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:25.541862 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b7675-ba95-4c7e-b4b9-db4fd45be186 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:25.542310 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b7675-ba95-4c7e-b4b9-db4fd45be186 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:25.542541 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b7675-ba95-4c7e-b4b9-db4fd45be186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:25.587831 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-f04b7675-ba95-4c7e-b4b9-db4fd45be186 None None] MFA Rules not processed for user `f3d134d3ee554ddbbbf22644945b93cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:25.590572 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-f04b7675-ba95-4c7e-b4b9-db4fd45be186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:25.612181 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 687/1379] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:25.628576 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a6884-4aa4-492d-a044-2fde87e035dc None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:25.630118 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-ef1a6884-4aa4-492d-a044-2fde87e035dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:25.912138 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a6884-4aa4-492d-a044-2fde87e035dc None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:25.923885 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a8674-ea07-48fc-ae04-0e4f94e46fcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:25.928219 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a8674-ea07-48fc-ae04-0e4f94e46fcf service nova] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:25.928783 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a8674-ea07-48fc-ae04-0e4f94e46fcf service nova] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:25.929162 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a8674-ea07-48fc-ae04-0e4f94e46fcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:25.961155 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a8674-ea07-48fc-ae04-0e4f94e46fcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:25.975440 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a8674-ea07-48fc-ae04-0e4f94e46fcf service nova] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:26.044986 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 693/1380] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:27.254623 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8e427-f72c-4ebf-987b-fa5db30eef43 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:27.255121 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8e427-f72c-4ebf-987b-fa5db30eef43 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:27.255205 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8e427-f72c-4ebf-987b-fa5db30eef43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:27.341997 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-09b8e427-f72c-4ebf-987b-fa5db30eef43 None None] MFA Rules not processed for user `6147bac8e2104d04b727c1e3bc7fff6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:27.343416 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-09b8e427-f72c-4ebf-987b-fa5db30eef43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:27.479630 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 688/1381] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:27.498739 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a8674-ea07-48fc-ae04-0e4f94e46fcf service nova] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:27.522853 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a8674-ea07-48fc-ae04-0e4f94e46fcf service nova] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:27.536929 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcaf28-01e1-453c-90a6-87436651f3a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:27.539008 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcaf28-01e1-453c-90a6-87436651f3a0 service nova] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:27.539455 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcaf28-01e1-453c-90a6-87436651f3a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:27.539913 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcaf28-01e1-453c-90a6-87436651f3a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:27.563954 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bcaf28-01e1-453c-90a6-87436651f3a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:27.568916 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bcaf28-01e1-453c-90a6-87436651f3a0 service nova] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:27.604199 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 694/1382] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:28.481969 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79cee7-fe24-4e93-b33f-bc35ac1fa27a None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:28.482842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79cee7-fe24-4e93-b33f-bc35ac1fa27a None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:28.483192 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79cee7-fe24-4e93-b33f-bc35ac1fa27a None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:28.484908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 689/1383] 10.222.0.23 () {54 vars in 912 bytes} [Wed Nov 2 20:30:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:30:28.491403 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f01c3c-1e56-43a1-8e56-3a7de348864c None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:28.491699 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f01c3c-1e56-43a1-8e56-3a7de348864c None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:28.492219 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f01c3c-1e56-43a1-8e56-3a7de348864c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:28.541591 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-c5f01c3c-1e56-43a1-8e56-3a7de348864c None None] MFA Rules not processed for user `fdb57cba49ce43ad95096047859dfe1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:28.546066 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-c5f01c3c-1e56-43a1-8e56-3a7de348864c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:28.740872 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 695/1384] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Nov 2 20:30:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:28.866087 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79cee7-fe24-4e93-b33f-bc35ac1fa27a None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:28.875241 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-4e79cee7-fe24-4e93-b33f-bc35ac1fa27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:28.906197 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79cee7-fe24-4e93-b33f-bc35ac1fa27a None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:28.923574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1d128-b916-4670-856d-9694d5307628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:28.924236 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1d128-b916-4670-856d-9694d5307628 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:28.925915 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1d128-b916-4670-856d-9694d5307628 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:28.926317 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1d128-b916-4670-856d-9694d5307628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:28.941038 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1d128-b916-4670-856d-9694d5307628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:28.943379 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1d128-b916-4670-856d-9694d5307628 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:28.978389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 690/1385] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:30.747853 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad112727-d283-4885-b2ea-0c331bb08138 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:30.748330 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad112727-d283-4885-b2ea-0c331bb08138 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:30.748857 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad112727-d283-4885-b2ea-0c331bb08138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:30.842687 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-ad112727-d283-4885-b2ea-0c331bb08138 None None] MFA Rules not processed for user `469b5cd3abf74c7984dd02faa1abfcd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:30.846240 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-ad112727-d283-4885-b2ea-0c331bb08138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:30.891990 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19840bd1-4cba-4142-8279-619ec7e3d6d1 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:30.893369 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19840bd1-4cba-4142-8279-619ec7e3d6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:30.893792 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19840bd1-4cba-4142-8279-619ec7e3d6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:30.950920 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-19840bd1-4cba-4142-8279-619ec7e3d6d1 None None] MFA Rules not processed for user `6147bac8e2104d04b727c1e3bc7fff6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:30.952591 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-19840bd1-4cba-4142-8279-619ec7e3d6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:30.984924 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 691/1386] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:30.986075 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19840bd1-4cba-4142-8279-619ec7e3d6d1 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:31.086920 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 696/1387] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:31.088654 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd13851-2227-475c-9fc5-e671f8d7c4a5 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:31.091247 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd13851-2227-475c-9fc5-e671f8d7c4a5 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:31.092042 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd13851-2227-475c-9fc5-e671f8d7c4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:31.176817 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:31.193195 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-5cd13851-2227-475c-9fc5-e671f8d7c4a5 None None] MFA Rules not processed for user `4bd602c085ad406eab3705dc8500a003`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:31.194742 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-5cd13851-2227-475c-9fc5-e671f8d7c4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:31.205052 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19840bd1-4cba-4142-8279-619ec7e3d6d1 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:31.211214 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e812f9-a7f6-4e85-83ca-7ddccd7fd35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:31.212221 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e812f9-a7f6-4e85-83ca-7ddccd7fd35e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:31.212769 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e812f9-a7f6-4e85-83ca-7ddccd7fd35e admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:31.213529 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e812f9-a7f6-4e85-83ca-7ddccd7fd35e admin admin] PATH_INFO: `/v3/users/6aec3fd14e95418abd3ce9083c032e8f` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:31.216201 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e812f9-a7f6-4e85-83ca-7ddccd7fd35e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aec3fd14e95418abd3ce9083c032e8f)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:31.217563 dv-cinder-862365-5-smb devstack@keystone.service[81403]: WARNING py.warnings [None req-f3e812f9-a7f6-4e85-83ca-7ddccd7fd35e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 20:30:31.217563 dv-cinder-862365-5-smb devstack@keystone.service[81403]: warnings.warn(msg) Nov 02 20:30:31.217563 dv-cinder-862365-5-smb devstack@keystone.service[81403]: Nov 02 20:30:31.219918 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e812f9-a7f6-4e85-83ca-7ddccd7fd35e admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:31.260829 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:31.415613 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-f3e812f9-a7f6-4e85-83ca-7ddccd7fd35e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aec3fd14e95418abd3ce9083c032e8f'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:31.418349 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-f3e812f9-a7f6-4e85-83ca-7ddccd7fd35e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aec3fd14e95418abd3ce9083c032e8f'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:31.457501 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-f3e812f9-a7f6-4e85-83ca-7ddccd7fd35e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aec3fd14e95418abd3ce9083c032e8f'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:31.458448 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-f3e812f9-a7f6-4e85-83ca-7ddccd7fd35e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aec3fd14e95418abd3ce9083c032e8f'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:31.476956 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 697/1388] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:31.478226 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd13851-2227-475c-9fc5-e671f8d7c4a5 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:31.479866 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-5cd13851-2227-475c-9fc5-e671f8d7c4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:31.486323 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-f3e812f9-a7f6-4e85-83ca-7ddccd7fd35e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aec3fd14e95418abd3ce9083c032e8f'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:31.531353 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 692/1389] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:30:30 2022] DELETE /identity/v3/users/6aec3fd14e95418abd3ce9083c032e8f => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:31.535653 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5031a34-0319-47ee-93cb-f85f2731939e None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:31.535949 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5031a34-0319-47ee-93cb-f85f2731939e None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:31.536223 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5031a34-0319-47ee-93cb-f85f2731939e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:31.590778 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-a5031a34-0319-47ee-93cb-f85f2731939e None None] MFA Rules not processed for user `4bd602c085ad406eab3705dc8500a003`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:31.593395 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-a5031a34-0319-47ee-93cb-f85f2731939e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:31.626312 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd13851-2227-475c-9fc5-e671f8d7c4a5 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:31.703654 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 693/1390] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:31.703654 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9ab5c-b0eb-4b09-a607-5bb04cf7e591 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:31.703654 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9ab5c-b0eb-4b09-a607-5bb04cf7e591 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:31.703654 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9ab5c-b0eb-4b09-a607-5bb04cf7e591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:31.734253 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-cfc9ab5c-b0eb-4b09-a607-5bb04cf7e591 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:31.735831 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-cfc9ab5c-b0eb-4b09-a607-5bb04cf7e591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:31.776036 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59acf5e-0ac8-4ba4-97dd-8a0df6e729e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603a9f31ae814003a2cbd02f964f4ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:31.776716 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59acf5e-0ac8-4ba4-97dd-8a0df6e729e9 service placement] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:31.776894 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59acf5e-0ac8-4ba4-97dd-8a0df6e729e9 service placement] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:31.777164 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59acf5e-0ac8-4ba4-97dd-8a0df6e729e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:31.781812 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-e59acf5e-0ac8-4ba4-97dd-8a0df6e729e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:31.801820 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59acf5e-0ac8-4ba4-97dd-8a0df6e729e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:31.810563 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59acf5e-0ac8-4ba4-97dd-8a0df6e729e9 service placement] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:31.835481 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 694/1391] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:31.840976 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 698/1392] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:31.849664 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9ab5c-b0eb-4b09-a607-5bb04cf7e591 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:31.860316 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-cfc9ab5c-b0eb-4b09-a607-5bb04cf7e591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:31.923717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:32.037669 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9ab5c-b0eb-4b09-a607-5bb04cf7e591 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:32.053837 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eeb776-6828-4a9c-b371-61662383fc4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:32.054487 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eeb776-6828-4a9c-b371-61662383fc4f service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:32.054767 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eeb776-6828-4a9c-b371-61662383fc4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:32.055064 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eeb776-6828-4a9c-b371-61662383fc4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:32.079823 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eeb776-6828-4a9c-b371-61662383fc4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:32.083254 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eeb776-6828-4a9c-b371-61662383fc4f service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:32.104818 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 695/1393] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:32.255058 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6a499-b588-485b-804e-fb23b1b4134a None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:32.255605 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6a499-b588-485b-804e-fb23b1b4134a None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:32.256624 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6a499-b588-485b-804e-fb23b1b4134a None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:32.258790 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 699/1394] 10.222.0.23 () {54 vars in 912 bytes} [Wed Nov 2 20:30:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:30:32.289512 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4773171-1405-47cd-a9c7-00ddd9b051f5 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:32.289804 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4773171-1405-47cd-a9c7-00ddd9b051f5 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:32.290143 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4773171-1405-47cd-a9c7-00ddd9b051f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:32.342694 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-b4773171-1405-47cd-a9c7-00ddd9b051f5 None None] MFA Rules not processed for user `fdb57cba49ce43ad95096047859dfe1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:32.344041 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-b4773171-1405-47cd-a9c7-00ddd9b051f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:32.379583 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 696/1395] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Nov 2 20:30:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:30:32.398659 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6a499-b588-485b-804e-fb23b1b4134a None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:32.425400 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6a499-b588-485b-804e-fb23b1b4134a None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:32.431103 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bdbdd-f1fa-4648-aadb-10417f6eee58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:32.431735 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bdbdd-f1fa-4648-aadb-10417f6eee58 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:32.432054 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bdbdd-f1fa-4648-aadb-10417f6eee58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:32.432300 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bdbdd-f1fa-4648-aadb-10417f6eee58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:32.465383 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549bdbdd-f1fa-4648-aadb-10417f6eee58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:32.469017 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549bdbdd-f1fa-4648-aadb-10417f6eee58 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:32.498721 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 700/1396] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:33.114441 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4773171-1405-47cd-a9c7-00ddd9b051f5 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:33.116673 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-b4773171-1405-47cd-a9c7-00ddd9b051f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:33.154400 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4773171-1405-47cd-a9c7-00ddd9b051f5 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:33.198818 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad991ac-465c-4f28-ad67-18922e72e0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:33.205124 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad991ac-465c-4f28-ad67-18922e72e0bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:33.207199 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad991ac-465c-4f28-ad67-18922e72e0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:33.207499 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad991ac-465c-4f28-ad67-18922e72e0bf admin admin] PATH_INFO: `/v3/projects/7f4427351c82438c9c7b399c83173f1b` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:33.211247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad991ac-465c-4f28-ad67-18922e72e0bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f4427351c82438c9c7b399c83173f1b)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:33.215561 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad991ac-465c-4f28-ad67-18922e72e0bf admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:33.349870 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bdbdd-f1fa-4648-aadb-10417f6eee58 service neutron] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:33.352052 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-549bdbdd-f1fa-4648-aadb-10417f6eee58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:33.364744 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-fad991ac-465c-4f28-ad67-18922e72e0bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f4427351c82438c9c7b399c83173f1b', 'request_id': 'req-fad991ac-465c-4f28-ad67-18922e72e0bf'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:33.392469 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-fad991ac-465c-4f28-ad67-18922e72e0bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f4427351c82438c9c7b399c83173f1b', 'request_id': 'req-fad991ac-465c-4f28-ad67-18922e72e0bf'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:33.418782 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-fad991ac-465c-4f28-ad67-18922e72e0bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f4427351c82438c9c7b399c83173f1b', 'request_id': 'req-fad991ac-465c-4f28-ad67-18922e72e0bf'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:33.436642 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-fad991ac-465c-4f28-ad67-18922e72e0bf admin admin] The token cache is being invalidate because project 7f4427351c82438c9c7b399c83173f1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:30:33.437064 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-fad991ac-465c-4f28-ad67-18922e72e0bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:33.438135 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-fad991ac-465c-4f28-ad67-18922e72e0bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:33.442630 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 697/1397] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:30:33 2022] DELETE /identity/v3/projects/7f4427351c82438c9c7b399c83173f1b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:33.446690 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad991ac-465c-4f28-ad67-18922e72e0bf admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:33.450578 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-fad991ac-465c-4f28-ad67-18922e72e0bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:33.490901 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:33.551157 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad991ac-465c-4f28-ad67-18922e72e0bf admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:33.558849 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00221a9f-db8f-4a16-9f66-afd84610364c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:33.559507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00221a9f-db8f-4a16-9f66-afd84610364c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:33.559793 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00221a9f-db8f-4a16-9f66-afd84610364c admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:33.560075 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00221a9f-db8f-4a16-9f66-afd84610364c admin admin] PATH_INFO: `/v3/users/01beca11cf5849849fd6126a264f7d4d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:33.561241 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00221a9f-db8f-4a16-9f66-afd84610364c admin admin] RBAC: Authorizing `identity:delete_user(user_id=01beca11cf5849849fd6126a264f7d4d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:33.564031 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00221a9f-db8f-4a16-9f66-afd84610364c admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:33.617659 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bdbdd-f1fa-4648-aadb-10417f6eee58 service neutron] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:33.700061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:33.714101 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-00221a9f-db8f-4a16-9f66-afd84610364c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01beca11cf5849849fd6126a264f7d4d'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:33.722297 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-00221a9f-db8f-4a16-9f66-afd84610364c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01beca11cf5849849fd6126a264f7d4d'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:33.749206 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-00221a9f-db8f-4a16-9f66-afd84610364c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01beca11cf5849849fd6126a264f7d4d'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:33.754443 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-00221a9f-db8f-4a16-9f66-afd84610364c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01beca11cf5849849fd6126a264f7d4d'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:33.813859 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e2e2b-a29a-4278-809e-eccf894c1be6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:33.814491 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e2e2b-a29a-4278-809e-eccf894c1be6 service nova] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:33.814770 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e2e2b-a29a-4278-809e-eccf894c1be6 service nova] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:33.815041 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e2e2b-a29a-4278-809e-eccf894c1be6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:33.821081 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-a64e2e2b-a29a-4278-809e-eccf894c1be6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:33.821581 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-00221a9f-db8f-4a16-9f66-afd84610364c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01beca11cf5849849fd6126a264f7d4d'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:33.894437 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 698/1398] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:30:33 2022] DELETE /identity/v3/users/01beca11cf5849849fd6126a264f7d4d => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:33.895111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00221a9f-db8f-4a16-9f66-afd84610364c admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:33.898324 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-00221a9f-db8f-4a16-9f66-afd84610364c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:33.991804 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e2e2b-a29a-4278-809e-eccf894c1be6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:33.999142 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e2e2b-a29a-4278-809e-eccf894c1be6 service nova] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:34.038957 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 701/1399] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:33 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 689 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 20:30:34.230195 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00221a9f-db8f-4a16-9f66-afd84610364c admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:34.258622 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e03540-0476-4e23-81b9-56d79162db97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:34.260644 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e03540-0476-4e23-81b9-56d79162db97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:34.260933 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e03540-0476-4e23-81b9-56d79162db97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:34.261212 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e03540-0476-4e23-81b9-56d79162db97 admin admin] PATH_INFO: `/v3/users/59c541f62cfe49a8b750e4ae067c63e9` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:34.263444 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e03540-0476-4e23-81b9-56d79162db97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59c541f62cfe49a8b750e4ae067c63e9)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:34.276622 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e03540-0476-4e23-81b9-56d79162db97 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:34.423236 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-02e03540-0476-4e23-81b9-56d79162db97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59c541f62cfe49a8b750e4ae067c63e9'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:34.423950 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-02e03540-0476-4e23-81b9-56d79162db97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59c541f62cfe49a8b750e4ae067c63e9'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:34.466646 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-02e03540-0476-4e23-81b9-56d79162db97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59c541f62cfe49a8b750e4ae067c63e9'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:34.469984 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-02e03540-0476-4e23-81b9-56d79162db97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59c541f62cfe49a8b750e4ae067c63e9'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:34.527761 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-02e03540-0476-4e23-81b9-56d79162db97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59c541f62cfe49a8b750e4ae067c63e9'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:34.571187 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 699/1400] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:30:33 2022] DELETE /identity/v3/users/59c541f62cfe49a8b750e4ae067c63e9 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:34.578934 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e5c4a-7d9c-4f90-ab6d-1116c67ef199 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:34.579592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e5c4a-7d9c-4f90-ab6d-1116c67ef199 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:34.579592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e5c4a-7d9c-4f90-ab6d-1116c67ef199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:34.688284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-541e5c4a-7d9c-4f90-ab6d-1116c67ef199 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:34.690364 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-541e5c4a-7d9c-4f90-ab6d-1116c67ef199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:34.960566 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 702/1401] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:34.977930 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e03540-0476-4e23-81b9-56d79162db97 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:34.980248 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-02e03540-0476-4e23-81b9-56d79162db97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:35.044953 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e5c4a-7d9c-4f90-ab6d-1116c67ef199 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:35.053429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-541e5c4a-7d9c-4f90-ab6d-1116c67ef199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:35.123714 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e5c4a-7d9c-4f90-ab6d-1116c67ef199 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:35.131197 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:35.132409 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52dffcd-587b-4f96-8268-a1c57aa61c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:35.133393 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dffcd-587b-4f96-8268-a1c57aa61c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:35.133929 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dffcd-587b-4f96-8268-a1c57aa61c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:35.134101 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dffcd-587b-4f96-8268-a1c57aa61c81 admin admin] PATH_INFO: `/v3/projects/4e0b0a521fb54f459f8d0577fa4be7b3` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:35.135460 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52dffcd-587b-4f96-8268-a1c57aa61c81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e0b0a521fb54f459f8d0577fa4be7b3)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:35.140022 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52dffcd-587b-4f96-8268-a1c57aa61c81 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:35.154135 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:35.233045 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e03540-0476-4e23-81b9-56d79162db97 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:35.256066 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-d52dffcd-587b-4f96-8268-a1c57aa61c81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e0b0a521fb54f459f8d0577fa4be7b3', 'request_id': 'req-d52dffcd-587b-4f96-8268-a1c57aa61c81'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:35.269900 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-d52dffcd-587b-4f96-8268-a1c57aa61c81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e0b0a521fb54f459f8d0577fa4be7b3', 'request_id': 'req-d52dffcd-587b-4f96-8268-a1c57aa61c81'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:35.307062 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-d52dffcd-587b-4f96-8268-a1c57aa61c81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e0b0a521fb54f459f8d0577fa4be7b3', 'request_id': 'req-d52dffcd-587b-4f96-8268-a1c57aa61c81'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:35.332518 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-d52dffcd-587b-4f96-8268-a1c57aa61c81 admin admin] The token cache is being invalidate because project 4e0b0a521fb54f459f8d0577fa4be7b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:30:35.333662 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-d52dffcd-587b-4f96-8268-a1c57aa61c81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:35.334557 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-d52dffcd-587b-4f96-8268-a1c57aa61c81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:35.340758 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 703/1402] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:30:35 2022] DELETE /identity/v3/projects/4e0b0a521fb54f459f8d0577fa4be7b3 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:35.344742 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbab8f-0e95-437a-b4e7-81972cb1caa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:35.345444 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbab8f-0e95-437a-b4e7-81972cb1caa4 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:35.345783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbab8f-0e95-437a-b4e7-81972cb1caa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:35.346425 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbab8f-0e95-437a-b4e7-81972cb1caa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:35.346633 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775ed90-ffe0-4b12-9fd2-dca0bb1e546d None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:35.347135 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775ed90-ffe0-4b12-9fd2-dca0bb1e546d None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:35.347608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775ed90-ffe0-4b12-9fd2-dca0bb1e546d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:35.349550 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-02fbab8f-0e95-437a-b4e7-81972cb1caa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:35.391457 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-f775ed90-ffe0-4b12-9fd2-dca0bb1e546d None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:35.393953 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-f775ed90-ffe0-4b12-9fd2-dca0bb1e546d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:35.462100 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fbab8f-0e95-437a-b4e7-81972cb1caa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:35.464987 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fbab8f-0e95-437a-b4e7-81972cb1caa4 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:35.542837 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 700/1403] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:35.617767 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 704/1404] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:30:35.625687 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13532bb-d47a-4f5b-98b5-138a210e470d None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:35.626047 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13532bb-d47a-4f5b-98b5-138a210e470d None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:35.627135 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13532bb-d47a-4f5b-98b5-138a210e470d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:35.700312 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-a13532bb-d47a-4f5b-98b5-138a210e470d None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:35.702086 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-a13532bb-d47a-4f5b-98b5-138a210e470d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:35.739206 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 701/1405] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:35.743365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775ed90-ffe0-4b12-9fd2-dca0bb1e546d None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:35.765388 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775ed90-ffe0-4b12-9fd2-dca0bb1e546d None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:35.786806 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb6dc5-8ff3-4143-8df8-5b64934aa0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:35.787745 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb6dc5-8ff3-4143-8df8-5b64934aa0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:35.788213 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb6dc5-8ff3-4143-8df8-5b64934aa0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:35.788963 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb6dc5-8ff3-4143-8df8-5b64934aa0a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:35.790036 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb6dc5-8ff3-4143-8df8-5b64934aa0a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:30:35.790506 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb6dc5-8ff3-4143-8df8-5b64934aa0a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:35.792447 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb6dc5-8ff3-4143-8df8-5b64934aa0a9 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:35.811723 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 705/1406] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:30:35.814311 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13532bb-d47a-4f5b-98b5-138a210e470d None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:35.827262 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13532bb-d47a-4f5b-98b5-138a210e470d None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:35.837808 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0f617-c483-4667-9fc3-71d68e0e8708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:35.851998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0f617-c483-4667-9fc3-71d68e0e8708 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:35.852357 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0f617-c483-4667-9fc3-71d68e0e8708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:35.852669 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0f617-c483-4667-9fc3-71d68e0e8708 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:35.853396 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0f617-c483-4667-9fc3-71d68e0e8708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:35.867089 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0f617-c483-4667-9fc3-71d68e0e8708 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:35.975538 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 702/1407] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:30:35 2022] POST /identity/v3/projects => generated 365 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:35.977337 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb6dc5-8ff3-4143-8df8-5b64934aa0a9 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:35.991879 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb6dc5-8ff3-4143-8df8-5b64934aa0a9 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:36.023174 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56862622-33ca-4698-988e-11a049e640c4 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:36.023505 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56862622-33ca-4698-988e-11a049e640c4 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:36.023913 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56862622-33ca-4698-988e-11a049e640c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:36.099775 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-56862622-33ca-4698-988e-11a049e640c4 None None] MFA Rules not processed for user `4bd602c085ad406eab3705dc8500a003`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:36.105810 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-56862622-33ca-4698-988e-11a049e640c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:36.192452 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13267a90-16db-40a8-8580-38edf0d7b24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:36.193114 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13267a90-16db-40a8-8580-38edf0d7b24c admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:36.194601 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13267a90-16db-40a8-8580-38edf0d7b24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:36.194898 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13267a90-16db-40a8-8580-38edf0d7b24c admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:36.195914 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13267a90-16db-40a8-8580-38edf0d7b24c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:36.203213 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13267a90-16db-40a8-8580-38edf0d7b24c admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:36.255489 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 706/1408] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:30:35 2022] POST /identity/v3/users => generated 283 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:36.259895 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13267a90-16db-40a8-8580-38edf0d7b24c admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:36.290155 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13267a90-16db-40a8-8580-38edf0d7b24c admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:36.304884 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fc676-e854-4113-bb1c-a02d757ab5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:36.305518 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fc676-e854-4113-bb1c-a02d757ab5be admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:36.308578 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fc676-e854-4113-bb1c-a02d757ab5be admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:36.308886 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fc676-e854-4113-bb1c-a02d757ab5be admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:36.309580 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0fc676-e854-4113-bb1c-a02d757ab5be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:36.316661 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0fc676-e854-4113-bb1c-a02d757ab5be admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:36.339296 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:36.339296 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 707/1409] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:36.344710 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 703/1410] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:30:36.362654 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fc676-e854-4113-bb1c-a02d757ab5be admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:36.397715 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fc676-e854-4113-bb1c-a02d757ab5be admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:36.407866 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4428e04-925a-43f1-8a06-5dd3807ab67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:36.409446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4428e04-925a-43f1-8a06-5dd3807ab67c admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:36.409685 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4428e04-925a-43f1-8a06-5dd3807ab67c admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:36.410192 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4428e04-925a-43f1-8a06-5dd3807ab67c admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:36.410868 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4428e04-925a-43f1-8a06-5dd3807ab67c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:36.413029 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4428e04-925a-43f1-8a06-5dd3807ab67c admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:36.431213 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 708/1411] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:36.431388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56862622-33ca-4698-988e-11a049e640c4 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:36.452024 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56862622-33ca-4698-988e-11a049e640c4 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:36.475370 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387f566-bc22-42f8-b0a3-737f26a3c6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:36.476069 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387f566-bc22-42f8-b0a3-737f26a3c6fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:36.476352 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387f566-bc22-42f8-b0a3-737f26a3c6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:36.476656 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387f566-bc22-42f8-b0a3-737f26a3c6fe admin admin] PATH_INFO: `/v3/projects/aa2fa1fa6cf642a6a96d0a87ce902876/users/615147571be7443cb392cd9f6f6be55e/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:36.541005 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387f566-bc22-42f8-b0a3-737f26a3c6fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa2fa1fa6cf642a6a96d0a87ce902876, user_id=615147571be7443cb392cd9f6f6be55e, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:36.556580 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387f566-bc22-42f8-b0a3-737f26a3c6fe admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:36.570624 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:36.605197 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 704/1412] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:36 2022] PUT /identity/v3/projects/aa2fa1fa6cf642a6a96d0a87ce902876/users/615147571be7443cb392cd9f6f6be55e/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:36.619867 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2b65f-be5d-4550-9916-eec3b8e8e93c None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:36.620667 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2b65f-be5d-4550-9916-eec3b8e8e93c None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:36.621153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2b65f-be5d-4550-9916-eec3b8e8e93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:36.686770 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-4ed2b65f-be5d-4550-9916-eec3b8e8e93c None None] MFA Rules not processed for user `615147571be7443cb392cd9f6f6be55e`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:36.689653 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-4ed2b65f-be5d-4550-9916-eec3b8e8e93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:36.723693 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910b8ed-2ea9-4c99-b100-90212de8ae9a None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:36.724457 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910b8ed-2ea9-4c99-b100-90212de8ae9a None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:36.725136 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910b8ed-2ea9-4c99-b100-90212de8ae9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:36.873816 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-3910b8ed-2ea9-4c99-b100-90212de8ae9a None None] MFA Rules not processed for user `66937804f65147f392f4ddfc3e961d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:36.879073 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-3910b8ed-2ea9-4c99-b100-90212de8ae9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:36.976624 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 709/1413] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:36.981872 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2b65f-be5d-4550-9916-eec3b8e8e93c None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:37.118087 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 705/1414] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Nov 2 20:30:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:30:37.233746 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2b65f-be5d-4550-9916-eec3b8e8e93c None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:37.269124 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40df550-5410-4089-971c-12f46ef89068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:37.269819 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40df550-5410-4089-971c-12f46ef89068 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:37.270102 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40df550-5410-4089-971c-12f46ef89068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:37.270381 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40df550-5410-4089-971c-12f46ef89068 admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:37.271087 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40df550-5410-4089-971c-12f46ef89068 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:37.273101 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40df550-5410-4089-971c-12f46ef89068 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:37.348723 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 710/1415] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:30:36 2022] POST /identity/v3/projects => generated 363 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:37.353239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910b8ed-2ea9-4c99-b100-90212de8ae9a None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:37.372109 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910b8ed-2ea9-4c99-b100-90212de8ae9a None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:37.464525 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40df550-5410-4089-971c-12f46ef89068 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:37.466456 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-f40df550-5410-4089-971c-12f46ef89068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:37.608323 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0755e1f-aacb-4bf9-9c79-faacc9b2a8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:37.609245 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0755e1f-aacb-4bf9-9c79-faacc9b2a8ae admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:37.614275 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0755e1f-aacb-4bf9-9c79-faacc9b2a8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:37.614710 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0755e1f-aacb-4bf9-9c79-faacc9b2a8ae admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:37.620663 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0755e1f-aacb-4bf9-9c79-faacc9b2a8ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:37.623533 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0755e1f-aacb-4bf9-9c79-faacc9b2a8ae admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:37.724654 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 706/1416] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:30:37 2022] POST /identity/v3/users => generated 288 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:37.725647 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0755e1f-aacb-4bf9-9c79-faacc9b2a8ae admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:37.734702 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-f0755e1f-aacb-4bf9-9c79-faacc9b2a8ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:37.761460 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40df550-5410-4089-971c-12f46ef89068 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:37.775798 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a33f2-6753-4080-a46c-9e53514eb26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:37.776944 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a33f2-6753-4080-a46c-9e53514eb26b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:37.777435 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a33f2-6753-4080-a46c-9e53514eb26b admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:37.778516 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a33f2-6753-4080-a46c-9e53514eb26b admin admin] PATH_INFO: `/v3/projects/aa680622d2734ab59a1b81646fa6113d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:37.781774 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a33f2-6753-4080-a46c-9e53514eb26b admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa680622d2734ab59a1b81646fa6113d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:37.785349 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a33f2-6753-4080-a46c-9e53514eb26b admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:37.793836 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:37.897201 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:37.902110 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-b39a33f2-6753-4080-a46c-9e53514eb26b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa680622d2734ab59a1b81646fa6113d', 'request_id': 'req-b39a33f2-6753-4080-a46c-9e53514eb26b'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:37.917317 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-b39a33f2-6753-4080-a46c-9e53514eb26b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa680622d2734ab59a1b81646fa6113d', 'request_id': 'req-b39a33f2-6753-4080-a46c-9e53514eb26b'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:37.929937 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-b39a33f2-6753-4080-a46c-9e53514eb26b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa680622d2734ab59a1b81646fa6113d', 'request_id': 'req-b39a33f2-6753-4080-a46c-9e53514eb26b'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:37.969354 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0755e1f-aacb-4bf9-9c79-faacc9b2a8ae admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:37.976442 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-b39a33f2-6753-4080-a46c-9e53514eb26b admin admin] The token cache is being invalidate because project aa680622d2734ab59a1b81646fa6113d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:30:37.976442 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-b39a33f2-6753-4080-a46c-9e53514eb26b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:37.977765 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-b39a33f2-6753-4080-a46c-9e53514eb26b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:37.979610 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 711/1417] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:30:37 2022] DELETE /identity/v3/projects/aa680622d2734ab59a1b81646fa6113d => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:37.983289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a33f2-6753-4080-a46c-9e53514eb26b admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:37.995030 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-b39a33f2-6753-4080-a46c-9e53514eb26b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:38.161574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51239b6d-72a1-433b-8fe4-a72579816841 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f22f80ac694e9888c132af1e58e292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:38.162573 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51239b6d-72a1-433b-8fe4-a72579816841 service swift] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:38.163944 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51239b6d-72a1-433b-8fe4-a72579816841 service swift] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:38.164254 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51239b6d-72a1-433b-8fe4-a72579816841 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:38.176211 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-51239b6d-72a1-433b-8fe4-a72579816841 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:38.267933 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a33f2-6753-4080-a46c-9e53514eb26b admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:38.296617 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78924dae-c61e-4aaf-80c2-342f607c005c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:38.297509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78924dae-c61e-4aaf-80c2-342f607c005c admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:38.298177 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78924dae-c61e-4aaf-80c2-342f607c005c admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:38.299785 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78924dae-c61e-4aaf-80c2-342f607c005c admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:38.301596 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78924dae-c61e-4aaf-80c2-342f607c005c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:38.308965 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78924dae-c61e-4aaf-80c2-342f607c005c admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:38.341896 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 712/1418] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:38.341896 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78924dae-c61e-4aaf-80c2-342f607c005c admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:38.345974 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-78924dae-c61e-4aaf-80c2-342f607c005c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:38.379712 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78924dae-c61e-4aaf-80c2-342f607c005c admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:38.389417 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fdfcc-89c7-4836-8e85-93b59e5b5592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:38.390064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fdfcc-89c7-4836-8e85-93b59e5b5592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:38.390349 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fdfcc-89c7-4836-8e85-93b59e5b5592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:38.390658 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fdfcc-89c7-4836-8e85-93b59e5b5592 admin admin] PATH_INFO: `/v3/users/376f7abd349e46d49c53336dade1dc27` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:38.392003 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7fdfcc-89c7-4836-8e85-93b59e5b5592 admin admin] RBAC: Authorizing `identity:delete_user(user_id=376f7abd349e46d49c53336dade1dc27)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:38.405819 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7fdfcc-89c7-4836-8e85-93b59e5b5592 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:38.533679 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51239b6d-72a1-433b-8fe4-a72579816841 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:38.537567 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51239b6d-72a1-433b-8fe4-a72579816841 service swift] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:38.590617 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 707/1419] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Nov 2 20:30:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 864 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 20:30:38.594415 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51239b6d-72a1-433b-8fe4-a72579816841 service swift] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:38.608521 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4b7fdfcc-89c7-4836-8e85-93b59e5b5592 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '376f7abd349e46d49c53336dade1dc27'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:38.611104 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4b7fdfcc-89c7-4836-8e85-93b59e5b5592 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '376f7abd349e46d49c53336dade1dc27'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:38.695238 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4b7fdfcc-89c7-4836-8e85-93b59e5b5592 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '376f7abd349e46d49c53336dade1dc27'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:38.699237 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4b7fdfcc-89c7-4836-8e85-93b59e5b5592 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '376f7abd349e46d49c53336dade1dc27'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:38.747319 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51239b6d-72a1-433b-8fe4-a72579816841 service swift] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:38.761242 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4b7fdfcc-89c7-4836-8e85-93b59e5b5592 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '376f7abd349e46d49c53336dade1dc27'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:38.811106 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4df34-eae1-4a16-b922-47118c033da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:38.814547 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 713/1420] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:30:38 2022] DELETE /identity/v3/users/376f7abd349e46d49c53336dade1dc27 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:38.821349 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4df34-eae1-4a16-b922-47118c033da9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:38.835080 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4df34-eae1-4a16-b922-47118c033da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:38.839566 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4df34-eae1-4a16-b922-47118c033da9 admin admin] PATH_INFO: `/v3/projects/172af555d16847efbb98f88aefbadda3/users/824a52dcc6e24f9a90cce7d541f399ef/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:38.922540 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4df34-eae1-4a16-b922-47118c033da9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=172af555d16847efbb98f88aefbadda3, user_id=824a52dcc6e24f9a90cce7d541f399ef, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:38.939490 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4df34-eae1-4a16-b922-47118c033da9 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:38.998358 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 708/1421] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:38 2022] PUT /identity/v3/projects/172af555d16847efbb98f88aefbadda3/users/824a52dcc6e24f9a90cce7d541f399ef/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:39.002640 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fdfcc-89c7-4836-8e85-93b59e5b5592 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:39.004218 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-4b7fdfcc-89c7-4836-8e85-93b59e5b5592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:39.010032 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:39.189731 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fdfcc-89c7-4836-8e85-93b59e5b5592 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:39.608093 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8af5ec-bbb4-4962-bfa6-dca409ec8cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:39.614156 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8af5ec-bbb4-4962-bfa6-dca409ec8cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:39.614583 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8af5ec-bbb4-4962-bfa6-dca409ec8cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:39.614791 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8af5ec-bbb4-4962-bfa6-dca409ec8cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:39.615519 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8af5ec-bbb4-4962-bfa6-dca409ec8cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:39.631826 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8af5ec-bbb4-4962-bfa6-dca409ec8cc2 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:39.679002 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 714/1422] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 677 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:39.684625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4df34-eae1-4a16-b922-47118c033da9 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:39.708709 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4df34-eae1-4a16-b922-47118c033da9 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:39.736331 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8eaba9-4eeb-4571-95b8-3ec0ac7d13da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:39.741150 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8eaba9-4eeb-4571-95b8-3ec0ac7d13da admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:39.748109 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8eaba9-4eeb-4571-95b8-3ec0ac7d13da admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:39.748787 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8eaba9-4eeb-4571-95b8-3ec0ac7d13da admin admin] PATH_INFO: `/v3/projects/172af555d16847efbb98f88aefbadda3/users/824a52dcc6e24f9a90cce7d541f399ef/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:39.756086 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8eaba9-4eeb-4571-95b8-3ec0ac7d13da admin admin] RBAC: Authorizing `identity:create_grant(project_id=172af555d16847efbb98f88aefbadda3, user_id=824a52dcc6e24f9a90cce7d541f399ef, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:39.768012 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8eaba9-4eeb-4571-95b8-3ec0ac7d13da admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:39.838903 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 709/1423] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:39 2022] PUT /identity/v3/projects/172af555d16847efbb98f88aefbadda3/users/824a52dcc6e24f9a90cce7d541f399ef/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:39.855006 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2052f6b-fa83-4d16-80ec-ec7f0a30a073 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:39.856041 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2052f6b-fa83-4d16-80ec-ec7f0a30a073 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:39.856351 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2052f6b-fa83-4d16-80ec-ec7f0a30a073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:40.038111 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-f2052f6b-fa83-4d16-80ec-ec7f0a30a073 None None] MFA Rules not processed for user `824a52dcc6e24f9a90cce7d541f399ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:40.052833 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-f2052f6b-fa83-4d16-80ec-ec7f0a30a073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:40.430421 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 715/1424] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:39 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 577 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:40.529729 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8eaba9-4eeb-4571-95b8-3ec0ac7d13da admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:40.532960 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-9b8eaba9-4eeb-4571-95b8-3ec0ac7d13da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:40.741394 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:40.794572 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8eaba9-4eeb-4571-95b8-3ec0ac7d13da admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:40.811063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7bd5c-eb4a-4029-8285-b5eca01bd138 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:40.814375 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7bd5c-eb4a-4029-8285-b5eca01bd138 service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:40.819719 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7bd5c-eb4a-4029-8285-b5eca01bd138 service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:40.821144 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7bd5c-eb4a-4029-8285-b5eca01bd138 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:40.865189 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7bd5c-eb4a-4029-8285-b5eca01bd138 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:40.869857 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7bd5c-eb4a-4029-8285-b5eca01bd138 service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:40.918072 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 710/1425] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:40 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:41.509296 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2052f6b-fa83-4d16-80ec-ec7f0a30a073 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:41.530364 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2052f6b-fa83-4d16-80ec-ec7f0a30a073 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:41.559963 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aeaaf5-bab3-4713-8f6c-a4f83b31d136 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:41.564032 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aeaaf5-bab3-4713-8f6c-a4f83b31d136 service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:41.565679 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aeaaf5-bab3-4713-8f6c-a4f83b31d136 service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:41.566747 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aeaaf5-bab3-4713-8f6c-a4f83b31d136 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:41.578414 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-90aeaaf5-bab3-4713-8f6c-a4f83b31d136 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:41.698259 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:41.844696 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aeaaf5-bab3-4713-8f6c-a4f83b31d136 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:41.844696 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aeaaf5-bab3-4713-8f6c-a4f83b31d136 service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:41.879342 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 716/1426] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:42.817318 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b004818-738e-4071-86a7-48ae750e5c63 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:42.818448 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b004818-738e-4071-86a7-48ae750e5c63 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:42.818915 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b004818-738e-4071-86a7-48ae750e5c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:42.867899 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-4b004818-738e-4071-86a7-48ae750e5c63 None None] MFA Rules not processed for user `fdb57cba49ce43ad95096047859dfe1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:42.869344 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-4b004818-738e-4071-86a7-48ae750e5c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:43.037032 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 711/1427] 10.222.0.15 () {58 vars in 1015 bytes} [Wed Nov 2 20:30:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:43.427125 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aeaaf5-bab3-4713-8f6c-a4f83b31d136 service cinder] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:43.427642 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b004818-738e-4071-86a7-48ae750e5c63 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:43.429303 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-4b004818-738e-4071-86a7-48ae750e5c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:43.431373 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-90aeaaf5-bab3-4713-8f6c-a4f83b31d136 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:43.461029 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b004818-738e-4071-86a7-48ae750e5c63 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:43.469068 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aeaaf5-bab3-4713-8f6c-a4f83b31d136 service cinder] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:43.482750 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969d1c5-4d5b-4f3c-b14f-42f95d23f391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:43.485433 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969d1c5-4d5b-4f3c-b14f-42f95d23f391 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:43.485732 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969d1c5-4d5b-4f3c-b14f-42f95d23f391 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:43.490526 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969d1c5-4d5b-4f3c-b14f-42f95d23f391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:43.491255 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fc803-c3dc-4876-9108-e09d2e935839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:43.495771 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fc803-c3dc-4876-9108-e09d2e935839 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:43.496731 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fc803-c3dc-4876-9108-e09d2e935839 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:43.498704 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fc803-c3dc-4876-9108-e09d2e935839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:43.528395 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7fc803-c3dc-4876-9108-e09d2e935839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:43.537157 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7fc803-c3dc-4876-9108-e09d2e935839 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:43.539507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969d1c5-4d5b-4f3c-b14f-42f95d23f391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:43.582754 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969d1c5-4d5b-4f3c-b14f-42f95d23f391 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:43.619769 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 712/1428] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:43.624638 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 717/1429] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:44.683110 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969d1c5-4d5b-4f3c-b14f-42f95d23f391 service neutron] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:44.686482 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-9969d1c5-4d5b-4f3c-b14f-42f95d23f391 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:45.124375 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969d1c5-4d5b-4f3c-b14f-42f95d23f391 service neutron] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:45.156825 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2c857-4ab5-4765-9c24-2824f18365dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:45.157432 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2c857-4ab5-4765-9c24-2824f18365dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:45.157721 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2c857-4ab5-4765-9c24-2824f18365dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:45.158006 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2c857-4ab5-4765-9c24-2824f18365dc admin admin] PATH_INFO: `/v3/projects/05e2245b5d7b4201a92dff1796866111` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:45.186435 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a2c857-4ab5-4765-9c24-2824f18365dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=05e2245b5d7b4201a92dff1796866111)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:45.191963 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a2c857-4ab5-4765-9c24-2824f18365dc admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:45.398757 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-36a2c857-4ab5-4765-9c24-2824f18365dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05e2245b5d7b4201a92dff1796866111', 'request_id': 'req-36a2c857-4ab5-4765-9c24-2824f18365dc'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:45.421476 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-36a2c857-4ab5-4765-9c24-2824f18365dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05e2245b5d7b4201a92dff1796866111', 'request_id': 'req-36a2c857-4ab5-4765-9c24-2824f18365dc'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:45.450092 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-36a2c857-4ab5-4765-9c24-2824f18365dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05e2245b5d7b4201a92dff1796866111', 'request_id': 'req-36a2c857-4ab5-4765-9c24-2824f18365dc'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:45.491888 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-36a2c857-4ab5-4765-9c24-2824f18365dc admin admin] The token cache is being invalidate because project 05e2245b5d7b4201a92dff1796866111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:30:45.492441 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-36a2c857-4ab5-4765-9c24-2824f18365dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:45.495987 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-36a2c857-4ab5-4765-9c24-2824f18365dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:45.508473 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf4c7f-1382-47f9-830b-4cf9595561ec None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:45.509201 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 713/1430] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:30:44 2022] DELETE /identity/v3/projects/05e2245b5d7b4201a92dff1796866111 => generated 0 bytes in 819 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:45.510471 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf4c7f-1382-47f9-830b-4cf9595561ec None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:45.510985 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf4c7f-1382-47f9-830b-4cf9595561ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:45.599190 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-4dcf4c7f-1382-47f9-830b-4cf9595561ec None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:45.602137 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-4dcf4c7f-1382-47f9-830b-4cf9595561ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:45.927673 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 718/1431] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:45.935890 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de01aeb-bf9d-40de-aa6a-7ed6eaf51f6f None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:45.936406 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de01aeb-bf9d-40de-aa6a-7ed6eaf51f6f None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:45.936488 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de01aeb-bf9d-40de-aa6a-7ed6eaf51f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:45.973298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-4de01aeb-bf9d-40de-aa6a-7ed6eaf51f6f None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:45.974918 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-4de01aeb-bf9d-40de-aa6a-7ed6eaf51f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:46.002106 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf4c7f-1382-47f9-830b-4cf9595561ec None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:46.009342 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 714/1432] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:46.032383 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf4c7f-1382-47f9-830b-4cf9595561ec None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:46.060868 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c9502-8141-4110-9230-39bb96f23671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:46.061533 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c9502-8141-4110-9230-39bb96f23671 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:46.061817 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c9502-8141-4110-9230-39bb96f23671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:46.062090 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c9502-8141-4110-9230-39bb96f23671 admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:46.062749 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488c9502-8141-4110-9230-39bb96f23671 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:30:46.063212 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488c9502-8141-4110-9230-39bb96f23671 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:46.066615 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488c9502-8141-4110-9230-39bb96f23671 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:46.113579 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 719/1433] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:30:46.124055 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de01aeb-bf9d-40de-aa6a-7ed6eaf51f6f None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:46.130643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:46.147421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de01aeb-bf9d-40de-aa6a-7ed6eaf51f6f None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:46.163363 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae181794-abd8-4a4e-855c-77769b43a6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:46.166075 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae181794-abd8-4a4e-855c-77769b43a6ce admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:46.166502 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae181794-abd8-4a4e-855c-77769b43a6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:46.168017 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae181794-abd8-4a4e-855c-77769b43a6ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:46.169836 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae181794-abd8-4a4e-855c-77769b43a6ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:46.176539 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae181794-abd8-4a4e-855c-77769b43a6ce admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:46.352966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 715/1434] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:30:46 2022] POST /identity/v3/projects => generated 389 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:46.358647 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c9502-8141-4110-9230-39bb96f23671 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:46.373215 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c9502-8141-4110-9230-39bb96f23671 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:46.580523 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753031aa-92a1-4763-ac26-14d7fe724412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:46.584968 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753031aa-92a1-4763-ac26-14d7fe724412 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:46.585500 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753031aa-92a1-4763-ac26-14d7fe724412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:46.586002 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753031aa-92a1-4763-ac26-14d7fe724412 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:46.587123 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753031aa-92a1-4763-ac26-14d7fe724412 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:46.596095 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753031aa-92a1-4763-ac26-14d7fe724412 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:46.617177 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae181794-abd8-4a4e-855c-77769b43a6ce admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:46.619487 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-ae181794-abd8-4a4e-855c-77769b43a6ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:46.661126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae181794-abd8-4a4e-855c-77769b43a6ce admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:46.665026 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 720/1435] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:30:46 2022] POST /identity/v3/users => generated 295 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:46.671249 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753031aa-92a1-4763-ac26-14d7fe724412 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:46.686800 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753031aa-92a1-4763-ac26-14d7fe724412 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:46.691393 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667b3b0-5b43-4083-ba30-3d22a8bddef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:46.695557 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667b3b0-5b43-4083-ba30-3d22a8bddef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:46.697002 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667b3b0-5b43-4083-ba30-3d22a8bddef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:46.697289 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667b3b0-5b43-4083-ba30-3d22a8bddef5 admin admin] PATH_INFO: `/v3/users/5662025c0d154c17843c58195cfb5422` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:46.702549 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c667b3b0-5b43-4083-ba30-3d22a8bddef5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5662025c0d154c17843c58195cfb5422)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:46.707031 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c667b3b0-5b43-4083-ba30-3d22a8bddef5 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:46.712912 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a671c-15ad-477f-ac51-28421fd8258f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:46.714681 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a671c-15ad-477f-ac51-28421fd8258f admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:46.716923 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a671c-15ad-477f-ac51-28421fd8258f admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:46.718094 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a671c-15ad-477f-ac51-28421fd8258f admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:46.721522 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a671c-15ad-477f-ac51-28421fd8258f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:46.727048 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a671c-15ad-477f-ac51-28421fd8258f admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:46.780157 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 721/1436] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:46.786449 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a671c-15ad-477f-ac51-28421fd8258f admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:46.817673 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a671c-15ad-477f-ac51-28421fd8258f admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:46.831427 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2aeace-ec4a-49da-b5ef-fbb6507e6294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:46.832505 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2aeace-ec4a-49da-b5ef-fbb6507e6294 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:46.832971 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2aeace-ec4a-49da-b5ef-fbb6507e6294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:46.833394 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2aeace-ec4a-49da-b5ef-fbb6507e6294 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:46.834189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2aeace-ec4a-49da-b5ef-fbb6507e6294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:46.836933 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2aeace-ec4a-49da-b5ef-fbb6507e6294 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:46.840858 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-c667b3b0-5b43-4083-ba30-3d22a8bddef5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5662025c0d154c17843c58195cfb5422'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:46.842592 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-c667b3b0-5b43-4083-ba30-3d22a8bddef5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5662025c0d154c17843c58195cfb5422'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:46.870026 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 722/1437] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:46.871174 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2aeace-ec4a-49da-b5ef-fbb6507e6294 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:46.888611 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-1d2aeace-ec4a-49da-b5ef-fbb6507e6294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:46.892914 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-c667b3b0-5b43-4083-ba30-3d22a8bddef5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5662025c0d154c17843c58195cfb5422'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:46.893841 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-c667b3b0-5b43-4083-ba30-3d22a8bddef5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5662025c0d154c17843c58195cfb5422'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:46.928781 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-c667b3b0-5b43-4083-ba30-3d22a8bddef5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5662025c0d154c17843c58195cfb5422'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:46.960583 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2aeace-ec4a-49da-b5ef-fbb6507e6294 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:46.981207 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb9462a-6034-4997-b8f4-91f907d38ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:46.982266 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9462a-6034-4997-b8f4-91f907d38ad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:46.982751 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 716/1438] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:30:46 2022] DELETE /identity/v3/users/5662025c0d154c17843c58195cfb5422 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:30:46.983370 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9462a-6034-4997-b8f4-91f907d38ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:46.983370 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9462a-6034-4997-b8f4-91f907d38ad4 admin admin] PATH_INFO: `/v3/projects/4e9b3012cdde40a18d83f98ac7fb982c/users/282ca78baea742f59cdf6d7f3aedc299/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:46.988736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba911b4-0edf-458e-881e-8f88fdef3e6e None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:46.991281 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba911b4-0edf-458e-881e-8f88fdef3e6e None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:46.993679 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba911b4-0edf-458e-881e-8f88fdef3e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:47.004502 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:47.037704 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb9462a-6034-4997-b8f4-91f907d38ad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e9b3012cdde40a18d83f98ac7fb982c, user_id=282ca78baea742f59cdf6d7f3aedc299, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:47.041925 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb9462a-6034-4997-b8f4-91f907d38ad4 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:47.081584 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 723/1439] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:46 2022] PUT /identity/v3/projects/4e9b3012cdde40a18d83f98ac7fb982c/users/282ca78baea742f59cdf6d7f3aedc299/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:47.093358 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62657fee-af76-4f28-933a-d1c9e07f2dd6 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:47.093830 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62657fee-af76-4f28-933a-d1c9e07f2dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:47.094563 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62657fee-af76-4f28-933a-d1c9e07f2dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:47.112660 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-2ba911b4-0edf-458e-881e-8f88fdef3e6e None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:47.114369 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-2ba911b4-0edf-458e-881e-8f88fdef3e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:47.191178 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-62657fee-af76-4f28-933a-d1c9e07f2dd6 None None] MFA Rules not processed for user `282ca78baea742f59cdf6d7f3aedc299`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:47.194989 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-62657fee-af76-4f28-933a-d1c9e07f2dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:47.404332 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 717/1440] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:47.505641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 724/1441] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:47.509188 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba911b4-0edf-458e-881e-8f88fdef3e6e None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:47.523228 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba911b4-0edf-458e-881e-8f88fdef3e6e None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:47.546243 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ee3cd-8809-4f23-9282-bb5b6c0a0f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:47.547784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ee3cd-8809-4f23-9282-bb5b6c0a0f6e admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:47.548173 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ee3cd-8809-4f23-9282-bb5b6c0a0f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:47.548984 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ee3cd-8809-4f23-9282-bb5b6c0a0f6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:47.549759 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ee3cd-8809-4f23-9282-bb5b6c0a0f6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:47.555432 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ee3cd-8809-4f23-9282-bb5b6c0a0f6e admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:47.568617 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62657fee-af76-4f28-933a-d1c9e07f2dd6 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:47.570388 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-62657fee-af76-4f28-933a-d1c9e07f2dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:47.677643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 718/1442] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:30:47 2022] POST /identity/v3/projects => generated 389 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:47.678961 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ee3cd-8809-4f23-9282-bb5b6c0a0f6e admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:47.718517 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62657fee-af76-4f28-933a-d1c9e07f2dd6 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:47.792372 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:47.861193 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ee3cd-8809-4f23-9282-bb5b6c0a0f6e admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:47.867431 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb3b0f-a860-4784-9c72-211a7a257a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:47.868627 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb3b0f-a860-4784-9c72-211a7a257a79 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:47.868627 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb3b0f-a860-4784-9c72-211a7a257a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:47.868977 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb3b0f-a860-4784-9c72-211a7a257a79 admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:47.869708 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb3b0f-a860-4784-9c72-211a7a257a79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:47.873067 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb3b0f-a860-4784-9c72-211a7a257a79 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:47.919446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d5362-4815-49cd-aa7d-02d97aafb3e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:47.921393 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d5362-4815-49cd-aa7d-02d97aafb3e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:47.924083 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d5362-4815-49cd-aa7d-02d97aafb3e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:47.925874 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d5362-4815-49cd-aa7d-02d97aafb3e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:47.946493 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 719/1443] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:30:47 2022] POST /identity/v3/users => generated 301 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:47.956462 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb3b0f-a860-4784-9c72-211a7a257a79 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:47.973346 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d5362-4815-49cd-aa7d-02d97aafb3e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:47.976196 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d5362-4815-49cd-aa7d-02d97aafb3e9 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:47.977529 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb3b0f-a860-4784-9c72-211a7a257a79 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:47.988177 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7649bd-6de5-453f-a6ca-c22c16b69b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:47.990889 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7649bd-6de5-453f-a6ca-c22c16b69b64 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:47.990889 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7649bd-6de5-453f-a6ca-c22c16b69b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:47.991108 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7649bd-6de5-453f-a6ca-c22c16b69b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:47.997184 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7649bd-6de5-453f-a6ca-c22c16b69b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:47.999559 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7649bd-6de5-453f-a6ca-c22c16b69b64 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:48.025662 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 720/1444] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:48.026764 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7649bd-6de5-453f-a6ca-c22c16b69b64 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:48.027992 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 725/1445] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 20:30:48.052520 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7649bd-6de5-453f-a6ca-c22c16b69b64 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:48.073831 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e388266-890d-45f3-978e-dcba254cca6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:48.075289 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e388266-890d-45f3-978e-dcba254cca6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:48.076393 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e388266-890d-45f3-978e-dcba254cca6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:48.079500 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e388266-890d-45f3-978e-dcba254cca6d admin admin] PATH_INFO: `/v3/projects/7ff3e4f60a0b40859c3790a937bb3269/users/c7b9beb459444274a232064d7f2fe8d3/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:48.596224 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e388266-890d-45f3-978e-dcba254cca6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff3e4f60a0b40859c3790a937bb3269, user_id=c7b9beb459444274a232064d7f2fe8d3, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:48.600390 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e388266-890d-45f3-978e-dcba254cca6d admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:48.652335 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 721/1446] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:48 2022] PUT /identity/v3/projects/7ff3e4f60a0b40859c3790a937bb3269/users/c7b9beb459444274a232064d7f2fe8d3/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:48.656260 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d5362-4815-49cd-aa7d-02d97aafb3e9 service neutron] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:48.682454 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d5362-4815-49cd-aa7d-02d97aafb3e9 service neutron] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:48.816361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:48.929278 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaeeb1a-8406-41a1-8da0-8edc22feee7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:48.961899 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaeeb1a-8406-41a1-8da0-8edc22feee7f admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:48.963118 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaeeb1a-8406-41a1-8da0-8edc22feee7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:48.965930 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaeeb1a-8406-41a1-8da0-8edc22feee7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:48.966646 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaeeb1a-8406-41a1-8da0-8edc22feee7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:48.972224 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaeeb1a-8406-41a1-8da0-8edc22feee7f admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:49.023752 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 726/1447] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:49.028304 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e388266-890d-45f3-978e-dcba254cca6d admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:49.042727 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e388266-890d-45f3-978e-dcba254cca6d admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:49.057853 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba6a2c-fa07-4e5d-9d83-d12644cebc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:49.059029 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba6a2c-fa07-4e5d-9d83-d12644cebc2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:49.059205 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba6a2c-fa07-4e5d-9d83-d12644cebc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:49.061302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba6a2c-fa07-4e5d-9d83-d12644cebc2e admin admin] PATH_INFO: `/v3/projects/7ff3e4f60a0b40859c3790a937bb3269/users/c7b9beb459444274a232064d7f2fe8d3/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:49.066960 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba6a2c-fa07-4e5d-9d83-d12644cebc2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff3e4f60a0b40859c3790a937bb3269, user_id=c7b9beb459444274a232064d7f2fe8d3, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:49.071506 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba6a2c-fa07-4e5d-9d83-d12644cebc2e admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:49.097648 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 722/1448] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:49 2022] PUT /identity/v3/projects/7ff3e4f60a0b40859c3790a937bb3269/users/c7b9beb459444274a232064d7f2fe8d3/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:49.107759 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c1265-f2b4-4f67-8fa8-8a27cfdd6c8a None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:49.108507 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c1265-f2b4-4f67-8fa8-8a27cfdd6c8a None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:49.109063 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c1265-f2b4-4f67-8fa8-8a27cfdd6c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:49.190910 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-5b2c1265-f2b4-4f67-8fa8-8a27cfdd6c8a None None] MFA Rules not processed for user `c7b9beb459444274a232064d7f2fe8d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:49.192135 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-5b2c1265-f2b4-4f67-8fa8-8a27cfdd6c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:49.543135 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 727/1449] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:49 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:49.557069 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba6a2c-fa07-4e5d-9d83-d12644cebc2e admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:49.560148 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-a8ba6a2c-fa07-4e5d-9d83-d12644cebc2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:49.788489 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba6a2c-fa07-4e5d-9d83-d12644cebc2e admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:49.811709 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f81037-9da9-4c83-9848-f26022a5e520 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:49.814733 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f81037-9da9-4c83-9848-f26022a5e520 service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:49.815032 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f81037-9da9-4c83-9848-f26022a5e520 service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:49.815308 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f81037-9da9-4c83-9848-f26022a5e520 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:49.851023 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f81037-9da9-4c83-9848-f26022a5e520 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:49.854323 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f81037-9da9-4c83-9848-f26022a5e520 service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:49.903955 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 723/1450] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:49 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 20:30:50.291885 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c1265-f2b4-4f67-8fa8-8a27cfdd6c8a None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:50.458546 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c1265-f2b4-4f67-8fa8-8a27cfdd6c8a None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:50.477230 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12975d-195e-4c44-898f-d07219f92173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:50.479188 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12975d-195e-4c44-898f-d07219f92173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:50.479654 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12975d-195e-4c44-898f-d07219f92173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:50.480088 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12975d-195e-4c44-898f-d07219f92173 admin admin] PATH_INFO: `/v3/users/282ca78baea742f59cdf6d7f3aedc299` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:50.482994 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12975d-195e-4c44-898f-d07219f92173 admin admin] RBAC: Authorizing `identity:delete_user(user_id=282ca78baea742f59cdf6d7f3aedc299)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:50.491344 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12975d-195e-4c44-898f-d07219f92173 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:50.643197 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-bc12975d-195e-4c44-898f-d07219f92173 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '282ca78baea742f59cdf6d7f3aedc299'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:50.649239 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-bc12975d-195e-4c44-898f-d07219f92173 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '282ca78baea742f59cdf6d7f3aedc299'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:50.711499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:50.745927 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-bc12975d-195e-4c44-898f-d07219f92173 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '282ca78baea742f59cdf6d7f3aedc299'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:50.749382 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-bc12975d-195e-4c44-898f-d07219f92173 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '282ca78baea742f59cdf6d7f3aedc299'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:50.775109 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-bc12975d-195e-4c44-898f-d07219f92173 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '282ca78baea742f59cdf6d7f3aedc299'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:50.824250 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 728/1451] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:30:50 2022] DELETE /identity/v3/users/282ca78baea742f59cdf6d7f3aedc299 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:50.832559 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbe6ba-b1d0-4265-ab1d-e6cc6f63446e None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:50.833672 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbe6ba-b1d0-4265-ab1d-e6cc6f63446e None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:50.834287 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbe6ba-b1d0-4265-ab1d-e6cc6f63446e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:50.949070 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-9efbe6ba-b1d0-4265-ab1d-e6cc6f63446e None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:50.952576 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-9efbe6ba-b1d0-4265-ab1d-e6cc6f63446e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:51.289382 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 724/1452] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:51.407828 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12975d-195e-4c44-898f-d07219f92173 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:51.418958 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-bc12975d-195e-4c44-898f-d07219f92173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:51.476474 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efbe6ba-b1d0-4265-ab1d-e6cc6f63446e None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:51.478369 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-9efbe6ba-b1d0-4265-ab1d-e6cc6f63446e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:51.501664 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efbe6ba-b1d0-4265-ab1d-e6cc6f63446e None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:51.536332 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899dea8-cd95-4efe-8439-6598e10c684e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:51.538331 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899dea8-cd95-4efe-8439-6598e10c684e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:51.539539 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899dea8-cd95-4efe-8439-6598e10c684e admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:51.541390 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899dea8-cd95-4efe-8439-6598e10c684e admin admin] PATH_INFO: `/v3/projects/9723cf0574a2470586229fc76603cdb2` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:51.545418 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899dea8-cd95-4efe-8439-6598e10c684e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9723cf0574a2470586229fc76603cdb2)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:51.572771 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899dea8-cd95-4efe-8439-6598e10c684e admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:51.614980 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:51.702512 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12975d-195e-4c44-898f-d07219f92173 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:51.735689 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-d899dea8-cd95-4efe-8439-6598e10c684e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9723cf0574a2470586229fc76603cdb2', 'request_id': 'req-d899dea8-cd95-4efe-8439-6598e10c684e'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:51.751333 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-d899dea8-cd95-4efe-8439-6598e10c684e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9723cf0574a2470586229fc76603cdb2', 'request_id': 'req-d899dea8-cd95-4efe-8439-6598e10c684e'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:51.769869 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-d899dea8-cd95-4efe-8439-6598e10c684e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9723cf0574a2470586229fc76603cdb2', 'request_id': 'req-d899dea8-cd95-4efe-8439-6598e10c684e'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:51.788696 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc8200-716f-45a1-ba51-82aa198f3cd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:51.789786 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc8200-716f-45a1-ba51-82aa198f3cd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:51.790710 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc8200-716f-45a1-ba51-82aa198f3cd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:51.791011 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc8200-716f-45a1-ba51-82aa198f3cd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:51.810084 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-d899dea8-cd95-4efe-8439-6598e10c684e admin admin] The token cache is being invalidate because project 9723cf0574a2470586229fc76603cdb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:30:51.810084 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-d899dea8-cd95-4efe-8439-6598e10c684e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:51.810084 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-d899dea8-cd95-4efe-8439-6598e10c684e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:51.810084 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 725/1453] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:30:51 2022] DELETE /identity/v3/projects/9723cf0574a2470586229fc76603cdb2 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:30:51.813703 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899dea8-cd95-4efe-8439-6598e10c684e admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:51.830168 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-d899dea8-cd95-4efe-8439-6598e10c684e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:51.972688 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899dea8-cd95-4efe-8439-6598e10c684e admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:51.978890 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1c7e7-e32e-43f7-8236-d50e52b739c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:51.979713 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1c7e7-e32e-43f7-8236-d50e52b739c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:51.980161 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1c7e7-e32e-43f7-8236-d50e52b739c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:51.980573 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1c7e7-e32e-43f7-8236-d50e52b739c0 admin admin] PATH_INFO: `/v3/users/8a32ce215950453f980b27c7b83624f5` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:51.982690 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1c7e7-e32e-43f7-8236-d50e52b739c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a32ce215950453f980b27c7b83624f5)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:51.985607 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1c7e7-e32e-43f7-8236-d50e52b739c0 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:52.003970 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc8200-716f-45a1-ba51-82aa198f3cd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:52.015957 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc8200-716f-45a1-ba51-82aa198f3cd5 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:52.029849 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 729/1454] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:52.031442 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38b2e8-e120-4db4-91da-0ca47f6e9172 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:52.031802 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38b2e8-e120-4db4-91da-0ca47f6e9172 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:52.032866 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38b2e8-e120-4db4-91da-0ca47f6e9172 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:52.034430 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 730/1455] 10.222.0.23 () {54 vars in 921 bytes} [Wed Nov 2 20:30:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:30:52.093156 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-fce1c7e7-e32e-43f7-8236-d50e52b739c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a32ce215950453f980b27c7b83624f5'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:52.093752 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-fce1c7e7-e32e-43f7-8236-d50e52b739c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a32ce215950453f980b27c7b83624f5'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:52.114014 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-fce1c7e7-e32e-43f7-8236-d50e52b739c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a32ce215950453f980b27c7b83624f5'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:52.115981 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-fce1c7e7-e32e-43f7-8236-d50e52b739c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a32ce215950453f980b27c7b83624f5'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:52.133531 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-fce1c7e7-e32e-43f7-8236-d50e52b739c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a32ce215950453f980b27c7b83624f5'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:52.153300 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 726/1456] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:30:51 2022] DELETE /identity/v3/users/8a32ce215950453f980b27c7b83624f5 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:52.203938 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0775edc-5d6c-400a-96fd-4b7b0bdad7d2 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:52.205037 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0775edc-5d6c-400a-96fd-4b7b0bdad7d2 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:52.205455 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0775edc-5d6c-400a-96fd-4b7b0bdad7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:52.254934 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-b0775edc-5d6c-400a-96fd-4b7b0bdad7d2 None None] MFA Rules not processed for user `f906fd11db004026a78eb3d69fa5b298`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:52.257733 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-b0775edc-5d6c-400a-96fd-4b7b0bdad7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:52.321010 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475d477-2106-43dc-a630-c84523b5475d None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:52.321365 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475d477-2106-43dc-a630-c84523b5475d None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:52.321573 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475d477-2106-43dc-a630-c84523b5475d None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:52.323022 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 727/1457] 10.222.0.23 () {54 vars in 921 bytes} [Wed Nov 2 20:30:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 20:30:52.374480 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:52.425255 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 731/1458] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Nov 2 20:30:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:52.512261 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c860ef6-ed5f-4ee3-abea-4b2b2f0b6b4f None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:52.513652 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c860ef6-ed5f-4ee3-abea-4b2b2f0b6b4f None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:52.513945 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c860ef6-ed5f-4ee3-abea-4b2b2f0b6b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:52.581752 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-4c860ef6-ed5f-4ee3-abea-4b2b2f0b6b4f None None] MFA Rules not processed for user `f906fd11db004026a78eb3d69fa5b298`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:52.583008 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-4c860ef6-ed5f-4ee3-abea-4b2b2f0b6b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:52.620336 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 728/1459] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Nov 2 20:30:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:30:52.626808 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0775edc-5d6c-400a-96fd-4b7b0bdad7d2 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:52.628434 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-b0775edc-5d6c-400a-96fd-4b7b0bdad7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:52.879107 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0775edc-5d6c-400a-96fd-4b7b0bdad7d2 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:52.911871 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2c17d-a3f3-4ed7-a27d-06681947b06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:52.912612 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2c17d-a3f3-4ed7-a27d-06681947b06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:52.916071 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2c17d-a3f3-4ed7-a27d-06681947b06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:52.917017 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2c17d-a3f3-4ed7-a27d-06681947b06f admin admin] PATH_INFO: `/v3/users/d29e2c0e8aab45a38964be7c806bc1d6` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:52.921624 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2c17d-a3f3-4ed7-a27d-06681947b06f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d29e2c0e8aab45a38964be7c806bc1d6)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:52.927931 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2c17d-a3f3-4ed7-a27d-06681947b06f admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:53.045322 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c860ef6-ed5f-4ee3-abea-4b2b2f0b6b4f None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:53.047732 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-4c860ef6-ed5f-4ee3-abea-4b2b2f0b6b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:53.078300 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c860ef6-ed5f-4ee3-abea-4b2b2f0b6b4f None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:53.082657 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-2ad2c17d-a3f3-4ed7-a27d-06681947b06f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd29e2c0e8aab45a38964be7c806bc1d6'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:53.083569 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-2ad2c17d-a3f3-4ed7-a27d-06681947b06f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd29e2c0e8aab45a38964be7c806bc1d6'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:53.090188 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3d32b-0c91-4301-abf5-03585880467b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:53.091926 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3d32b-0c91-4301-abf5-03585880467b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:53.092538 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3d32b-0c91-4301-abf5-03585880467b admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:53.092843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3d32b-0c91-4301-abf5-03585880467b admin admin] PATH_INFO: `/v3/users/615147571be7443cb392cd9f6f6be55e` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:53.095731 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3d32b-0c91-4301-abf5-03585880467b admin admin] RBAC: Authorizing `identity:delete_user(user_id=615147571be7443cb392cd9f6f6be55e)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:53.099799 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3d32b-0c91-4301-abf5-03585880467b admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:53.121669 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:53.124368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-2ad2c17d-a3f3-4ed7-a27d-06681947b06f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd29e2c0e8aab45a38964be7c806bc1d6'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:53.126926 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-2ad2c17d-a3f3-4ed7-a27d-06681947b06f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd29e2c0e8aab45a38964be7c806bc1d6'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:53.144688 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-2ad2c17d-a3f3-4ed7-a27d-06681947b06f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd29e2c0e8aab45a38964be7c806bc1d6'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:53.175944 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 732/1460] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:30:52 2022] DELETE /identity/v3/users/d29e2c0e8aab45a38964be7c806bc1d6 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:53.178500 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd574f7d-f121-49f9-9927-9ef7482a6d20 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:53.178770 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd574f7d-f121-49f9-9927-9ef7482a6d20 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:53.179577 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd574f7d-f121-49f9-9927-9ef7482a6d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:53.223365 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-aea3d32b-0c91-4301-abf5-03585880467b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '615147571be7443cb392cd9f6f6be55e'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:53.226279 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-aea3d32b-0c91-4301-abf5-03585880467b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '615147571be7443cb392cd9f6f6be55e'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:53.241008 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-bd574f7d-f121-49f9-9927-9ef7482a6d20 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:53.243929 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-bd574f7d-f121-49f9-9927-9ef7482a6d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:53.244614 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-aea3d32b-0c91-4301-abf5-03585880467b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '615147571be7443cb392cd9f6f6be55e'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:53.258419 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-aea3d32b-0c91-4301-abf5-03585880467b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '615147571be7443cb392cd9f6f6be55e'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:53.285722 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-aea3d32b-0c91-4301-abf5-03585880467b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '615147571be7443cb392cd9f6f6be55e'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:53.308536 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 729/1461] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:30:53 2022] DELETE /identity/v3/users/615147571be7443cb392cd9f6f6be55e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:30:53.312581 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29cf6d-ff20-459b-abaa-d0936b47149e None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:53.313671 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29cf6d-ff20-459b-abaa-d0936b47149e None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:53.315026 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29cf6d-ff20-459b-abaa-d0936b47149e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:53.326266 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:53.349872 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-ae29cf6d-ff20-459b-abaa-d0936b47149e None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:53.351365 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-ae29cf6d-ff20-459b-abaa-d0936b47149e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:53.358430 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 733/1462] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:53.449280 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 730/1463] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:53.466151 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd574f7d-f121-49f9-9927-9ef7482a6d20 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:53.470207 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-bd574f7d-f121-49f9-9927-9ef7482a6d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:53.486372 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29cf6d-ff20-459b-abaa-d0936b47149e None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:53.488446 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-ae29cf6d-ff20-459b-abaa-d0936b47149e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:53.587741 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29cf6d-ff20-459b-abaa-d0936b47149e None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:53.594301 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66772dd-c497-46a5-8046-aced498122d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:53.595877 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66772dd-c497-46a5-8046-aced498122d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:53.596137 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66772dd-c497-46a5-8046-aced498122d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:53.596671 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66772dd-c497-46a5-8046-aced498122d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:53.610838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66772dd-c497-46a5-8046-aced498122d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:53.613289 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66772dd-c497-46a5-8046-aced498122d0 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:53.664030 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd574f7d-f121-49f9-9927-9ef7482a6d20 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:53.682824 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b86624-dcf0-4465-a18e-2b62466e5c88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:53.685086 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b86624-dcf0-4465-a18e-2b62466e5c88 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:53.686369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b86624-dcf0-4465-a18e-2b62466e5c88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:53.687051 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b86624-dcf0-4465-a18e-2b62466e5c88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:53.701330 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 731/1464] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:53.706877 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66772dd-c497-46a5-8046-aced498122d0 service neutron] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:53.711055 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-b66772dd-c497-46a5-8046-aced498122d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:53.731565 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b86624-dcf0-4465-a18e-2b62466e5c88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:53.740094 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b86624-dcf0-4465-a18e-2b62466e5c88 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:53.779783 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 734/1465] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:53.832084 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:53.951257 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66772dd-c497-46a5-8046-aced498122d0 service neutron] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:53.981526 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b86624-dcf0-4465-a18e-2b62466e5c88 service neutron] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:53.983629 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-22b86624-dcf0-4465-a18e-2b62466e5c88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:53.988105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f29d9-213d-4946-8359-c2ef918c5f07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:53.989234 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f29d9-213d-4946-8359-c2ef918c5f07 service nova] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:53.989521 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f29d9-213d-4946-8359-c2ef918c5f07 service nova] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:53.991715 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f29d9-213d-4946-8359-c2ef918c5f07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:53.996350 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-2f9f29d9-213d-4946-8359-c2ef918c5f07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:54.015490 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b86624-dcf0-4465-a18e-2b62466e5c88 service neutron] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:54.030536 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fe0c1-f8b2-4c49-bcf5-ce33748c7ef3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:54.033641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f29d9-213d-4946-8359-c2ef918c5f07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:54.036783 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fe0c1-f8b2-4c49-bcf5-ce33748c7ef3 service nova] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:54.036783 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fe0c1-f8b2-4c49-bcf5-ce33748c7ef3 service nova] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:54.037107 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fe0c1-f8b2-4c49-bcf5-ce33748c7ef3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:54.038389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f29d9-213d-4946-8359-c2ef918c5f07 service nova] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:54.040332 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-ca0fe0c1-f8b2-4c49-bcf5-ce33748c7ef3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:54.072245 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 732/1466] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:54.085122 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0fe0c1-f8b2-4c49-bcf5-ce33748c7ef3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:54.091994 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0fe0c1-f8b2-4c49-bcf5-ce33748c7ef3 service nova] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:54.131598 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 735/1467] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:54.352450 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f29d9-213d-4946-8359-c2ef918c5f07 service nova] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:54.354486 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-2f9f29d9-213d-4946-8359-c2ef918c5f07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:54.400049 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f29d9-213d-4946-8359-c2ef918c5f07 service nova] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:54.419855 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4366032-8fdf-41f5-8f7b-a25a87281765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:54.421224 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4366032-8fdf-41f5-8f7b-a25a87281765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:54.423437 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4366032-8fdf-41f5-8f7b-a25a87281765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:54.425764 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4366032-8fdf-41f5-8f7b-a25a87281765 admin admin] PATH_INFO: `/v3/projects/a332e5db39574e619d483b4710faf6c7` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:54.427523 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4366032-8fdf-41f5-8f7b-a25a87281765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a332e5db39574e619d483b4710faf6c7)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:54.434102 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4366032-8fdf-41f5-8f7b-a25a87281765 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:54.555679 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-f4366032-8fdf-41f5-8f7b-a25a87281765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a332e5db39574e619d483b4710faf6c7', 'request_id': 'req-f4366032-8fdf-41f5-8f7b-a25a87281765'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:54.567280 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-f4366032-8fdf-41f5-8f7b-a25a87281765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a332e5db39574e619d483b4710faf6c7', 'request_id': 'req-f4366032-8fdf-41f5-8f7b-a25a87281765'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:54.593255 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-f4366032-8fdf-41f5-8f7b-a25a87281765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a332e5db39574e619d483b4710faf6c7', 'request_id': 'req-f4366032-8fdf-41f5-8f7b-a25a87281765'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:54.622013 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-f4366032-8fdf-41f5-8f7b-a25a87281765 admin admin] The token cache is being invalidate because project a332e5db39574e619d483b4710faf6c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:30:54.622514 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-f4366032-8fdf-41f5-8f7b-a25a87281765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:54.623783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-f4366032-8fdf-41f5-8f7b-a25a87281765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:54.632386 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 733/1468] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:30:54 2022] DELETE /identity/v3/projects/a332e5db39574e619d483b4710faf6c7 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:54.632910 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930e14d-ecbd-4aeb-a43a-517d3c0e8bad None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:54.633380 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930e14d-ecbd-4aeb-a43a-517d3c0e8bad None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:54.633787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930e14d-ecbd-4aeb-a43a-517d3c0e8bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:54.688855 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-1930e14d-ecbd-4aeb-a43a-517d3c0e8bad None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:54.690968 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-1930e14d-ecbd-4aeb-a43a-517d3c0e8bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:54.730617 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4366032-8fdf-41f5-8f7b-a25a87281765 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:54.732050 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-f4366032-8fdf-41f5-8f7b-a25a87281765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:54.789316 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 736/1469] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:54.800764 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a6256-8c04-4769-84c0-ee34d9e2deb2 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:54.801052 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a6256-8c04-4769-84c0-ee34d9e2deb2 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:54.801356 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a6256-8c04-4769-84c0-ee34d9e2deb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:54.842255 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-cf9a6256-8c04-4769-84c0-ee34d9e2deb2 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:54.843610 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-cf9a6256-8c04-4769-84c0-ee34d9e2deb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:54.856046 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4366032-8fdf-41f5-8f7b-a25a87281765 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:54.862728 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f279074-f072-43ca-b37b-32dc5f5f12c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:54.865456 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f279074-f072-43ca-b37b-32dc5f5f12c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:54.865456 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f279074-f072-43ca-b37b-32dc5f5f12c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:54.865456 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f279074-f072-43ca-b37b-32dc5f5f12c6 admin admin] PATH_INFO: `/v3/projects/aa2fa1fa6cf642a6a96d0a87ce902876` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:54.865456 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f279074-f072-43ca-b37b-32dc5f5f12c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa2fa1fa6cf642a6a96d0a87ce902876)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:54.867411 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f279074-f072-43ca-b37b-32dc5f5f12c6 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:54.872960 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 737/1470] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:30:54.878997 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a6256-8c04-4769-84c0-ee34d9e2deb2 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:54.891060 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a6256-8c04-4769-84c0-ee34d9e2deb2 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:54.898395 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dead5ec-18f6-4090-abac-64105ed207a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:54.899201 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dead5ec-18f6-4090-abac-64105ed207a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:54.899489 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dead5ec-18f6-4090-abac-64105ed207a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:54.899772 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dead5ec-18f6-4090-abac-64105ed207a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:54.900431 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dead5ec-18f6-4090-abac-64105ed207a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:30:54.900764 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dead5ec-18f6-4090-abac-64105ed207a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:54.904160 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dead5ec-18f6-4090-abac-64105ed207a2 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:54.930600 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 738/1471] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:30:54.931624 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dead5ec-18f6-4090-abac-64105ed207a2 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:54.945685 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dead5ec-18f6-4090-abac-64105ed207a2 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:54.952084 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:54.969957 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-2f279074-f072-43ca-b37b-32dc5f5f12c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa2fa1fa6cf642a6a96d0a87ce902876', 'request_id': 'req-2f279074-f072-43ca-b37b-32dc5f5f12c6'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:54.985479 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-2f279074-f072-43ca-b37b-32dc5f5f12c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa2fa1fa6cf642a6a96d0a87ce902876', 'request_id': 'req-2f279074-f072-43ca-b37b-32dc5f5f12c6'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:55.001253 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-2f279074-f072-43ca-b37b-32dc5f5f12c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa2fa1fa6cf642a6a96d0a87ce902876', 'request_id': 'req-2f279074-f072-43ca-b37b-32dc5f5f12c6'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:55.019523 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-2f279074-f072-43ca-b37b-32dc5f5f12c6 admin admin] The token cache is being invalidate because project aa2fa1fa6cf642a6a96d0a87ce902876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:30:55.019523 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-2f279074-f072-43ca-b37b-32dc5f5f12c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:55.020509 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-2f279074-f072-43ca-b37b-32dc5f5f12c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:55.025247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 734/1472] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:30:54 2022] DELETE /identity/v3/projects/aa2fa1fa6cf642a6a96d0a87ce902876 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:30:55.026664 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f279074-f072-43ca-b37b-32dc5f5f12c6 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:55.027870 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-2f279074-f072-43ca-b37b-32dc5f5f12c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:55.069667 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6cfa6-332d-4f09-b60c-14ef55375c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:55.070370 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6cfa6-332d-4f09-b60c-14ef55375c51 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:55.070658 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6cfa6-332d-4f09-b60c-14ef55375c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:55.070934 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6cfa6-332d-4f09-b60c-14ef55375c51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:55.071895 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6cfa6-332d-4f09-b60c-14ef55375c51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:55.074209 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6cfa6-332d-4f09-b60c-14ef55375c51 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:55.096685 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:55.130992 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 739/1473] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:30:54 2022] POST /identity/v3/projects => generated 401 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:55.136011 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6cfa6-332d-4f09-b60c-14ef55375c51 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:55.146122 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-8ad6cfa6-332d-4f09-b60c-14ef55375c51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:55.146997 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f279074-f072-43ca-b37b-32dc5f5f12c6 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:55.246230 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6cfa6-332d-4f09-b60c-14ef55375c51 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:55.251986 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ccedd-667a-4811-a421-90ebf6076512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:55.252918 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ccedd-667a-4811-a421-90ebf6076512 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:55.253268 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ccedd-667a-4811-a421-90ebf6076512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:55.253618 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ccedd-667a-4811-a421-90ebf6076512 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:55.254121 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02a4a0-7a45-43f2-b247-ea8e5e49f873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:55.254548 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ccedd-667a-4811-a421-90ebf6076512 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:55.255741 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02a4a0-7a45-43f2-b247-ea8e5e49f873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:55.256098 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02a4a0-7a45-43f2-b247-ea8e5e49f873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:55.256574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02a4a0-7a45-43f2-b247-ea8e5e49f873 admin admin] PATH_INFO: `/v3/users/824a52dcc6e24f9a90cce7d541f399ef` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:55.257596 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ccedd-667a-4811-a421-90ebf6076512 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:55.258010 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02a4a0-7a45-43f2-b247-ea8e5e49f873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=824a52dcc6e24f9a90cce7d541f399ef)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:55.261027 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02a4a0-7a45-43f2-b247-ea8e5e49f873 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:55.291333 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 740/1474] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:30:55 2022] POST /identity/v3/users => generated 301 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:30:55.296001 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ccedd-667a-4811-a421-90ebf6076512 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:55.312797 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ccedd-667a-4811-a421-90ebf6076512 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:55.338564 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6f384-2a88-43e8-b59f-2b607dd3eab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:55.338564 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6f384-2a88-43e8-b59f-2b607dd3eab1 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:55.338564 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6f384-2a88-43e8-b59f-2b607dd3eab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:55.338564 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6f384-2a88-43e8-b59f-2b607dd3eab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:55.338964 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6f384-2a88-43e8-b59f-2b607dd3eab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:55.338964 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6f384-2a88-43e8-b59f-2b607dd3eab1 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:55.344464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-ff02a4a0-7a45-43f2-b247-ea8e5e49f873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '824a52dcc6e24f9a90cce7d541f399ef'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:55.345229 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-ff02a4a0-7a45-43f2-b247-ea8e5e49f873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '824a52dcc6e24f9a90cce7d541f399ef'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:55.352744 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 741/1475] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:30:55.355822 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6f384-2a88-43e8-b59f-2b607dd3eab1 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:55.358495 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-ff02a4a0-7a45-43f2-b247-ea8e5e49f873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '824a52dcc6e24f9a90cce7d541f399ef'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:55.359560 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-d1b6f384-2a88-43e8-b59f-2b607dd3eab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:55.361336 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-ff02a4a0-7a45-43f2-b247-ea8e5e49f873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '824a52dcc6e24f9a90cce7d541f399ef'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:55.381898 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-ff02a4a0-7a45-43f2-b247-ea8e5e49f873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '824a52dcc6e24f9a90cce7d541f399ef'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:55.385269 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:55.388121 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6f384-2a88-43e8-b59f-2b607dd3eab1 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:55.396019 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599cba3-e55d-4cd4-be72-9f5eed120591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:55.397601 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599cba3-e55d-4cd4-be72-9f5eed120591 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:55.399613 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599cba3-e55d-4cd4-be72-9f5eed120591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:55.399897 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599cba3-e55d-4cd4-be72-9f5eed120591 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:55.400584 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599cba3-e55d-4cd4-be72-9f5eed120591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:55.404589 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 735/1476] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:30:55 2022] DELETE /identity/v3/users/824a52dcc6e24f9a90cce7d541f399ef => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:55.409079 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599cba3-e55d-4cd4-be72-9f5eed120591 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:55.424039 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 742/1477] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:55.426105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02a4a0-7a45-43f2-b247-ea8e5e49f873 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:55.508654 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599cba3-e55d-4cd4-be72-9f5eed120591 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:55.510818 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-3599cba3-e55d-4cd4-be72-9f5eed120591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:55.545173 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02a4a0-7a45-43f2-b247-ea8e5e49f873 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:55.552853 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a04441-ef8f-43ec-b28c-0abb2cdc1372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:55.554020 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a04441-ef8f-43ec-b28c-0abb2cdc1372 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:55.554020 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a04441-ef8f-43ec-b28c-0abb2cdc1372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:55.554201 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a04441-ef8f-43ec-b28c-0abb2cdc1372 admin admin] PATH_INFO: `/v3/projects/4254d074357f4f678851ed518716ddda/users/b15dec4102e3429abbb691d7e5a0b6cc/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:55.564096 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599cba3-e55d-4cd4-be72-9f5eed120591 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:55.574994 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a04441-ef8f-43ec-b28c-0abb2cdc1372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4254d074357f4f678851ed518716ddda, user_id=b15dec4102e3429abbb691d7e5a0b6cc, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:55.576341 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49c454-8fdb-4a4c-823c-57508f790569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:55.577059 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49c454-8fdb-4a4c-823c-57508f790569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:55.577596 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49c454-8fdb-4a4c-823c-57508f790569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:55.577868 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49c454-8fdb-4a4c-823c-57508f790569 admin admin] PATH_INFO: `/v3/projects/4e9b3012cdde40a18d83f98ac7fb982c` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:55.578929 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a04441-ef8f-43ec-b28c-0abb2cdc1372 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:55.580756 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49c454-8fdb-4a4c-823c-57508f790569 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e9b3012cdde40a18d83f98ac7fb982c)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:55.583210 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49c454-8fdb-4a4c-823c-57508f790569 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:55.601089 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 736/1478] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:55 2022] PUT /identity/v3/projects/4254d074357f4f678851ed518716ddda/users/b15dec4102e3429abbb691d7e5a0b6cc/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:55.613094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bc9f2-d862-491d-9505-fc60af8f5143 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:55.613462 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bc9f2-d862-491d-9505-fc60af8f5143 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:55.613740 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bc9f2-d862-491d-9505-fc60af8f5143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:55.658742 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-7a5bc9f2-d862-491d-9505-fc60af8f5143 None None] MFA Rules not processed for user `b15dec4102e3429abbb691d7e5a0b6cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:55.660596 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-7a5bc9f2-d862-491d-9505-fc60af8f5143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:55.663952 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-2b49c454-8fdb-4a4c-823c-57508f790569 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e9b3012cdde40a18d83f98ac7fb982c', 'request_id': 'req-2b49c454-8fdb-4a4c-823c-57508f790569'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:55.674367 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-2b49c454-8fdb-4a4c-823c-57508f790569 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e9b3012cdde40a18d83f98ac7fb982c', 'request_id': 'req-2b49c454-8fdb-4a4c-823c-57508f790569'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:55.683542 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-2b49c454-8fdb-4a4c-823c-57508f790569 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e9b3012cdde40a18d83f98ac7fb982c', 'request_id': 'req-2b49c454-8fdb-4a4c-823c-57508f790569'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:55.707671 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-2b49c454-8fdb-4a4c-823c-57508f790569 admin admin] The token cache is being invalidate because project 4e9b3012cdde40a18d83f98ac7fb982c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:30:55.708917 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-2b49c454-8fdb-4a4c-823c-57508f790569 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:55.710318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-2b49c454-8fdb-4a4c-823c-57508f790569 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:55.717606 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 743/1479] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:30:55 2022] DELETE /identity/v3/projects/4e9b3012cdde40a18d83f98ac7fb982c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:55.720021 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49c454-8fdb-4a4c-823c-57508f790569 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:55.721977 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-2b49c454-8fdb-4a4c-823c-57508f790569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:55.759816 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 737/1480] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:55 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:55.761005 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bc9f2-d862-491d-9505-fc60af8f5143 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:55.762449 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-7a5bc9f2-d862-491d-9505-fc60af8f5143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:55.783601 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:55.810835 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49c454-8fdb-4a4c-823c-57508f790569 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:55.816260 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e453c-9413-4e91-b158-aa7743151f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:55.817252 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e453c-9413-4e91-b158-aa7743151f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:55.817546 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e453c-9413-4e91-b158-aa7743151f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:55.817830 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e453c-9413-4e91-b158-aa7743151f77 admin admin] PATH_INFO: `/v3/projects/949af41049344b56811b82f94c427ab6` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:55.819002 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e453c-9413-4e91-b158-aa7743151f77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=949af41049344b56811b82f94c427ab6)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:55.821125 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e453c-9413-4e91-b158-aa7743151f77 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:55.847822 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bc9f2-d862-491d-9505-fc60af8f5143 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:55.852989 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac259c-e83a-4ebb-9eb5-042e6bd2c408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:55.853686 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac259c-e83a-4ebb-9eb5-042e6bd2c408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:55.854027 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac259c-e83a-4ebb-9eb5-042e6bd2c408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:55.854358 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac259c-e83a-4ebb-9eb5-042e6bd2c408 admin admin] PATH_INFO: `/v3/users/c7b9beb459444274a232064d7f2fe8d3` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:55.855827 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac259c-e83a-4ebb-9eb5-042e6bd2c408 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7b9beb459444274a232064d7f2fe8d3)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:55.858463 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac259c-e83a-4ebb-9eb5-042e6bd2c408 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:55.864984 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:55.895292 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-466e453c-9413-4e91-b158-aa7743151f77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '949af41049344b56811b82f94c427ab6', 'request_id': 'req-466e453c-9413-4e91-b158-aa7743151f77'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:55.902965 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-466e453c-9413-4e91-b158-aa7743151f77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '949af41049344b56811b82f94c427ab6', 'request_id': 'req-466e453c-9413-4e91-b158-aa7743151f77'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:55.912419 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-466e453c-9413-4e91-b158-aa7743151f77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '949af41049344b56811b82f94c427ab6', 'request_id': 'req-466e453c-9413-4e91-b158-aa7743151f77'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:55.916463 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-94ac259c-e83a-4ebb-9eb5-042e6bd2c408 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7b9beb459444274a232064d7f2fe8d3'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:55.917183 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-94ac259c-e83a-4ebb-9eb5-042e6bd2c408 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7b9beb459444274a232064d7f2fe8d3'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:55.924930 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-94ac259c-e83a-4ebb-9eb5-042e6bd2c408 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7b9beb459444274a232064d7f2fe8d3'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:55.925616 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-94ac259c-e83a-4ebb-9eb5-042e6bd2c408 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7b9beb459444274a232064d7f2fe8d3'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:55.927144 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-466e453c-9413-4e91-b158-aa7743151f77 admin admin] The token cache is being invalidate because project 949af41049344b56811b82f94c427ab6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:30:55.927620 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-466e453c-9413-4e91-b158-aa7743151f77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:55.928815 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-466e453c-9413-4e91-b158-aa7743151f77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:55.930153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 744/1481] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:30:55 2022] DELETE /identity/v3/projects/949af41049344b56811b82f94c427ab6 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:55.933753 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e453c-9413-4e91-b158-aa7743151f77 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:55.935652 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-466e453c-9413-4e91-b158-aa7743151f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:55.942693 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-94ac259c-e83a-4ebb-9eb5-042e6bd2c408 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7b9beb459444274a232064d7f2fe8d3'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:55.963476 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 738/1482] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:30:55 2022] DELETE /identity/v3/users/c7b9beb459444274a232064d7f2fe8d3 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:55.964752 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac259c-e83a-4ebb-9eb5-042e6bd2c408 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:55.966736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-94ac259c-e83a-4ebb-9eb5-042e6bd2c408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:56.018217 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e453c-9413-4e91-b158-aa7743151f77 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:56.043584 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac259c-e83a-4ebb-9eb5-042e6bd2c408 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:56.065226 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c9276-039c-4a00-af72-a945fb1eb7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:56.066060 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c9276-039c-4a00-af72-a945fb1eb7e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:56.066479 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c9276-039c-4a00-af72-a945fb1eb7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:56.066769 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c9276-039c-4a00-af72-a945fb1eb7e8 admin admin] PATH_INFO: `/v3/projects/172af555d16847efbb98f88aefbadda3` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:56.067928 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c9276-039c-4a00-af72-a945fb1eb7e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=172af555d16847efbb98f88aefbadda3)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:56.071567 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c9276-039c-4a00-af72-a945fb1eb7e8 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:56.096031 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7122522-dbd8-4f7a-9a45-4b1b0b72b2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:56.096900 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7122522-dbd8-4f7a-9a45-4b1b0b72b2be admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:56.097416 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7122522-dbd8-4f7a-9a45-4b1b0b72b2be admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:56.097660 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7122522-dbd8-4f7a-9a45-4b1b0b72b2be admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:56.098451 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7122522-dbd8-4f7a-9a45-4b1b0b72b2be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:56.100950 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7122522-dbd8-4f7a-9a45-4b1b0b72b2be admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:56.133491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-930c9276-039c-4a00-af72-a945fb1eb7e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '172af555d16847efbb98f88aefbadda3', 'request_id': 'req-930c9276-039c-4a00-af72-a945fb1eb7e8'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:56.140452 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 745/1483] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:30:55 2022] POST /identity/v3/projects => generated 399 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:56.142167 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7122522-dbd8-4f7a-9a45-4b1b0b72b2be admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:56.144864 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-c7122522-dbd8-4f7a-9a45-4b1b0b72b2be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:56.150060 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-930c9276-039c-4a00-af72-a945fb1eb7e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '172af555d16847efbb98f88aefbadda3', 'request_id': 'req-930c9276-039c-4a00-af72-a945fb1eb7e8'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:56.150524 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:56.168270 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-930c9276-039c-4a00-af72-a945fb1eb7e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '172af555d16847efbb98f88aefbadda3', 'request_id': 'req-930c9276-039c-4a00-af72-a945fb1eb7e8'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:56.190652 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-930c9276-039c-4a00-af72-a945fb1eb7e8 admin admin] The token cache is being invalidate because project 172af555d16847efbb98f88aefbadda3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:30:56.190842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-930c9276-039c-4a00-af72-a945fb1eb7e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:56.191550 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-930c9276-039c-4a00-af72-a945fb1eb7e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:56.193602 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 739/1484] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:30:55 2022] DELETE /identity/v3/projects/172af555d16847efbb98f88aefbadda3 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:56.194900 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c9276-039c-4a00-af72-a945fb1eb7e8 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:56.196981 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-930c9276-039c-4a00-af72-a945fb1eb7e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:56.220659 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:56.287372 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7122522-dbd8-4f7a-9a45-4b1b0b72b2be admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:56.293155 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c797bc-c975-4015-9219-4d7e9e1fc03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:56.293814 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c797bc-c975-4015-9219-4d7e9e1fc03f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:56.294153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c797bc-c975-4015-9219-4d7e9e1fc03f admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:56.294446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c797bc-c975-4015-9219-4d7e9e1fc03f admin admin] PATH_INFO: `/v3/users/e010d18e48d042ccb8b9d9b0c411461f` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:56.296377 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c797bc-c975-4015-9219-4d7e9e1fc03f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e010d18e48d042ccb8b9d9b0c411461f)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:56.299800 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c797bc-c975-4015-9219-4d7e9e1fc03f admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:56.309636 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c9276-039c-4a00-af72-a945fb1eb7e8 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:56.316974 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1859e15-3f0e-48d7-ab1f-b404f71c1b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:56.317748 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1859e15-3f0e-48d7-ab1f-b404f71c1b66 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:56.318316 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1859e15-3f0e-48d7-ab1f-b404f71c1b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:56.318596 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1859e15-3f0e-48d7-ab1f-b404f71c1b66 admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:56.319670 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1859e15-3f0e-48d7-ab1f-b404f71c1b66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:56.321829 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1859e15-3f0e-48d7-ab1f-b404f71c1b66 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:56.359966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 740/1485] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:30:56 2022] POST /identity/v3/users => generated 306 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:56.363324 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f0489-9b5f-478e-8f87-92478d4d816e None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:56.363618 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f0489-9b5f-478e-8f87-92478d4d816e None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:56.364304 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f0489-9b5f-478e-8f87-92478d4d816e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:56.382493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-95c797bc-c975-4015-9219-4d7e9e1fc03f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e010d18e48d042ccb8b9d9b0c411461f'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:56.393661 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-95c797bc-c975-4015-9219-4d7e9e1fc03f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e010d18e48d042ccb8b9d9b0c411461f'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:56.395597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-939f0489-9b5f-478e-8f87-92478d4d816e None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:56.397207 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-939f0489-9b5f-478e-8f87-92478d4d816e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:56.418789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 741/1486] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:56.420505 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f0489-9b5f-478e-8f87-92478d4d816e None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:56.443664 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-95c797bc-c975-4015-9219-4d7e9e1fc03f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e010d18e48d042ccb8b9d9b0c411461f'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:56.446969 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-95c797bc-c975-4015-9219-4d7e9e1fc03f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e010d18e48d042ccb8b9d9b0c411461f'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:56.449758 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f0489-9b5f-478e-8f87-92478d4d816e None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:56.462992 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cb13e-684a-4956-9ebb-cd27c69730f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:56.463936 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cb13e-684a-4956-9ebb-cd27c69730f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:56.464227 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cb13e-684a-4956-9ebb-cd27c69730f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:56.464577 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cb13e-684a-4956-9ebb-cd27c69730f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:56.465188 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8cb13e-684a-4956-9ebb-cd27c69730f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:56.467101 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8cb13e-684a-4956-9ebb-cd27c69730f8 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:56.469337 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-95c797bc-c975-4015-9219-4d7e9e1fc03f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e010d18e48d042ccb8b9d9b0c411461f'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:56.483162 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 742/1487] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:56.485558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9639a6-36d6-4369-88d7-87f9ebb39378 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:56.485856 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9639a6-36d6-4369-88d7-87f9ebb39378 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:56.486271 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9639a6-36d6-4369-88d7-87f9ebb39378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:56.494471 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 746/1488] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:30:56 2022] DELETE /identity/v3/users/e010d18e48d042ccb8b9d9b0c411461f => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:56.496719 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c797bc-c975-4015-9219-4d7e9e1fc03f admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:56.500235 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-95c797bc-c975-4015-9219-4d7e9e1fc03f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:56.514323 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-7a9639a6-36d6-4369-88d7-87f9ebb39378 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:56.516400 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-7a9639a6-36d6-4369-88d7-87f9ebb39378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:56.629649 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c797bc-c975-4015-9219-4d7e9e1fc03f admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:56.635938 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c56cd-6ed1-42fd-a90e-a04b023ec59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:56.637010 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c56cd-6ed1-42fd-a90e-a04b023ec59a admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:56.637589 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c56cd-6ed1-42fd-a90e-a04b023ec59a admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:56.638201 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c56cd-6ed1-42fd-a90e-a04b023ec59a admin admin] PATH_INFO: `/v3/projects/72ab136d112643a5835d75f0d7eb5529/users/de486ad467604b96ae2c87c2496ade26/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:56.642561 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 743/1489] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:56.643893 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9639a6-36d6-4369-88d7-87f9ebb39378 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:56.657820 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9639a6-36d6-4369-88d7-87f9ebb39378 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:56.663860 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf10da-82f0-4dde-9e46-5efa3dc172ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:56.664540 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf10da-82f0-4dde-9e46-5efa3dc172ab admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:56.664860 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf10da-82f0-4dde-9e46-5efa3dc172ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:56.665143 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf10da-82f0-4dde-9e46-5efa3dc172ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:56.666066 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf10da-82f0-4dde-9e46-5efa3dc172ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:30:56.666387 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf10da-82f0-4dde-9e46-5efa3dc172ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:56.668680 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf10da-82f0-4dde-9e46-5efa3dc172ab admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:56.670297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c56cd-6ed1-42fd-a90e-a04b023ec59a admin admin] RBAC: Authorizing `identity:create_grant(project_id=72ab136d112643a5835d75f0d7eb5529, user_id=de486ad467604b96ae2c87c2496ade26, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:56.674191 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c56cd-6ed1-42fd-a90e-a04b023ec59a admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:56.695061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 744/1490] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:30:56.699685 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf10da-82f0-4dde-9e46-5efa3dc172ab admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:56.700656 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 747/1491] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:56 2022] PUT /identity/v3/projects/72ab136d112643a5835d75f0d7eb5529/users/de486ad467604b96ae2c87c2496ade26/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:56.705559 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c56cd-6ed1-42fd-a90e-a04b023ec59a admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:56.715830 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:56.718646 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf10da-82f0-4dde-9e46-5efa3dc172ab admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:56.806507 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c56cd-6ed1-42fd-a90e-a04b023ec59a admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:56.812355 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51211df-7b71-492d-ba85-2c2b282842e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:56.813237 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51211df-7b71-492d-ba85-2c2b282842e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:56.813660 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51211df-7b71-492d-ba85-2c2b282842e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:56.814108 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51211df-7b71-492d-ba85-2c2b282842e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:56.814940 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51211df-7b71-492d-ba85-2c2b282842e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:56.816746 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51211df-7b71-492d-ba85-2c2b282842e0 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:56.830995 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 748/1492] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:30:56.832004 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51211df-7b71-492d-ba85-2c2b282842e0 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:56.833923 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-b51211df-7b71-492d-ba85-2c2b282842e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:56.837716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c27bb-2470-4112-9ef1-e54589dc5909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:56.838534 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c27bb-2470-4112-9ef1-e54589dc5909 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:56.838951 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c27bb-2470-4112-9ef1-e54589dc5909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:56.840997 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c27bb-2470-4112-9ef1-e54589dc5909 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:56.849852 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c27bb-2470-4112-9ef1-e54589dc5909 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:56.851638 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51211df-7b71-492d-ba85-2c2b282842e0 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:56.853169 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c27bb-2470-4112-9ef1-e54589dc5909 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:56.864523 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3453c7c-875c-41de-aa1b-94cb62a259cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:56.865543 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3453c7c-875c-41de-aa1b-94cb62a259cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:56.865828 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3453c7c-875c-41de-aa1b-94cb62a259cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:56.866102 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3453c7c-875c-41de-aa1b-94cb62a259cd admin admin] PATH_INFO: `/v3/projects/7ff3e4f60a0b40859c3790a937bb3269` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:56.867829 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3453c7c-875c-41de-aa1b-94cb62a259cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ff3e4f60a0b40859c3790a937bb3269)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:56.870126 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3453c7c-875c-41de-aa1b-94cb62a259cd admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:56.889134 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:56.902698 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 745/1493] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:30:56 2022] POST /identity/v3/projects => generated 367 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:56.902698 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c27bb-2470-4112-9ef1-e54589dc5909 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:56.945277 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-e3453c7c-875c-41de-aa1b-94cb62a259cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff3e4f60a0b40859c3790a937bb3269', 'request_id': 'req-e3453c7c-875c-41de-aa1b-94cb62a259cd'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:56.952783 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-e3453c7c-875c-41de-aa1b-94cb62a259cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff3e4f60a0b40859c3790a937bb3269', 'request_id': 'req-e3453c7c-875c-41de-aa1b-94cb62a259cd'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:56.960979 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-e3453c7c-875c-41de-aa1b-94cb62a259cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff3e4f60a0b40859c3790a937bb3269', 'request_id': 'req-e3453c7c-875c-41de-aa1b-94cb62a259cd'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:56.985342 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-e3453c7c-875c-41de-aa1b-94cb62a259cd admin admin] The token cache is being invalidate because project 7ff3e4f60a0b40859c3790a937bb3269 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:30:56.985635 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-e3453c7c-875c-41de-aa1b-94cb62a259cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:56.986307 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-e3453c7c-875c-41de-aa1b-94cb62a259cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:56.987914 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 749/1494] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:30:56 2022] DELETE /identity/v3/projects/7ff3e4f60a0b40859c3790a937bb3269 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:56.991261 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3453c7c-875c-41de-aa1b-94cb62a259cd admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:56.991261 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-e3453c7c-875c-41de-aa1b-94cb62a259cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:56.999289 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c27bb-2470-4112-9ef1-e54589dc5909 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:57.068830 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3453c7c-875c-41de-aa1b-94cb62a259cd admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:57.074041 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969de3ad-ecb3-4193-ad36-1a2c0e553351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:57.074738 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969de3ad-ecb3-4193-ad36-1a2c0e553351 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:57.075152 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969de3ad-ecb3-4193-ad36-1a2c0e553351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:57.075368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969de3ad-ecb3-4193-ad36-1a2c0e553351 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:57.075999 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969de3ad-ecb3-4193-ad36-1a2c0e553351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:57.078388 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969de3ad-ecb3-4193-ad36-1a2c0e553351 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:57.083766 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbeca2d-48b1-4476-9035-2b71d2a6d614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:57.084650 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbeca2d-48b1-4476-9035-2b71d2a6d614 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:57.085119 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbeca2d-48b1-4476-9035-2b71d2a6d614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:57.085476 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbeca2d-48b1-4476-9035-2b71d2a6d614 admin admin] PATH_INFO: `/v3/projects/72ab136d112643a5835d75f0d7eb5529/users/de486ad467604b96ae2c87c2496ade26/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:57.091859 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbeca2d-48b1-4476-9035-2b71d2a6d614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72ab136d112643a5835d75f0d7eb5529, user_id=de486ad467604b96ae2c87c2496ade26, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:57.095692 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbeca2d-48b1-4476-9035-2b71d2a6d614 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:57.107536 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 750/1495] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:30:56 2022] POST /identity/v3/users => generated 284 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:57.109258 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320148c8-8303-489d-b9e6-370d62c49247 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:57.109386 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 746/1496] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:56 2022] PUT /identity/v3/projects/72ab136d112643a5835d75f0d7eb5529/users/de486ad467604b96ae2c87c2496ade26/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:57.109557 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320148c8-8303-489d-b9e6-370d62c49247 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:57.110003 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320148c8-8303-489d-b9e6-370d62c49247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:57.120179 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbeca2d-48b1-4476-9035-2b71d2a6d614 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:57.122367 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-7cbeca2d-48b1-4476-9035-2b71d2a6d614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:57.137813 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-320148c8-8303-489d-b9e6-370d62c49247 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:57.139022 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-320148c8-8303-489d-b9e6-370d62c49247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:57.148567 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:57.195547 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbeca2d-48b1-4476-9035-2b71d2a6d614 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:57.207154 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e36527-36bf-4bf0-8541-e83e3bd2e676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:57.207947 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e36527-36bf-4bf0-8541-e83e3bd2e676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:57.208373 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e36527-36bf-4bf0-8541-e83e3bd2e676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:57.208703 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e36527-36bf-4bf0-8541-e83e3bd2e676 admin admin] PATH_INFO: `/v3/projects/1c3190060b924a8caf4f3a5ecbf40151` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:57.209873 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e36527-36bf-4bf0-8541-e83e3bd2e676 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c3190060b924a8caf4f3a5ecbf40151)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:57.217692 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 751/1497] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:57.217853 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e36527-36bf-4bf0-8541-e83e3bd2e676 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:57.217930 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320148c8-8303-489d-b9e6-370d62c49247 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:57.228759 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320148c8-8303-489d-b9e6-370d62c49247 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:57.233502 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18278a72-106a-4aa1-9ce5-8513de3bf2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:57.234112 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18278a72-106a-4aa1-9ce5-8513de3bf2cc admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:57.235599 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18278a72-106a-4aa1-9ce5-8513de3bf2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:57.235599 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18278a72-106a-4aa1-9ce5-8513de3bf2cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:57.235885 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18278a72-106a-4aa1-9ce5-8513de3bf2cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:57.237795 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18278a72-106a-4aa1-9ce5-8513de3bf2cc admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:57.253713 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 752/1498] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:57.253713 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad8024-ea06-4c89-ae41-2e5365d08463 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:57.253713 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad8024-ea06-4c89-ae41-2e5365d08463 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:57.253713 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad8024-ea06-4c89-ae41-2e5365d08463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:57.269027 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:57.277210 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-04e36527-36bf-4bf0-8541-e83e3bd2e676 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c3190060b924a8caf4f3a5ecbf40151', 'request_id': 'req-04e36527-36bf-4bf0-8541-e83e3bd2e676'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:57.293946 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-73ad8024-ea06-4c89-ae41-2e5365d08463 None None] MFA Rules not processed for user `de486ad467604b96ae2c87c2496ade26`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:57.295195 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-73ad8024-ea06-4c89-ae41-2e5365d08463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:57.296210 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-04e36527-36bf-4bf0-8541-e83e3bd2e676 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c3190060b924a8caf4f3a5ecbf40151', 'request_id': 'req-04e36527-36bf-4bf0-8541-e83e3bd2e676'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:57.304926 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-04e36527-36bf-4bf0-8541-e83e3bd2e676 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c3190060b924a8caf4f3a5ecbf40151', 'request_id': 'req-04e36527-36bf-4bf0-8541-e83e3bd2e676'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:57.315878 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-04e36527-36bf-4bf0-8541-e83e3bd2e676 admin admin] The token cache is being invalidate because project 1c3190060b924a8caf4f3a5ecbf40151 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:30:57.316265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-04e36527-36bf-4bf0-8541-e83e3bd2e676 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:57.317001 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-04e36527-36bf-4bf0-8541-e83e3bd2e676 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:30:57.318554 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 747/1499] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:30:57 2022] DELETE /identity/v3/projects/1c3190060b924a8caf4f3a5ecbf40151 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:57.320001 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc2946-8d4e-439f-bbcd-cfe0701f8852 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:57.320332 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc2946-8d4e-439f-bbcd-cfe0701f8852 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:57.320867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc2946-8d4e-439f-bbcd-cfe0701f8852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:57.341074 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-43fc2946-8d4e-439f-bbcd-cfe0701f8852 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:57.342282 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-43fc2946-8d4e-439f-bbcd-cfe0701f8852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:57.366820 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 753/1500] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:57 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:57.367465 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad8024-ea06-4c89-ae41-2e5365d08463 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:57.368807 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-73ad8024-ea06-4c89-ae41-2e5365d08463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:57.406259 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 748/1501] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:57.407677 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8326a09-f1a1-42f0-870f-98000152b174 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:57.407966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8326a09-f1a1-42f0-870f-98000152b174 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:57.408243 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8326a09-f1a1-42f0-870f-98000152b174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:57.427787 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-e8326a09-f1a1-42f0-870f-98000152b174 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:57.429021 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-e8326a09-f1a1-42f0-870f-98000152b174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:57.435299 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad8024-ea06-4c89-ae41-2e5365d08463 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:57.438658 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 749/1502] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:57.439550 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8326a09-f1a1-42f0-870f-98000152b174 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:57.440892 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-e8326a09-f1a1-42f0-870f-98000152b174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:57.449746 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc6900-f17f-4b90-9351-a091ac9bbf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:57.450305 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc6900-f17f-4b90-9351-a091ac9bbf7b admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:57.450588 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc6900-f17f-4b90-9351-a091ac9bbf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:57.450860 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc6900-f17f-4b90-9351-a091ac9bbf7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:57.451510 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc6900-f17f-4b90-9351-a091ac9bbf7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:57.453420 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc6900-f17f-4b90-9351-a091ac9bbf7b admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:57.465502 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 754/1503] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:57.469725 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc6900-f17f-4b90-9351-a091ac9bbf7b admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:57.479805 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc6900-f17f-4b90-9351-a091ac9bbf7b admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:57.484392 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70bc78-dadc-41aa-8360-16c33c17fe16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:57.485565 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70bc78-dadc-41aa-8360-16c33c17fe16 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:57.485853 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70bc78-dadc-41aa-8360-16c33c17fe16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:57.486129 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70bc78-dadc-41aa-8360-16c33c17fe16 admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:57.486782 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70bc78-dadc-41aa-8360-16c33c17fe16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:30:57.487228 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70bc78-dadc-41aa-8360-16c33c17fe16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:57.488722 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70bc78-dadc-41aa-8360-16c33c17fe16 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:57.502394 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 755/1504] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:30:57.503704 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac165c-70fa-4619-a73b-25a91b77ad4d None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:57.503998 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac165c-70fa-4619-a73b-25a91b77ad4d None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:57.504276 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac165c-70fa-4619-a73b-25a91b77ad4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:57.507882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8326a09-f1a1-42f0-870f-98000152b174 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:57.512244 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a767106-1e81-4252-94cf-e32d3be31726 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:57.512244 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a767106-1e81-4252-94cf-e32d3be31726 service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:57.512515 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a767106-1e81-4252-94cf-e32d3be31726 service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:57.512833 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a767106-1e81-4252-94cf-e32d3be31726 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:57.525036 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-06ac165c-70fa-4619-a73b-25a91b77ad4d None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:57.526951 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-06ac165c-70fa-4619-a73b-25a91b77ad4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:57.529005 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a767106-1e81-4252-94cf-e32d3be31726 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:57.530443 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a767106-1e81-4252-94cf-e32d3be31726 service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:57.541188 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 750/1505] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:57 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:57.542148 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 756/1506] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:57.543028 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac165c-70fa-4619-a73b-25a91b77ad4d None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:57.543404 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a767106-1e81-4252-94cf-e32d3be31726 service cinder] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:57.553007 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:57.556889 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a767106-1e81-4252-94cf-e32d3be31726 service cinder] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:57.558621 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac165c-70fa-4619-a73b-25a91b77ad4d None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:57.562910 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad197b-21fa-4ce4-bd6d-a34682ca08e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:57.564364 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad197b-21fa-4ce4-bd6d-a34682ca08e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:57.564633 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923d39d-1802-46d1-a3c4-3e70d496427f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:57.564919 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad197b-21fa-4ce4-bd6d-a34682ca08e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:57.565231 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad197b-21fa-4ce4-bd6d-a34682ca08e4 admin admin] PATH_INFO: `/v3/projects/16d7e8f125ee49c59996fd1dd34388b7/users/87fc45bec87944389cc3989441de9ffb/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:57.565363 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923d39d-1802-46d1-a3c4-3e70d496427f admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:57.565635 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923d39d-1802-46d1-a3c4-3e70d496427f admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:57.565923 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923d39d-1802-46d1-a3c4-3e70d496427f admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:57.566556 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923d39d-1802-46d1-a3c4-3e70d496427f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:57.569840 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923d39d-1802-46d1-a3c4-3e70d496427f admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:57.584733 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad197b-21fa-4ce4-bd6d-a34682ca08e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16d7e8f125ee49c59996fd1dd34388b7, user_id=87fc45bec87944389cc3989441de9ffb, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:57.587619 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad197b-21fa-4ce4-bd6d-a34682ca08e4 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:57.616510 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 751/1507] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:57 2022] PUT /identity/v3/projects/16d7e8f125ee49c59996fd1dd34388b7/users/87fc45bec87944389cc3989441de9ffb/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:57.616510 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad197b-21fa-4ce4-bd6d-a34682ca08e4 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:57.627553 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 757/1508] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:30:57 2022] POST /identity/v3/projects => generated 387 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:57.632385 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee4e36-e8a4-4b84-bada-55a63ae76f81 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:57.632385 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee4e36-e8a4-4b84-bada-55a63ae76f81 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:57.632385 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee4e36-e8a4-4b84-bada-55a63ae76f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:57.662750 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:57.667237 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-09ee4e36-e8a4-4b84-bada-55a63ae76f81 None None] MFA Rules not processed for user `87fc45bec87944389cc3989441de9ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:57.668697 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-09ee4e36-e8a4-4b84-bada-55a63ae76f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:57.682886 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad197b-21fa-4ce4-bd6d-a34682ca08e4 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:57.738387 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 758/1509] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:57.739312 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee4e36-e8a4-4b84-bada-55a63ae76f81 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:57.743516 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8370cad-374b-4f9e-ae9a-155fa612da01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:57.744140 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8370cad-374b-4f9e-ae9a-155fa612da01 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:57.744422 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8370cad-374b-4f9e-ae9a-155fa612da01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:57.744724 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8370cad-374b-4f9e-ae9a-155fa612da01 admin admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:57.745370 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8370cad-374b-4f9e-ae9a-155fa612da01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:30:57.745676 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8370cad-374b-4f9e-ae9a-155fa612da01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:57.747262 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8370cad-374b-4f9e-ae9a-155fa612da01 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:57.750215 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee4e36-e8a4-4b84-bada-55a63ae76f81 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:57.755257 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828877aa-afc5-4fdd-896c-59fed7a36a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:57.755843 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828877aa-afc5-4fdd-896c-59fed7a36a9e admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:57.756264 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828877aa-afc5-4fdd-896c-59fed7a36a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:57.756537 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828877aa-afc5-4fdd-896c-59fed7a36a9e admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:57.757193 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828877aa-afc5-4fdd-896c-59fed7a36a9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:57.759075 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828877aa-afc5-4fdd-896c-59fed7a36a9e admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:57.759479 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 752/1510] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:30:57.760346 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8370cad-374b-4f9e-ae9a-155fa612da01 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:57.781413 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 759/1511] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:30:57 2022] POST /identity/v3/users => generated 294 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:57.782262 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828877aa-afc5-4fdd-896c-59fed7a36a9e admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:57.791397 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828877aa-afc5-4fdd-896c-59fed7a36a9e admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:57.796228 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4722392-e183-4e4f-b749-97954d500cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:57.796844 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4722392-e183-4e4f-b749-97954d500cfc admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:57.797233 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4722392-e183-4e4f-b749-97954d500cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:57.797449 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4722392-e183-4e4f-b749-97954d500cfc admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:57.798041 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4722392-e183-4e4f-b749-97954d500cfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:57.800050 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4722392-e183-4e4f-b749-97954d500cfc admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:57.818851 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8370cad-374b-4f9e-ae9a-155fa612da01 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:57.823561 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2588235-661a-4cc6-98aa-7c2a9538b509 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:57.824182 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2588235-661a-4cc6-98aa-7c2a9538b509 service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:57.824473 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2588235-661a-4cc6-98aa-7c2a9538b509 service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:57.824788 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2588235-661a-4cc6-98aa-7c2a9538b509 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:57.826601 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-b2588235-661a-4cc6-98aa-7c2a9538b509 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:57.837460 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 760/1512] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:30:57 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:57.838240 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4722392-e183-4e4f-b749-97954d500cfc admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:57.894290 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2588235-661a-4cc6-98aa-7c2a9538b509 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:57.895715 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2588235-661a-4cc6-98aa-7c2a9538b509 service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:57.904188 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4722392-e183-4e4f-b749-97954d500cfc admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:57.905166 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 753/1513] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:57 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:57.905979 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2588235-661a-4cc6-98aa-7c2a9538b509 service cinder] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:57.909869 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf12cc-c1fb-4dfb-9852-7c74efca3722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:57.910492 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf12cc-c1fb-4dfb-9852-7c74efca3722 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:57.910776 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf12cc-c1fb-4dfb-9852-7c74efca3722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:57.911052 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf12cc-c1fb-4dfb-9852-7c74efca3722 admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:57.911692 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf12cc-c1fb-4dfb-9852-7c74efca3722 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:57.913792 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf12cc-c1fb-4dfb-9852-7c74efca3722 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:57.923678 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2588235-661a-4cc6-98aa-7c2a9538b509 service cinder] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:57.930689 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc13a9-5f33-4d90-90c8-8e2ef1c60714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:57.931774 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc13a9-5f33-4d90-90c8-8e2ef1c60714 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:57.931774 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc13a9-5f33-4d90-90c8-8e2ef1c60714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:57.932253 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc13a9-5f33-4d90-90c8-8e2ef1c60714 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:57.933035 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc13a9-5f33-4d90-90c8-8e2ef1c60714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:57.934755 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc13a9-5f33-4d90-90c8-8e2ef1c60714 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:57.948258 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 754/1514] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:57.949149 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc13a9-5f33-4d90-90c8-8e2ef1c60714 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:57.951300 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 761/1515] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:30:57 2022] POST /identity/v3/projects => generated 369 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:57.952167 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf12cc-c1fb-4dfb-9852-7c74efca3722 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:57.964132 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc13a9-5f33-4d90-90c8-8e2ef1c60714 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:57.981059 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:58.034345 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:58.060981 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf12cc-c1fb-4dfb-9852-7c74efca3722 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:58.066470 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2d654-db4b-4a6a-b685-559cf1a3ce29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:58.067253 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2d654-db4b-4a6a-b685-559cf1a3ce29 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:58.067856 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2d654-db4b-4a6a-b685-559cf1a3ce29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:58.068237 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2d654-db4b-4a6a-b685-559cf1a3ce29 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:58.069882 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2d654-db4b-4a6a-b685-559cf1a3ce29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:58.073205 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2d654-db4b-4a6a-b685-559cf1a3ce29 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:58.089068 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a3140-fee6-47cb-b12a-90665d4557f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:58.089877 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a3140-fee6-47cb-b12a-90665d4557f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:58.090166 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a3140-fee6-47cb-b12a-90665d4557f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:58.090443 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a3140-fee6-47cb-b12a-90665d4557f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:58.091138 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a3140-fee6-47cb-b12a-90665d4557f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:58.094182 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a3140-fee6-47cb-b12a-90665d4557f7 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:58.101023 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 762/1516] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:30:57 2022] POST /identity/v3/users => generated 285 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:58.102036 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2d654-db4b-4a6a-b685-559cf1a3ce29 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:58.117747 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2d654-db4b-4a6a-b685-559cf1a3ce29 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:58.124180 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e521a-41e5-4aa4-8f47-d056e780366a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:58.125249 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e521a-41e5-4aa4-8f47-d056e780366a admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:58.125685 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e521a-41e5-4aa4-8f47-d056e780366a admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:58.126439 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e521a-41e5-4aa4-8f47-d056e780366a admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:58.126834 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 755/1517] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:30:57 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:58.127217 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e521a-41e5-4aa4-8f47-d056e780366a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:58.129484 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e521a-41e5-4aa4-8f47-d056e780366a admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:58.133384 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a3140-fee6-47cb-b12a-90665d4557f7 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:58.146496 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 763/1518] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:58.147219 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e521a-41e5-4aa4-8f47-d056e780366a admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:58.153758 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a3140-fee6-47cb-b12a-90665d4557f7 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:58.158150 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e521a-41e5-4aa4-8f47-d056e780366a admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:58.159371 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1837f57-ee1e-4519-b938-0f6fca3475f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:58.160261 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1837f57-ee1e-4519-b938-0f6fca3475f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:58.160672 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1837f57-ee1e-4519-b938-0f6fca3475f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:58.161058 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1837f57-ee1e-4519-b938-0f6fca3475f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:58.161864 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1837f57-ee1e-4519-b938-0f6fca3475f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:58.163842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1837f57-ee1e-4519-b938-0f6fca3475f6 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:58.167334 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69713e64-75d6-4575-8e1c-2dbb5a22034f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:58.167486 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69713e64-75d6-4575-8e1c-2dbb5a22034f admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:58.167955 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69713e64-75d6-4575-8e1c-2dbb5a22034f admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:58.168737 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69713e64-75d6-4575-8e1c-2dbb5a22034f admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:58.169644 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69713e64-75d6-4575-8e1c-2dbb5a22034f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:58.171762 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69713e64-75d6-4575-8e1c-2dbb5a22034f admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:58.179933 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 756/1519] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:58.181245 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1837f57-ee1e-4519-b938-0f6fca3475f6 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:58.187370 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 764/1520] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:58.187370 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69713e64-75d6-4575-8e1c-2dbb5a22034f admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:58.194124 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1837f57-ee1e-4519-b938-0f6fca3475f6 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:58.198257 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69713e64-75d6-4575-8e1c-2dbb5a22034f admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:58.199230 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c9f0e-883d-46c4-8ef2-5f4cd609349a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:58.199925 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c9f0e-883d-46c4-8ef2-5f4cd609349a admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:58.200196 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c9f0e-883d-46c4-8ef2-5f4cd609349a admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:58.200475 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c9f0e-883d-46c4-8ef2-5f4cd609349a admin admin] PATH_INFO: `/v3/projects/1d8425e832ac40a6889041457f701209/users/3fec41f4442546c7b9f6e109495dbb89/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:58.206013 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750fb05-5397-480c-b40c-b1d584e8d156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:58.206743 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750fb05-5397-480c-b40c-b1d584e8d156 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:58.207089 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750fb05-5397-480c-b40c-b1d584e8d156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:58.207430 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750fb05-5397-480c-b40c-b1d584e8d156 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:58.208204 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750fb05-5397-480c-b40c-b1d584e8d156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:58.210050 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750fb05-5397-480c-b40c-b1d584e8d156 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:58.221202 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c9f0e-883d-46c4-8ef2-5f4cd609349a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d8425e832ac40a6889041457f701209, user_id=3fec41f4442546c7b9f6e109495dbb89, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:58.223909 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 765/1521] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:58.224757 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750fb05-5397-480c-b40c-b1d584e8d156 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:58.226389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c9f0e-883d-46c4-8ef2-5f4cd609349a admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:58.237618 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750fb05-5397-480c-b40c-b1d584e8d156 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:58.255358 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 757/1522] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:58 2022] PUT /identity/v3/projects/1d8425e832ac40a6889041457f701209/users/3fec41f4442546c7b9f6e109495dbb89/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:58.255358 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c9f0e-883d-46c4-8ef2-5f4cd609349a admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:58.331224 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b738e12c-fa2f-4327-91ec-6b1af80841ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:58.331984 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738e12c-fa2f-4327-91ec-6b1af80841ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:58.332420 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738e12c-fa2f-4327-91ec-6b1af80841ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:58.332755 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738e12c-fa2f-4327-91ec-6b1af80841ce admin admin] PATH_INFO: `/v3/projects/75d7d4a46bbc4893a41847f45b5eca84/users/7a5f94ce2ea24d9a93f1c0fce467e01e/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:58.351703 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b738e12c-fa2f-4327-91ec-6b1af80841ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d7d4a46bbc4893a41847f45b5eca84, user_id=7a5f94ce2ea24d9a93f1c0fce467e01e, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:58.355073 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c9f0e-883d-46c4-8ef2-5f4cd609349a admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:58.355323 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b738e12c-fa2f-4327-91ec-6b1af80841ce admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:58.361819 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268509a-b905-4c24-be1a-f143d0f28832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:58.362601 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268509a-b905-4c24-be1a-f143d0f28832 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:58.362852 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268509a-b905-4c24-be1a-f143d0f28832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:58.363092 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268509a-b905-4c24-be1a-f143d0f28832 admin admin] PATH_INFO: `/v3/projects/a853a08ef18e4e43bc2f6341c3b944fc/users/880d22f1030e482e97f1f174f76cbba3/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:58.381852 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 766/1523] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:58 2022] PUT /identity/v3/projects/75d7d4a46bbc4893a41847f45b5eca84/users/7a5f94ce2ea24d9a93f1c0fce467e01e/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:58.385717 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6524aeb-3588-4f3f-9167-2589599b46ae None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:58.386168 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268509a-b905-4c24-be1a-f143d0f28832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a853a08ef18e4e43bc2f6341c3b944fc, user_id=880d22f1030e482e97f1f174f76cbba3, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:58.387120 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6524aeb-3588-4f3f-9167-2589599b46ae None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:58.387488 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6524aeb-3588-4f3f-9167-2589599b46ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:58.390279 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268509a-b905-4c24-be1a-f143d0f28832 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:58.408155 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 758/1524] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:58 2022] PUT /identity/v3/projects/a853a08ef18e4e43bc2f6341c3b944fc/users/880d22f1030e482e97f1f174f76cbba3/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:58.409159 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268509a-b905-4c24-be1a-f143d0f28832 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:58.477718 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-c6524aeb-3588-4f3f-9167-2589599b46ae None None] MFA Rules not processed for user `3fec41f4442546c7b9f6e109495dbb89`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:58.481476 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-c6524aeb-3588-4f3f-9167-2589599b46ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:58.501780 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268509a-b905-4c24-be1a-f143d0f28832 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:58.509896 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45752ff-7021-4fd6-9031-ed79234fcdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:58.510628 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45752ff-7021-4fd6-9031-ed79234fcdb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:58.511555 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45752ff-7021-4fd6-9031-ed79234fcdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:58.511945 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45752ff-7021-4fd6-9031-ed79234fcdb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:58.512716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45752ff-7021-4fd6-9031-ed79234fcdb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:58.517174 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45752ff-7021-4fd6-9031-ed79234fcdb3 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:58.530638 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 759/1525] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:58.533919 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8620f9-a286-45e1-8957-3f6b2be47348 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:58.535775 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8620f9-a286-45e1-8957-3f6b2be47348 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:58.536066 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8620f9-a286-45e1-8957-3f6b2be47348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:58.545716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:58.576974 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-ee8620f9-a286-45e1-8957-3f6b2be47348 None None] MFA Rules not processed for user `880d22f1030e482e97f1f174f76cbba3`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:58.579443 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-ee8620f9-a286-45e1-8957-3f6b2be47348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:58.594680 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:58.634306 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 767/1526] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:58.634306 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6524aeb-3588-4f3f-9167-2589599b46ae None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:58.656631 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6524aeb-3588-4f3f-9167-2589599b46ae None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:58.670828 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb883ea3-4120-46ba-807c-97d259de2e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:58.674393 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb883ea3-4120-46ba-807c-97d259de2e61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:58.674770 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb883ea3-4120-46ba-807c-97d259de2e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:58.675155 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb883ea3-4120-46ba-807c-97d259de2e61 admin admin] PATH_INFO: `/v3/projects/75d7d4a46bbc4893a41847f45b5eca84/users/7a5f94ce2ea24d9a93f1c0fce467e01e/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:58.681440 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb883ea3-4120-46ba-807c-97d259de2e61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d7d4a46bbc4893a41847f45b5eca84, user_id=7a5f94ce2ea24d9a93f1c0fce467e01e, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:58.683782 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 760/1527] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:58.685038 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8620f9-a286-45e1-8957-3f6b2be47348 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:58.685661 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb883ea3-4120-46ba-807c-97d259de2e61 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:58.703209 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8620f9-a286-45e1-8957-3f6b2be47348 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:58.707991 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 768/1528] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:58 2022] PUT /identity/v3/projects/75d7d4a46bbc4893a41847f45b5eca84/users/7a5f94ce2ea24d9a93f1c0fce467e01e/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:58.709144 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb883ea3-4120-46ba-807c-97d259de2e61 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:58.792838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49565ce3-bb8d-4b4b-b92b-e82d010bc85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:58.793582 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49565ce3-bb8d-4b4b-b92b-e82d010bc85b admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:58.793936 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49565ce3-bb8d-4b4b-b92b-e82d010bc85b admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:58.794288 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49565ce3-bb8d-4b4b-b92b-e82d010bc85b admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:58.795055 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49565ce3-bb8d-4b4b-b92b-e82d010bc85b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:58.798433 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49565ce3-bb8d-4b4b-b92b-e82d010bc85b admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:58.825277 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb883ea3-4120-46ba-807c-97d259de2e61 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:58.831679 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4ac4b-ded8-4cb5-80ca-a45d5c82f0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:58.832807 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4ac4b-ded8-4cb5-80ca-a45d5c82f0bf admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:58.832968 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4ac4b-ded8-4cb5-80ca-a45d5c82f0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:58.833236 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4ac4b-ded8-4cb5-80ca-a45d5c82f0bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:58.835073 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4ac4b-ded8-4cb5-80ca-a45d5c82f0bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:58.837574 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4ac4b-ded8-4cb5-80ca-a45d5c82f0bf admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:58.842117 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 761/1529] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:30:58 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:58.844082 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eac11b-9619-4975-a4e0-8401207d59b8 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:58.844650 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eac11b-9619-4975-a4e0-8401207d59b8 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:58.845143 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eac11b-9619-4975-a4e0-8401207d59b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:58.889970 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-08eac11b-9619-4975-a4e0-8401207d59b8 None None] MFA Rules not processed for user `7a5f94ce2ea24d9a93f1c0fce467e01e`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:58.891380 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-08eac11b-9619-4975-a4e0-8401207d59b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:58.892266 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 769/1530] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:30:58 2022] POST /identity/v3/projects => generated 369 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:58.893401 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4ac4b-ded8-4cb5-80ca-a45d5c82f0bf admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:58.983491 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4ac4b-ded8-4cb5-80ca-a45d5c82f0bf admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:58.989460 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98488eb1-ffbf-4a26-9e76-7e1de7d82912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:58.994184 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98488eb1-ffbf-4a26-9e76-7e1de7d82912 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:58.994184 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98488eb1-ffbf-4a26-9e76-7e1de7d82912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:58.994184 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98488eb1-ffbf-4a26-9e76-7e1de7d82912 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:58.994471 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 762/1531] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:58.994547 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98488eb1-ffbf-4a26-9e76-7e1de7d82912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:58.994625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eac11b-9619-4975-a4e0-8401207d59b8 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:58.994699 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98488eb1-ffbf-4a26-9e76-7e1de7d82912 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:58.999333 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:59.006359 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eac11b-9619-4975-a4e0-8401207d59b8 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:59.019319 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc684ac-f123-487e-9c90-f4aa740ff1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:59.019970 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc684ac-f123-487e-9c90-f4aa740ff1b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:59.020337 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc684ac-f123-487e-9c90-f4aa740ff1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:59.021145 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc684ac-f123-487e-9c90-f4aa740ff1b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:59.021502 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc684ac-f123-487e-9c90-f4aa740ff1b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:59.023557 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc684ac-f123-487e-9c90-f4aa740ff1b4 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:59.023844 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 770/1532] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:30:58 2022] POST /identity/v3/users => generated 299 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:59.024807 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98488eb1-ffbf-4a26-9e76-7e1de7d82912 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:59.055471 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 763/1533] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:30:58 2022] POST /identity/v3/users => generated 291 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:30:59.056514 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc684ac-f123-487e-9c90-f4aa740ff1b4 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:59.073097 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc684ac-f123-487e-9c90-f4aa740ff1b4 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:59.080655 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3f241-ea20-48f5-bd65-b85bdd736385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:59.081734 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3f241-ea20-48f5-bd65-b85bdd736385 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:59.082032 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3f241-ea20-48f5-bd65-b85bdd736385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:59.082478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3f241-ea20-48f5-bd65-b85bdd736385 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:59.083273 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3f241-ea20-48f5-bd65-b85bdd736385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:59.085766 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3f241-ea20-48f5-bd65-b85bdd736385 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:59.094550 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:59.098900 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98488eb1-ffbf-4a26-9e76-7e1de7d82912 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:59.105293 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188df3b-4d18-4370-8773-f8bdedef6595 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:59.106139 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188df3b-4d18-4370-8773-f8bdedef6595 service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:59.106593 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188df3b-4d18-4370-8773-f8bdedef6595 service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:59.107084 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188df3b-4d18-4370-8773-f8bdedef6595 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:59.113044 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 764/1534] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:59.117624 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3f241-ea20-48f5-bd65-b85bdd736385 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:59.119987 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7188df3b-4d18-4370-8773-f8bdedef6595 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:59.121758 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7188df3b-4d18-4370-8773-f8bdedef6595 service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:59.127651 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3f241-ea20-48f5-bd65-b85bdd736385 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:59.132831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 771/1535] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:59 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:59.133641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188df3b-4d18-4370-8773-f8bdedef6595 service cinder] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:59.144425 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a72f43-ca1e-4c36-8a92-a93325938703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:59.145105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a72f43-ca1e-4c36-8a92-a93325938703 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:59.145389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a72f43-ca1e-4c36-8a92-a93325938703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:59.145634 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188df3b-4d18-4370-8773-f8bdedef6595 service cinder] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:59.145741 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a72f43-ca1e-4c36-8a92-a93325938703 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:59.146310 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a72f43-ca1e-4c36-8a92-a93325938703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:59.147920 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a72f43-ca1e-4c36-8a92-a93325938703 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:59.151588 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d777e-f625-4bd7-825b-571309398a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:59.153047 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d777e-f625-4bd7-825b-571309398a5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:59.153383 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d777e-f625-4bd7-825b-571309398a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:59.153680 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d777e-f625-4bd7-825b-571309398a5c admin admin] PATH_INFO: `/v3/projects/5c1b9c9443da479fa91562945b5c3b03/users/5d4d424712e94275b433d0d766a955cd/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:59.165319 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 765/1536] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:59.169755 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a72f43-ca1e-4c36-8a92-a93325938703 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:59.178080 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d777e-f625-4bd7-825b-571309398a5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c1b9c9443da479fa91562945b5c3b03, user_id=5d4d424712e94275b433d0d766a955cd, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:59.181216 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d777e-f625-4bd7-825b-571309398a5c admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:59.186249 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a72f43-ca1e-4c36-8a92-a93325938703 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:59.191425 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748606ac-3c24-4bca-b027-5df4b3a5953e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:59.192223 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748606ac-3c24-4bca-b027-5df4b3a5953e admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:59.192831 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748606ac-3c24-4bca-b027-5df4b3a5953e admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:59.193117 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748606ac-3c24-4bca-b027-5df4b3a5953e admin admin] PATH_INFO: `/v3/projects/30ad137fea5c4b2cbfa05afc4508cd20/users/e83711c41e8c474394e2615e3727f570/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:59.197343 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 772/1537] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:59 2022] PUT /identity/v3/projects/5c1b9c9443da479fa91562945b5c3b03/users/5d4d424712e94275b433d0d766a955cd/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:59.198237 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d777e-f625-4bd7-825b-571309398a5c admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:59.201673 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-685d777e-f625-4bd7-825b-571309398a5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:59.211503 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748606ac-3c24-4bca-b027-5df4b3a5953e admin admin] RBAC: Authorizing `identity:create_grant(project_id=30ad137fea5c4b2cbfa05afc4508cd20, user_id=e83711c41e8c474394e2615e3727f570, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:59.214904 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748606ac-3c24-4bca-b027-5df4b3a5953e admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:59.229170 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 766/1538] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:59 2022] PUT /identity/v3/projects/30ad137fea5c4b2cbfa05afc4508cd20/users/e83711c41e8c474394e2615e3727f570/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:59.230013 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748606ac-3c24-4bca-b027-5df4b3a5953e admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:59.273562 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d777e-f625-4bd7-825b-571309398a5c admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:59.304290 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748606ac-3c24-4bca-b027-5df4b3a5953e admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:59.309443 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04e9b9-a75a-4398-93f0-93a2a41b57f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:59.310138 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04e9b9-a75a-4398-93f0-93a2a41b57f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:59.310587 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04e9b9-a75a-4398-93f0-93a2a41b57f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:59.310848 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04e9b9-a75a-4398-93f0-93a2a41b57f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:59.312308 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be04e9b9-a75a-4398-93f0-93a2a41b57f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:59.313821 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be04e9b9-a75a-4398-93f0-93a2a41b57f1 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:59.324965 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 767/1539] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:59.329114 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04e9b9-a75a-4398-93f0-93a2a41b57f1 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:59.332825 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e4c50-cf63-43b3-86c8-1d20f1806e80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:59.333522 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e4c50-cf63-43b3-86c8-1d20f1806e80 service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:59.333868 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e4c50-cf63-43b3-86c8-1d20f1806e80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:59.334227 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e4c50-cf63-43b3-86c8-1d20f1806e80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:59.339452 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04e9b9-a75a-4398-93f0-93a2a41b57f1 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:59.345122 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695f5aa-9b14-4fcb-9ab9-6f1e7599908c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:59.346017 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695f5aa-9b14-4fcb-9ab9-6f1e7599908c admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:59.346017 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695f5aa-9b14-4fcb-9ab9-6f1e7599908c admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:59.346284 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695f5aa-9b14-4fcb-9ab9-6f1e7599908c admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:59.346908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695f5aa-9b14-4fcb-9ab9-6f1e7599908c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:59.348516 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695f5aa-9b14-4fcb-9ab9-6f1e7599908c admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:59.360775 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 768/1540] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:30:59.365031 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695f5aa-9b14-4fcb-9ab9-6f1e7599908c admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:59.377939 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695f5aa-9b14-4fcb-9ab9-6f1e7599908c admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:59.383738 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cc512-baf8-45ad-a8fa-570f894f950a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:59.384435 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cc512-baf8-45ad-a8fa-570f894f950a admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:59.384760 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cc512-baf8-45ad-a8fa-570f894f950a admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:59.385043 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cc512-baf8-45ad-a8fa-570f894f950a admin admin] PATH_INFO: `/v3/projects/5c1b9c9443da479fa91562945b5c3b03/users/5d4d424712e94275b433d0d766a955cd/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:59.387015 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86cc512-baf8-45ad-a8fa-570f894f950a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c1b9c9443da479fa91562945b5c3b03, user_id=5d4d424712e94275b433d0d766a955cd, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:59.389922 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86cc512-baf8-45ad-a8fa-570f894f950a admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:59.403234 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 769/1541] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:59 2022] PUT /identity/v3/projects/5c1b9c9443da479fa91562945b5c3b03/users/5d4d424712e94275b433d0d766a955cd/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:59.404462 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cc512-baf8-45ad-a8fa-570f894f950a admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:59.416889 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e4c50-cf63-43b3-86c8-1d20f1806e80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:59.418394 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e4c50-cf63-43b3-86c8-1d20f1806e80 service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:59.428832 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 773/1542] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:30:59.430159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6bf95-e5df-460b-8dd2-ae7c735605d5 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:59.430457 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6bf95-e5df-460b-8dd2-ae7c735605d5 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:59.430733 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6bf95-e5df-460b-8dd2-ae7c735605d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:59.463481 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-2bc6bf95-e5df-460b-8dd2-ae7c735605d5 None None] MFA Rules not processed for user `5d4d424712e94275b433d0d766a955cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:59.465176 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-2bc6bf95-e5df-460b-8dd2-ae7c735605d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:59.503969 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:59.509539 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cc512-baf8-45ad-a8fa-570f894f950a admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:59.527186 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c956429-2f0d-4836-84ea-9ad625e0f6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:59.528243 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c956429-2f0d-4836-84ea-9ad625e0f6de admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:59.529103 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c956429-2f0d-4836-84ea-9ad625e0f6de admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:59.529483 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c956429-2f0d-4836-84ea-9ad625e0f6de admin admin] PATH_INFO: `/v3/projects/30ad137fea5c4b2cbfa05afc4508cd20/users/e83711c41e8c474394e2615e3727f570/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:59.531614 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c956429-2f0d-4836-84ea-9ad625e0f6de admin admin] RBAC: Authorizing `identity:create_grant(project_id=30ad137fea5c4b2cbfa05afc4508cd20, user_id=e83711c41e8c474394e2615e3727f570, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:30:59.535090 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c956429-2f0d-4836-84ea-9ad625e0f6de admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:30:59.560067 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 770/1543] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:30:59 2022] PUT /identity/v3/projects/30ad137fea5c4b2cbfa05afc4508cd20/users/e83711c41e8c474394e2615e3727f570/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:30:59.562224 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec210abb-dd11-41ff-a0ea-70f28f512544 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:59.562569 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec210abb-dd11-41ff-a0ea-70f28f512544 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:59.562962 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec210abb-dd11-41ff-a0ea-70f28f512544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:59.572829 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:30:59.602177 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 774/1544] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:59 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:59.615703 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-ec210abb-dd11-41ff-a0ea-70f28f512544 None None] MFA Rules not processed for user `e83711c41e8c474394e2615e3727f570`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:30:59.617880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-ec210abb-dd11-41ff-a0ea-70f28f512544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:30:59.675237 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6bf95-e5df-460b-8dd2-ae7c735605d5 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:59.803146 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 771/1545] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:30:59 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:30:59.820173 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6bf95-e5df-460b-8dd2-ae7c735605d5 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:59.939600 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93c89b-bef7-4ec7-8336-0db2b45e22a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:30:59.941426 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93c89b-bef7-4ec7-8336-0db2b45e22a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:30:59.941720 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93c89b-bef7-4ec7-8336-0db2b45e22a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:30:59.942607 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93c89b-bef7-4ec7-8336-0db2b45e22a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:30:59.973296 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec210abb-dd11-41ff-a0ea-70f28f512544 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:30:59.989451 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec210abb-dd11-41ff-a0ea-70f28f512544 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:30:59.999912 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d372f8-1a6e-4fe4-9b21-17eaee2d673b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:00.001272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d372f8-1a6e-4fe4-9b21-17eaee2d673b service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:00.001658 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d372f8-1a6e-4fe4-9b21-17eaee2d673b service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:00.001887 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d372f8-1a6e-4fe4-9b21-17eaee2d673b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:00.016245 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d372f8-1a6e-4fe4-9b21-17eaee2d673b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:00.018476 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d372f8-1a6e-4fe4-9b21-17eaee2d673b service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:00.030473 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 772/1546] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:59 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 20:31:00.133038 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93c89b-bef7-4ec7-8336-0db2b45e22a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:00.134563 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93c89b-bef7-4ec7-8336-0db2b45e22a8 service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:00.164147 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 775/1547] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:30:59 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:01.135167 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d372f8-1a6e-4fe4-9b21-17eaee2d673b service cinder] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:01.244153 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d372f8-1a6e-4fe4-9b21-17eaee2d673b service cinder] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:01.253603 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a3f6c-e747-4b6c-937f-3633927870e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:01.254266 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a3f6c-e747-4b6c-937f-3633927870e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:01.254557 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a3f6c-e747-4b6c-937f-3633927870e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:01.254942 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a3f6c-e747-4b6c-937f-3633927870e3 admin admin] PATH_INFO: `/v3/users/3fec41f4442546c7b9f6e109495dbb89` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:01.256167 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a3f6c-e747-4b6c-937f-3633927870e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fec41f4442546c7b9f6e109495dbb89)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:01.258135 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a3f6c-e747-4b6c-937f-3633927870e3 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:01.378170 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8a0a3f6c-e747-4b6c-937f-3633927870e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fec41f4442546c7b9f6e109495dbb89'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:01.380157 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8a0a3f6c-e747-4b6c-937f-3633927870e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fec41f4442546c7b9f6e109495dbb89'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:01.403694 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8a0a3f6c-e747-4b6c-937f-3633927870e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fec41f4442546c7b9f6e109495dbb89'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:01.405136 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8a0a3f6c-e747-4b6c-937f-3633927870e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fec41f4442546c7b9f6e109495dbb89'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:01.442764 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8a0a3f6c-e747-4b6c-937f-3633927870e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fec41f4442546c7b9f6e109495dbb89'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:01.451379 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:01.473397 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 773/1548] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:31:01 2022] DELETE /identity/v3/users/3fec41f4442546c7b9f6e109495dbb89 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:01.477870 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248242aa-db57-46b3-9577-7b6a9c3d20ea None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:01.478496 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248242aa-db57-46b3-9577-7b6a9c3d20ea None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:01.478496 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248242aa-db57-46b3-9577-7b6a9c3d20ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:01.542943 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-248242aa-db57-46b3-9577-7b6a9c3d20ea None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:01.544190 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-248242aa-db57-46b3-9577-7b6a9c3d20ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:01.590797 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:01.675059 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 776/1549] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:31:01.705207 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a3f6c-e747-4b6c-937f-3633927870e3 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:01.706753 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-8a0a3f6c-e747-4b6c-937f-3633927870e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:01.865144 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a3f6c-e747-4b6c-937f-3633927870e3 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:01.904685 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96593e-3831-416e-9cff-908c5e80598e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:01.905336 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96593e-3831-416e-9cff-908c5e80598e service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:01.905625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96593e-3831-416e-9cff-908c5e80598e service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:01.905907 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96593e-3831-416e-9cff-908c5e80598e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:01.932697 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e96593e-3831-416e-9cff-908c5e80598e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:01.939428 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e96593e-3831-416e-9cff-908c5e80598e service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:01.989479 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 774/1550] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:02.558747 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248242aa-db57-46b3-9577-7b6a9c3d20ea None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:02.560177 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-248242aa-db57-46b3-9577-7b6a9c3d20ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:02.571857 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248242aa-db57-46b3-9577-7b6a9c3d20ea None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:02.576365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4d801-3692-4765-adbd-ccc4f3d65328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:02.577036 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4d801-3692-4765-adbd-ccc4f3d65328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:02.577319 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4d801-3692-4765-adbd-ccc4f3d65328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:02.577852 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4d801-3692-4765-adbd-ccc4f3d65328 admin admin] PATH_INFO: `/v3/users/880d22f1030e482e97f1f174f76cbba3` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:02.579458 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4d801-3692-4765-adbd-ccc4f3d65328 admin admin] RBAC: Authorizing `identity:delete_user(user_id=880d22f1030e482e97f1f174f76cbba3)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:02.581522 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4d801-3692-4765-adbd-ccc4f3d65328 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:02.636355 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-dff4d801-3692-4765-adbd-ccc4f3d65328 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '880d22f1030e482e97f1f174f76cbba3'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:02.637165 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-dff4d801-3692-4765-adbd-ccc4f3d65328 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '880d22f1030e482e97f1f174f76cbba3'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:02.651242 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-dff4d801-3692-4765-adbd-ccc4f3d65328 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '880d22f1030e482e97f1f174f76cbba3'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:02.652359 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-dff4d801-3692-4765-adbd-ccc4f3d65328 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '880d22f1030e482e97f1f174f76cbba3'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:02.662365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-dff4d801-3692-4765-adbd-ccc4f3d65328 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '880d22f1030e482e97f1f174f76cbba3'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:02.677451 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 777/1551] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:31:02 2022] DELETE /identity/v3/users/880d22f1030e482e97f1f174f76cbba3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:02.681928 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f60ee-90d1-44c8-94af-18b2605d9614 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:02.682427 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f60ee-90d1-44c8-94af-18b2605d9614 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:02.682427 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f60ee-90d1-44c8-94af-18b2605d9614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:02.701973 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-d67f60ee-90d1-44c8-94af-18b2605d9614 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:02.704186 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-d67f60ee-90d1-44c8-94af-18b2605d9614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:02.773135 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4d801-3692-4765-adbd-ccc4f3d65328 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:02.775113 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-dff4d801-3692-4765-adbd-ccc4f3d65328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:02.777094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 775/1552] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:02.788383 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f60ee-90d1-44c8-94af-18b2605d9614 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:02.789878 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-d67f60ee-90d1-44c8-94af-18b2605d9614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:02.799795 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4d801-3692-4765-adbd-ccc4f3d65328 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:02.806369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98391e26-824b-4442-b149-f1866b856b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:02.807600 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98391e26-824b-4442-b149-f1866b856b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:02.807600 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98391e26-824b-4442-b149-f1866b856b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:02.807600 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98391e26-824b-4442-b149-f1866b856b04 admin admin] PATH_INFO: `/v3/projects/1d8425e832ac40a6889041457f701209` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:02.809317 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98391e26-824b-4442-b149-f1866b856b04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d8425e832ac40a6889041457f701209)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:02.810861 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98391e26-824b-4442-b149-f1866b856b04 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:02.871757 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f60ee-90d1-44c8-94af-18b2605d9614 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:02.878478 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-98391e26-824b-4442-b149-f1866b856b04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d8425e832ac40a6889041457f701209', 'request_id': 'req-98391e26-824b-4442-b149-f1866b856b04'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:02.886935 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-98391e26-824b-4442-b149-f1866b856b04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d8425e832ac40a6889041457f701209', 'request_id': 'req-98391e26-824b-4442-b149-f1866b856b04'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:02.893663 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-98391e26-824b-4442-b149-f1866b856b04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d8425e832ac40a6889041457f701209', 'request_id': 'req-98391e26-824b-4442-b149-f1866b856b04'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:02.915516 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-98391e26-824b-4442-b149-f1866b856b04 admin admin] The token cache is being invalidate because project 1d8425e832ac40a6889041457f701209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:31:02.915824 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-98391e26-824b-4442-b149-f1866b856b04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:02.916537 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-98391e26-824b-4442-b149-f1866b856b04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:02.922082 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 778/1553] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:31:02 2022] DELETE /identity/v3/projects/1d8425e832ac40a6889041457f701209 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:31:02.923893 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98391e26-824b-4442-b149-f1866b856b04 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:02.926060 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-98391e26-824b-4442-b149-f1866b856b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:02.985048 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:02.998260 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2b47d-68d7-4210-aad1-3a89834d78f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:02.998891 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2b47d-68d7-4210-aad1-3a89834d78f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:02.999184 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2b47d-68d7-4210-aad1-3a89834d78f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:02.999464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2b47d-68d7-4210-aad1-3a89834d78f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:03.001871 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-aee2b47d-68d7-4210-aad1-3a89834d78f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:03.019136 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:03.037964 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98391e26-824b-4442-b149-f1866b856b04 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:03.043375 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d65e98-ee02-4427-a7d9-727faa2b887c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:03.044091 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d65e98-ee02-4427-a7d9-727faa2b887c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:03.044440 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d65e98-ee02-4427-a7d9-727faa2b887c admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:03.044839 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d65e98-ee02-4427-a7d9-727faa2b887c admin admin] PATH_INFO: `/v3/users/5d4d424712e94275b433d0d766a955cd` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:03.046223 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d65e98-ee02-4427-a7d9-727faa2b887c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d4d424712e94275b433d0d766a955cd)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:03.048318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d65e98-ee02-4427-a7d9-727faa2b887c admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:03.131876 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2b47d-68d7-4210-aad1-3a89834d78f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:03.134044 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2b47d-68d7-4210-aad1-3a89834d78f3 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:03.143749 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-a6d65e98-ee02-4427-a7d9-727faa2b887c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d4d424712e94275b433d0d766a955cd'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:03.144332 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-a6d65e98-ee02-4427-a7d9-727faa2b887c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d4d424712e94275b433d0d766a955cd'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:03.163084 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 776/1554] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 20:31:03.168507 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-a6d65e98-ee02-4427-a7d9-727faa2b887c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d4d424712e94275b433d0d766a955cd'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:03.169363 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-a6d65e98-ee02-4427-a7d9-727faa2b887c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d4d424712e94275b433d0d766a955cd'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:03.178118 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-a6d65e98-ee02-4427-a7d9-727faa2b887c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d4d424712e94275b433d0d766a955cd'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:03.209529 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 779/1555] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:31:02 2022] DELETE /identity/v3/users/5d4d424712e94275b433d0d766a955cd => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:03.432586 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2b47d-68d7-4210-aad1-3a89834d78f3 service neutron] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:03.434593 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-aee2b47d-68d7-4210-aad1-3a89834d78f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:03.455121 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2b47d-68d7-4210-aad1-3a89834d78f3 service neutron] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:03.630123 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbe90a-db67-4bad-9e2c-cb13718018aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:03.630772 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbe90a-db67-4bad-9e2c-cb13718018aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:03.631055 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbe90a-db67-4bad-9e2c-cb13718018aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:03.631331 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbe90a-db67-4bad-9e2c-cb13718018aa admin admin] PATH_INFO: `/v3/users/b15dec4102e3429abbb691d7e5a0b6cc` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:03.632474 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bbe90a-db67-4bad-9e2c-cb13718018aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b15dec4102e3429abbb691d7e5a0b6cc)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:03.634826 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bbe90a-db67-4bad-9e2c-cb13718018aa admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:03.712808 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-26bbe90a-db67-4bad-9e2c-cb13718018aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b15dec4102e3429abbb691d7e5a0b6cc'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:03.713765 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-26bbe90a-db67-4bad-9e2c-cb13718018aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b15dec4102e3429abbb691d7e5a0b6cc'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:03.723848 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-26bbe90a-db67-4bad-9e2c-cb13718018aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b15dec4102e3429abbb691d7e5a0b6cc'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:03.724915 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-26bbe90a-db67-4bad-9e2c-cb13718018aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b15dec4102e3429abbb691d7e5a0b6cc'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:03.744715 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-26bbe90a-db67-4bad-9e2c-cb13718018aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b15dec4102e3429abbb691d7e5a0b6cc'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:03.783998 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e792ca-14da-4fa5-83af-5f73595578d3 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:03.784910 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e792ca-14da-4fa5-83af-5f73595578d3 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:03.799484 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e792ca-14da-4fa5-83af-5f73595578d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:03.812681 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 777/1556] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:31:03 2022] DELETE /identity/v3/users/b15dec4102e3429abbb691d7e5a0b6cc => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:03.829061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbe90a-db67-4bad-9e2c-cb13718018aa admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:03.830570 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-66e792ca-14da-4fa5-83af-5f73595578d3 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:03.830711 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-26bbe90a-db67-4bad-9e2c-cb13718018aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:03.838101 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-66e792ca-14da-4fa5-83af-5f73595578d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:03.866854 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:03.911957 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbe90a-db67-4bad-9e2c-cb13718018aa admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:03.914608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 780/1557] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:03.915869 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e792ca-14da-4fa5-83af-5f73595578d3 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:03.921056 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-66e792ca-14da-4fa5-83af-5f73595578d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:03.928974 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df6421-878f-4b03-b168-dbacc43736c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:03.930506 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df6421-878f-4b03-b168-dbacc43736c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:03.930506 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df6421-878f-4b03-b168-dbacc43736c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:03.930506 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df6421-878f-4b03-b168-dbacc43736c1 admin admin] PATH_INFO: `/v3/projects/a853a08ef18e4e43bc2f6341c3b944fc` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:03.931414 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df6421-878f-4b03-b168-dbacc43736c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a853a08ef18e4e43bc2f6341c3b944fc)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:03.933825 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df6421-878f-4b03-b168-dbacc43736c1 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:03.934130 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e792ca-14da-4fa5-83af-5f73595578d3 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:03.939433 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae32ec-7189-4881-9b3c-426cf539ce41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:03.940151 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae32ec-7189-4881-9b3c-426cf539ce41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:03.940833 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae32ec-7189-4881-9b3c-426cf539ce41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:03.940833 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae32ec-7189-4881-9b3c-426cf539ce41 admin admin] PATH_INFO: `/v3/users/87fc45bec87944389cc3989441de9ffb` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:03.942053 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae32ec-7189-4881-9b3c-426cf539ce41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87fc45bec87944389cc3989441de9ffb)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:03.944067 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae32ec-7189-4881-9b3c-426cf539ce41 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:04.000820 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:04.001348 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-b0df6421-878f-4b03-b168-dbacc43736c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a853a08ef18e4e43bc2f6341c3b944fc', 'request_id': 'req-b0df6421-878f-4b03-b168-dbacc43736c1'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:04.010243 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-37ae32ec-7189-4881-9b3c-426cf539ce41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87fc45bec87944389cc3989441de9ffb'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:04.011343 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-37ae32ec-7189-4881-9b3c-426cf539ce41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87fc45bec87944389cc3989441de9ffb'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:04.014559 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-b0df6421-878f-4b03-b168-dbacc43736c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a853a08ef18e4e43bc2f6341c3b944fc', 'request_id': 'req-b0df6421-878f-4b03-b168-dbacc43736c1'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:04.025753 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-b0df6421-878f-4b03-b168-dbacc43736c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a853a08ef18e4e43bc2f6341c3b944fc', 'request_id': 'req-b0df6421-878f-4b03-b168-dbacc43736c1'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:04.026739 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-37ae32ec-7189-4881-9b3c-426cf539ce41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87fc45bec87944389cc3989441de9ffb'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:04.027552 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-37ae32ec-7189-4881-9b3c-426cf539ce41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87fc45bec87944389cc3989441de9ffb'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:04.036602 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-37ae32ec-7189-4881-9b3c-426cf539ce41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87fc45bec87944389cc3989441de9ffb'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:04.039132 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-b0df6421-878f-4b03-b168-dbacc43736c1 admin admin] The token cache is being invalidate because project a853a08ef18e4e43bc2f6341c3b944fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:31:04.039132 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-b0df6421-878f-4b03-b168-dbacc43736c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:04.039866 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-b0df6421-878f-4b03-b168-dbacc43736c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:04.041972 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 778/1558] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:31:03 2022] DELETE /identity/v3/projects/a853a08ef18e4e43bc2f6341c3b944fc => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:04.044630 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df6421-878f-4b03-b168-dbacc43736c1 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:04.046148 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-b0df6421-878f-4b03-b168-dbacc43736c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:04.058873 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 781/1559] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:31:03 2022] DELETE /identity/v3/users/87fc45bec87944389cc3989441de9ffb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:04.060123 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb7d60-8cc2-486a-9a5d-3e4b386f11aa None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:04.060414 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb7d60-8cc2-486a-9a5d-3e4b386f11aa None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:04.060744 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb7d60-8cc2-486a-9a5d-3e4b386f11aa None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:04.062319 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 782/1560] 10.222.0.23 () {54 vars in 921 bytes} [Wed Nov 2 20:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:31:04.063110 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb7d60-8cc2-486a-9a5d-3e4b386f11aa None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:04.065183 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-fecb7d60-8cc2-486a-9a5d-3e4b386f11aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:04.133045 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df6421-878f-4b03-b168-dbacc43736c1 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:04.143613 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb7d60-8cc2-486a-9a5d-3e4b386f11aa None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:04.149642 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faff18c-95d8-43fd-9daa-21eb81a6d2fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:04.150545 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faff18c-95d8-43fd-9daa-21eb81a6d2fe service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:04.150829 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faff18c-95d8-43fd-9daa-21eb81a6d2fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:04.151107 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faff18c-95d8-43fd-9daa-21eb81a6d2fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:04.153543 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-0faff18c-95d8-43fd-9daa-21eb81a6d2fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:04.215993 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cf1e3-bc25-4f31-9d7e-903f9e504da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:04.216755 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cf1e3-bc25-4f31-9d7e-903f9e504da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:04.217037 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cf1e3-bc25-4f31-9d7e-903f9e504da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:04.217311 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cf1e3-bc25-4f31-9d7e-903f9e504da8 admin admin] PATH_INFO: `/v3/projects/5c1b9c9443da479fa91562945b5c3b03` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:04.224393 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cf1e3-bc25-4f31-9d7e-903f9e504da8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c1b9c9443da479fa91562945b5c3b03)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:04.231454 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cf1e3-bc25-4f31-9d7e-903f9e504da8 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:04.237737 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:04.245353 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faff18c-95d8-43fd-9daa-21eb81a6d2fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:04.247113 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faff18c-95d8-43fd-9daa-21eb81a6d2fe service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:04.261173 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 783/1561] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:04.262101 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faff18c-95d8-43fd-9daa-21eb81a6d2fe service neutron] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:04.264639 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-0faff18c-95d8-43fd-9daa-21eb81a6d2fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:04.292725 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faff18c-95d8-43fd-9daa-21eb81a6d2fe service neutron] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:04.299490 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2cedd4-bd54-4dc1-92c9-112057accab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:04.300731 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cedd4-bd54-4dc1-92c9-112057accab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:04.301121 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cedd4-bd54-4dc1-92c9-112057accab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:04.301481 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cedd4-bd54-4dc1-92c9-112057accab9 admin admin] PATH_INFO: `/v3/users/e83711c41e8c474394e2615e3727f570` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:04.303260 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2cedd4-bd54-4dc1-92c9-112057accab9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e83711c41e8c474394e2615e3727f570)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:04.305627 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2cedd4-bd54-4dc1-92c9-112057accab9 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:04.366345 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-de2cf1e3-bc25-4f31-9d7e-903f9e504da8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c1b9c9443da479fa91562945b5c3b03', 'request_id': 'req-de2cf1e3-bc25-4f31-9d7e-903f9e504da8'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:04.378802 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-7c2cedd4-bd54-4dc1-92c9-112057accab9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e83711c41e8c474394e2615e3727f570'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:04.379702 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-7c2cedd4-bd54-4dc1-92c9-112057accab9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e83711c41e8c474394e2615e3727f570'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:04.384207 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-de2cf1e3-bc25-4f31-9d7e-903f9e504da8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c1b9c9443da479fa91562945b5c3b03', 'request_id': 'req-de2cf1e3-bc25-4f31-9d7e-903f9e504da8'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:04.400891 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:04.404251 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-de2cf1e3-bc25-4f31-9d7e-903f9e504da8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c1b9c9443da479fa91562945b5c3b03', 'request_id': 'req-de2cf1e3-bc25-4f31-9d7e-903f9e504da8'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:04.405109 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-7c2cedd4-bd54-4dc1-92c9-112057accab9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e83711c41e8c474394e2615e3727f570'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:04.405844 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-7c2cedd4-bd54-4dc1-92c9-112057accab9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e83711c41e8c474394e2615e3727f570'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:04.428620 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-de2cf1e3-bc25-4f31-9d7e-903f9e504da8 admin admin] The token cache is being invalidate because project 5c1b9c9443da479fa91562945b5c3b03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:31:04.428620 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-de2cf1e3-bc25-4f31-9d7e-903f9e504da8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:04.429496 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-de2cf1e3-bc25-4f31-9d7e-903f9e504da8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:04.429869 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-7c2cedd4-bd54-4dc1-92c9-112057accab9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e83711c41e8c474394e2615e3727f570'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:04.443490 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 779/1562] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:31:04 2022] DELETE /identity/v3/projects/5c1b9c9443da479fa91562945b5c3b03 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:04.443490 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03a719-913e-47ad-9764-915eaa7d4d52 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:04.443490 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03a719-913e-47ad-9764-915eaa7d4d52 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:04.443490 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03a719-913e-47ad-9764-915eaa7d4d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:04.453641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 784/1563] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:31:04 2022] DELETE /identity/v3/users/e83711c41e8c474394e2615e3727f570 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:04.455228 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc48a6-cc1f-4ff4-abd0-5300b8a17135 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:04.455522 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc48a6-cc1f-4ff4-abd0-5300b8a17135 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:04.455808 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc48a6-cc1f-4ff4-abd0-5300b8a17135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:04.469968 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-fb03a719-913e-47ad-9764-915eaa7d4d52 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:04.471210 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-fb03a719-913e-47ad-9764-915eaa7d4d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:04.499656 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-ffcc48a6-cc1f-4ff4-abd0-5300b8a17135 None None] MFA Rules not processed for user `f906fd11db004026a78eb3d69fa5b298`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:04.500984 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-ffcc48a6-cc1f-4ff4-abd0-5300b8a17135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:04.593298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 780/1564] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:04.595677 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2b4cb-1b7c-45d5-b1bb-44eb6572c819 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:04.598038 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2b4cb-1b7c-45d5-b1bb-44eb6572c819 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:04.599879 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2b4cb-1b7c-45d5-b1bb-44eb6572c819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:04.629201 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-98f2b4cb-1b7c-45d5-b1bb-44eb6572c819 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:04.630766 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-98f2b4cb-1b7c-45d5-b1bb-44eb6572c819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:04.633815 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 785/1565] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Nov 2 20:31:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:04.636018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc48a6-cc1f-4ff4-abd0-5300b8a17135 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:04.638387 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-ffcc48a6-cc1f-4ff4-abd0-5300b8a17135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:04.641578 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 781/1566] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:04.659892 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b8932-1e7c-4fe0-bff6-d6cf68568e7d None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:04.660812 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b8932-1e7c-4fe0-bff6-d6cf68568e7d None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:04.660812 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b8932-1e7c-4fe0-bff6-d6cf68568e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:04.689396 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-a91b8932-1e7c-4fe0-bff6-d6cf68568e7d None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:04.690722 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-a91b8932-1e7c-4fe0-bff6-d6cf68568e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:04.707824 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 782/1567] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:04.707824 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b8932-1e7c-4fe0-bff6-d6cf68568e7d None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:04.708954 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-a91b8932-1e7c-4fe0-bff6-d6cf68568e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:04.733573 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b8932-1e7c-4fe0-bff6-d6cf68568e7d None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:04.741462 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25211ed-3dd8-48f4-b7fc-2d97afc86f29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:04.742641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25211ed-3dd8-48f4-b7fc-2d97afc86f29 service nova] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:04.743024 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25211ed-3dd8-48f4-b7fc-2d97afc86f29 service nova] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:04.743309 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25211ed-3dd8-48f4-b7fc-2d97afc86f29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:04.743437 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc48a6-cc1f-4ff4-abd0-5300b8a17135 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:04.747516 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3aff62-76c3-40e2-a24a-79c4d173ae19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:04.748160 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3aff62-76c3-40e2-a24a-79c4d173ae19 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:04.748440 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3aff62-76c3-40e2-a24a-79c4d173ae19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:04.748747 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3aff62-76c3-40e2-a24a-79c4d173ae19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:04.755834 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25211ed-3dd8-48f4-b7fc-2d97afc86f29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:04.759359 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25211ed-3dd8-48f4-b7fc-2d97afc86f29 service nova] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:04.761359 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3aff62-76c3-40e2-a24a-79c4d173ae19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:04.762807 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3aff62-76c3-40e2-a24a-79c4d173ae19 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:04.774705 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 786/1568] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:04.775566 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3aff62-76c3-40e2-a24a-79c4d173ae19 service neutron] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:04.783502 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 783/1569] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:04.792502 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3aff62-76c3-40e2-a24a-79c4d173ae19 service neutron] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:04.799206 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d91b7-4b2d-4d59-aa19-27f26a226ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:04.799979 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d91b7-4b2d-4d59-aa19-27f26a226ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:04.800328 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d91b7-4b2d-4d59-aa19-27f26a226ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:04.800666 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d91b7-4b2d-4d59-aa19-27f26a226ec1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:04.801443 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d91b7-4b2d-4d59-aa19-27f26a226ec1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:31:04.801750 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d91b7-4b2d-4d59-aa19-27f26a226ec1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:04.804426 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d91b7-4b2d-4d59-aa19-27f26a226ec1 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:04.825199 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 787/1570] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:31:04.830182 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25211ed-3dd8-48f4-b7fc-2d97afc86f29 service nova] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:04.848608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25211ed-3dd8-48f4-b7fc-2d97afc86f29 service nova] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:04.853920 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034db2b-61e3-4747-b881-34a1841bc3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:04.854550 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034db2b-61e3-4747-b881-34a1841bc3b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:04.855311 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034db2b-61e3-4747-b881-34a1841bc3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:04.855421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034db2b-61e3-4747-b881-34a1841bc3b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:04.856255 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034db2b-61e3-4747-b881-34a1841bc3b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:04.858076 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034db2b-61e3-4747-b881-34a1841bc3b8 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:04.902235 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d91b7-4b2d-4d59-aa19-27f26a226ec1 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:04.905014 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-014d91b7-4b2d-4d59-aa19-27f26a226ec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:04.949969 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 784/1571] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:31:04 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:04.950075 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d91b7-4b2d-4d59-aa19-27f26a226ec1 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:04.952955 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034db2b-61e3-4747-b881-34a1841bc3b8 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:05.064663 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca7f23-9188-4ed3-af5a-19c5fb00887b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:05.065910 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca7f23-9188-4ed3-af5a-19c5fb00887b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:05.066202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca7f23-9188-4ed3-af5a-19c5fb00887b admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:05.066476 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca7f23-9188-4ed3-af5a-19c5fb00887b admin admin] PATH_INFO: `/v3/projects/4254d074357f4f678851ed518716ddda` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:05.068126 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca7f23-9188-4ed3-af5a-19c5fb00887b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4254d074357f4f678851ed518716ddda)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:05.070486 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca7f23-9188-4ed3-af5a-19c5fb00887b admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:05.071630 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:05.073542 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:05.101802 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034db2b-61e3-4747-b881-34a1841bc3b8 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:05.107592 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0cd5a-825f-46c8-90c0-544119c101aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:05.108470 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0cd5a-825f-46c8-90c0-544119c101aa admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:05.108873 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0cd5a-825f-46c8-90c0-544119c101aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:05.109249 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0cd5a-825f-46c8-90c0-544119c101aa admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:05.110140 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0cd5a-825f-46c8-90c0-544119c101aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:05.112351 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0cd5a-825f-46c8-90c0-544119c101aa admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:05.165450 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 785/1572] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:31:04 2022] POST /identity/v3/users => generated 286 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:05.165995 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-07ca7f23-9188-4ed3-af5a-19c5fb00887b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4254d074357f4f678851ed518716ddda', 'request_id': 'req-07ca7f23-9188-4ed3-af5a-19c5fb00887b'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:05.168787 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0cd5a-825f-46c8-90c0-544119c101aa admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:05.173669 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-07ca7f23-9188-4ed3-af5a-19c5fb00887b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4254d074357f4f678851ed518716ddda', 'request_id': 'req-07ca7f23-9188-4ed3-af5a-19c5fb00887b'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:05.184079 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-07ca7f23-9188-4ed3-af5a-19c5fb00887b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4254d074357f4f678851ed518716ddda', 'request_id': 'req-07ca7f23-9188-4ed3-af5a-19c5fb00887b'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:05.187526 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0cd5a-825f-46c8-90c0-544119c101aa admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:05.207277 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-07ca7f23-9188-4ed3-af5a-19c5fb00887b admin admin] The token cache is being invalidate because project 4254d074357f4f678851ed518716ddda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:31:05.208152 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-07ca7f23-9188-4ed3-af5a-19c5fb00887b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:05.210500 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-07ca7f23-9188-4ed3-af5a-19c5fb00887b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:05.213005 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 788/1573] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:31:04 2022] DELETE /identity/v3/projects/4254d074357f4f678851ed518716ddda => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:05.217861 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca7f23-9188-4ed3-af5a-19c5fb00887b admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:05.221100 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-07ca7f23-9188-4ed3-af5a-19c5fb00887b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:05.305075 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16286d-3701-4dc3-8341-4a4c88fae204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:05.305730 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16286d-3701-4dc3-8341-4a4c88fae204 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:05.306061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16286d-3701-4dc3-8341-4a4c88fae204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:05.306284 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16286d-3701-4dc3-8341-4a4c88fae204 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:05.311916 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd16286d-3701-4dc3-8341-4a4c88fae204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:05.314389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd16286d-3701-4dc3-8341-4a4c88fae204 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:05.332923 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 786/1574] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:31:05.334857 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16286d-3701-4dc3-8341-4a4c88fae204 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:05.338338 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-bd16286d-3701-4dc3-8341-4a4c88fae204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:05.346606 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca7f23-9188-4ed3-af5a-19c5fb00887b admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:05.353701 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511efe58-a82e-438a-b2d3-26b7d9cb1390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:05.354541 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511efe58-a82e-438a-b2d3-26b7d9cb1390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:05.354859 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511efe58-a82e-438a-b2d3-26b7d9cb1390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:05.355292 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511efe58-a82e-438a-b2d3-26b7d9cb1390 admin admin] PATH_INFO: `/v3/users/de486ad467604b96ae2c87c2496ade26` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:05.355421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16286d-3701-4dc3-8341-4a4c88fae204 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:05.356862 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511efe58-a82e-438a-b2d3-26b7d9cb1390 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de486ad467604b96ae2c87c2496ade26)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:05.359910 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511efe58-a82e-438a-b2d3-26b7d9cb1390 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:05.362892 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58d66e-1b1a-4d20-8750-b4e93ef46d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:05.363679 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58d66e-1b1a-4d20-8750-b4e93ef46d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:05.364037 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58d66e-1b1a-4d20-8750-b4e93ef46d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:05.364388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58d66e-1b1a-4d20-8750-b4e93ef46d1e admin admin] PATH_INFO: `/v3/projects/30ad137fea5c4b2cbfa05afc4508cd20` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:05.365960 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58d66e-1b1a-4d20-8750-b4e93ef46d1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=30ad137fea5c4b2cbfa05afc4508cd20)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:05.367963 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58d66e-1b1a-4d20-8750-b4e93ef46d1e admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:05.420955 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-511efe58-a82e-438a-b2d3-26b7d9cb1390 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de486ad467604b96ae2c87c2496ade26'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:05.421964 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-511efe58-a82e-438a-b2d3-26b7d9cb1390 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de486ad467604b96ae2c87c2496ade26'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:05.441445 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-7e58d66e-1b1a-4d20-8750-b4e93ef46d1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30ad137fea5c4b2cbfa05afc4508cd20', 'request_id': 'req-7e58d66e-1b1a-4d20-8750-b4e93ef46d1e'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:05.446770 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-511efe58-a82e-438a-b2d3-26b7d9cb1390 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de486ad467604b96ae2c87c2496ade26'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:05.448758 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-511efe58-a82e-438a-b2d3-26b7d9cb1390 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de486ad467604b96ae2c87c2496ade26'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:05.458871 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-7e58d66e-1b1a-4d20-8750-b4e93ef46d1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30ad137fea5c4b2cbfa05afc4508cd20', 'request_id': 'req-7e58d66e-1b1a-4d20-8750-b4e93ef46d1e'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:05.459947 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-511efe58-a82e-438a-b2d3-26b7d9cb1390 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de486ad467604b96ae2c87c2496ade26'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:05.473843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-7e58d66e-1b1a-4d20-8750-b4e93ef46d1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30ad137fea5c4b2cbfa05afc4508cd20', 'request_id': 'req-7e58d66e-1b1a-4d20-8750-b4e93ef46d1e'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:05.491068 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-7e58d66e-1b1a-4d20-8750-b4e93ef46d1e admin admin] The token cache is being invalidate because project 30ad137fea5c4b2cbfa05afc4508cd20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:31:05.491481 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-7e58d66e-1b1a-4d20-8750-b4e93ef46d1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:05.492239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-7e58d66e-1b1a-4d20-8750-b4e93ef46d1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:05.494575 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 787/1576] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:31:05 2022] DELETE /identity/v3/projects/30ad137fea5c4b2cbfa05afc4508cd20 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:05.495650 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58d66e-1b1a-4d20-8750-b4e93ef46d1e admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:05.499368 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-7e58d66e-1b1a-4d20-8750-b4e93ef46d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:05.505300 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 789/1576] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:31:05 2022] DELETE /identity/v3/users/de486ad467604b96ae2c87c2496ade26 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:31:05.506331 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511efe58-a82e-438a-b2d3-26b7d9cb1390 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:05.508196 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-511efe58-a82e-438a-b2d3-26b7d9cb1390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:05.531668 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:05.637339 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:05.640570 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511efe58-a82e-438a-b2d3-26b7d9cb1390 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:05.654908 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517b281-506d-4634-b9c0-fa5e71e66610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:05.655603 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517b281-506d-4634-b9c0-fa5e71e66610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:05.655890 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517b281-506d-4634-b9c0-fa5e71e66610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:05.656336 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517b281-506d-4634-b9c0-fa5e71e66610 admin admin] PATH_INFO: `/v3/projects/16d7e8f125ee49c59996fd1dd34388b7` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:05.658115 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3517b281-506d-4634-b9c0-fa5e71e66610 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16d7e8f125ee49c59996fd1dd34388b7)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:05.658363 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58d66e-1b1a-4d20-8750-b4e93ef46d1e admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:05.661081 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3517b281-506d-4634-b9c0-fa5e71e66610 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:05.664279 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459405b-ddd2-43e2-b3c0-daadfbc1e589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:05.665091 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459405b-ddd2-43e2-b3c0-daadfbc1e589 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:05.665515 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459405b-ddd2-43e2-b3c0-daadfbc1e589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:05.665897 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459405b-ddd2-43e2-b3c0-daadfbc1e589 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:05.666655 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3459405b-ddd2-43e2-b3c0-daadfbc1e589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:05.668905 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3459405b-ddd2-43e2-b3c0-daadfbc1e589 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:05.683222 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 788/1577] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:05.685796 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd47147-ff73-49d8-92e5-419df8892565 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:05.686472 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd47147-ff73-49d8-92e5-419df8892565 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:05.686833 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd47147-ff73-49d8-92e5-419df8892565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:05.718975 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-abd47147-ff73-49d8-92e5-419df8892565 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:05.721251 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-abd47147-ff73-49d8-92e5-419df8892565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:05.733518 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-3517b281-506d-4634-b9c0-fa5e71e66610 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16d7e8f125ee49c59996fd1dd34388b7', 'request_id': 'req-3517b281-506d-4634-b9c0-fa5e71e66610'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:05.741027 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-3517b281-506d-4634-b9c0-fa5e71e66610 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16d7e8f125ee49c59996fd1dd34388b7', 'request_id': 'req-3517b281-506d-4634-b9c0-fa5e71e66610'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:05.751139 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-3517b281-506d-4634-b9c0-fa5e71e66610 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16d7e8f125ee49c59996fd1dd34388b7', 'request_id': 'req-3517b281-506d-4634-b9c0-fa5e71e66610'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:05.769680 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-3517b281-506d-4634-b9c0-fa5e71e66610 admin admin] The token cache is being invalidate because project 16d7e8f125ee49c59996fd1dd34388b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:31:05.770110 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-3517b281-506d-4634-b9c0-fa5e71e66610 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:05.770939 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-3517b281-506d-4634-b9c0-fa5e71e66610 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:05.775871 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 790/1578] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:31:05 2022] DELETE /identity/v3/projects/16d7e8f125ee49c59996fd1dd34388b7 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:05.775871 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517b281-506d-4634-b9c0-fa5e71e66610 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:05.776069 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-3517b281-506d-4634-b9c0-fa5e71e66610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:05.803416 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 789/1579] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:05.804569 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd47147-ff73-49d8-92e5-419df8892565 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:05.806166 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-abd47147-ff73-49d8-92e5-419df8892565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:05.820119 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd47147-ff73-49d8-92e5-419df8892565 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:05.825779 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63acc886-af05-41bb-8744-67a5cc36d4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:05.826428 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acc886-af05-41bb-8744-67a5cc36d4d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:05.826711 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acc886-af05-41bb-8744-67a5cc36d4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:05.826991 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acc886-af05-41bb-8744-67a5cc36d4d1 admin admin] PATH_INFO: `/v3/users/7a5f94ce2ea24d9a93f1c0fce467e01e` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:05.829126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63acc886-af05-41bb-8744-67a5cc36d4d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a5f94ce2ea24d9a93f1c0fce467e01e)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:05.831170 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63acc886-af05-41bb-8744-67a5cc36d4d1 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:05.899437 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517b281-506d-4634-b9c0-fa5e71e66610 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:05.905529 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916785de-a214-4203-ba21-5101786932c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:05.906290 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916785de-a214-4203-ba21-5101786932c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:05.907157 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916785de-a214-4203-ba21-5101786932c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:05.907528 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916785de-a214-4203-ba21-5101786932c1 admin admin] PATH_INFO: `/v3/projects/fba56766600d430da6ccd3c3e79997ee/users/2aa96af0e5cd47248b91910171bb66b5/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:05.913194 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-63acc886-af05-41bb-8744-67a5cc36d4d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a5f94ce2ea24d9a93f1c0fce467e01e'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:05.913954 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-63acc886-af05-41bb-8744-67a5cc36d4d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a5f94ce2ea24d9a93f1c0fce467e01e'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:05.923187 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-63acc886-af05-41bb-8744-67a5cc36d4d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a5f94ce2ea24d9a93f1c0fce467e01e'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:05.924086 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-63acc886-af05-41bb-8744-67a5cc36d4d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a5f94ce2ea24d9a93f1c0fce467e01e'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:05.929118 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916785de-a214-4203-ba21-5101786932c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fba56766600d430da6ccd3c3e79997ee, user_id=2aa96af0e5cd47248b91910171bb66b5, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:05.932000 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916785de-a214-4203-ba21-5101786932c1 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:05.948962 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-63acc886-af05-41bb-8744-67a5cc36d4d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a5f94ce2ea24d9a93f1c0fce467e01e'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:05.955211 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 791/1580] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:31:05 2022] PUT /identity/v3/projects/fba56766600d430da6ccd3c3e79997ee/users/2aa96af0e5cd47248b91910171bb66b5/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:05.958969 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e9dca-7496-4118-ae9a-39129c6d3253 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:05.959553 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e9dca-7496-4118-ae9a-39129c6d3253 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:05.960005 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e9dca-7496-4118-ae9a-39129c6d3253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:05.976697 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 790/1581] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:31:05 2022] DELETE /identity/v3/users/7a5f94ce2ea24d9a93f1c0fce467e01e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:05.976697 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce12618-a8e9-4c7d-b376-a5816e6b7fbd None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:05.976952 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce12618-a8e9-4c7d-b376-a5816e6b7fbd None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:05.977556 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce12618-a8e9-4c7d-b376-a5816e6b7fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:05.984492 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-7d6e9dca-7496-4118-ae9a-39129c6d3253 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:05.986131 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-7d6e9dca-7496-4118-ae9a-39129c6d3253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:06.006648 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:06.019733 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-fce12618-a8e9-4c7d-b376-a5816e6b7fbd None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:06.023288 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-fce12618-a8e9-4c7d-b376-a5816e6b7fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:06.063814 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 792/1582] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:06.066881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e9dca-7496-4118-ae9a-39129c6d3253 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:06.066881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-7d6e9dca-7496-4118-ae9a-39129c6d3253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:06.081757 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e9dca-7496-4118-ae9a-39129c6d3253 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:06.088085 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc18670-e062-4d51-8f0b-c4a73cbf5587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:06.088936 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc18670-e062-4d51-8f0b-c4a73cbf5587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:06.089326 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc18670-e062-4d51-8f0b-c4a73cbf5587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:06.089858 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc18670-e062-4d51-8f0b-c4a73cbf5587 admin admin] PATH_INFO: `/v3/projects/72ab136d112643a5835d75f0d7eb5529` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:06.091277 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc18670-e062-4d51-8f0b-c4a73cbf5587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72ab136d112643a5835d75f0d7eb5529)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:06.093854 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc18670-e062-4d51-8f0b-c4a73cbf5587 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:06.135296 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 791/1583] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:06.135296 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce12618-a8e9-4c7d-b376-a5816e6b7fbd None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:06.139483 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:06.148233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce12618-a8e9-4c7d-b376-a5816e6b7fbd None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:06.153194 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-2bc18670-e062-4d51-8f0b-c4a73cbf5587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72ab136d112643a5835d75f0d7eb5529', 'request_id': 'req-2bc18670-e062-4d51-8f0b-c4a73cbf5587'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:06.160273 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-2bc18670-e062-4d51-8f0b-c4a73cbf5587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72ab136d112643a5835d75f0d7eb5529', 'request_id': 'req-2bc18670-e062-4d51-8f0b-c4a73cbf5587'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:06.167270 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-2bc18670-e062-4d51-8f0b-c4a73cbf5587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72ab136d112643a5835d75f0d7eb5529', 'request_id': 'req-2bc18670-e062-4d51-8f0b-c4a73cbf5587'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:06.183339 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-2bc18670-e062-4d51-8f0b-c4a73cbf5587 admin admin] The token cache is being invalidate because project 72ab136d112643a5835d75f0d7eb5529 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:31:06.183896 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-2bc18670-e062-4d51-8f0b-c4a73cbf5587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:06.184584 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-2bc18670-e062-4d51-8f0b-c4a73cbf5587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:06.186654 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 793/1584] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:31:06 2022] DELETE /identity/v3/projects/72ab136d112643a5835d75f0d7eb5529 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:06.187695 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc18670-e062-4d51-8f0b-c4a73cbf5587 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:06.189565 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-2bc18670-e062-4d51-8f0b-c4a73cbf5587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:06.228763 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad474e-faf0-43b7-9716-d93a4153ab1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:06.229529 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad474e-faf0-43b7-9716-d93a4153ab1f admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:06.229819 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad474e-faf0-43b7-9716-d93a4153ab1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:06.230377 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad474e-faf0-43b7-9716-d93a4153ab1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:06.231045 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad474e-faf0-43b7-9716-d93a4153ab1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:31:06.231417 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad474e-faf0-43b7-9716-d93a4153ab1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:06.233402 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad474e-faf0-43b7-9716-d93a4153ab1f admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:06.258156 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 792/1585] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:31:06.260967 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68bf1a-3cfe-41de-98f1-86be3b781485 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:06.261236 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68bf1a-3cfe-41de-98f1-86be3b781485 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:06.261548 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68bf1a-3cfe-41de-98f1-86be3b781485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:06.265979 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc18670-e062-4d51-8f0b-c4a73cbf5587 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:06.270754 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ceaa7a-6600-4f3e-b064-e0aa6f6366b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:06.271622 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ceaa7a-6600-4f3e-b064-e0aa6f6366b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:06.271622 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ceaa7a-6600-4f3e-b064-e0aa6f6366b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:06.272061 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ceaa7a-6600-4f3e-b064-e0aa6f6366b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:06.274600 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-46ceaa7a-6600-4f3e-b064-e0aa6f6366b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:06.285994 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-6a68bf1a-3cfe-41de-98f1-86be3b781485 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:06.287298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-6a68bf1a-3cfe-41de-98f1-86be3b781485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:06.289408 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ceaa7a-6600-4f3e-b064-e0aa6f6366b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:06.290865 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ceaa7a-6600-4f3e-b064-e0aa6f6366b3 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:06.297215 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 793/1586] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:06.304815 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68bf1a-3cfe-41de-98f1-86be3b781485 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:06.305571 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 794/1587] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:06.306482 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-6a68bf1a-3cfe-41de-98f1-86be3b781485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:06.307328 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c013fb1-eea2-461c-80a9-afe11d9f5612 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:06.307795 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c013fb1-eea2-461c-80a9-afe11d9f5612 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:06.308221 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c013fb1-eea2-461c-80a9-afe11d9f5612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:06.320470 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68bf1a-3cfe-41de-98f1-86be3b781485 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:06.326575 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266dd805-1180-41a7-9efd-97c9b871ee14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:06.327198 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266dd805-1180-41a7-9efd-97c9b871ee14 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:06.327484 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266dd805-1180-41a7-9efd-97c9b871ee14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:06.328023 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266dd805-1180-41a7-9efd-97c9b871ee14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:06.328800 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266dd805-1180-41a7-9efd-97c9b871ee14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:06.330983 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266dd805-1180-41a7-9efd-97c9b871ee14 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:06.337649 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-8c013fb1-eea2-461c-80a9-afe11d9f5612 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:06.339211 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-8c013fb1-eea2-461c-80a9-afe11d9f5612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:06.362735 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 795/1588] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:06.364721 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 794/1589] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:31:06 2022] POST /identity/v3/projects => generated 367 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:06.366479 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c013fb1-eea2-461c-80a9-afe11d9f5612 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:06.369267 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266dd805-1180-41a7-9efd-97c9b871ee14 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:06.381910 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c013fb1-eea2-461c-80a9-afe11d9f5612 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:06.428044 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:06.443985 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266dd805-1180-41a7-9efd-97c9b871ee14 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:06.449798 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f656540-fb90-46b7-aac4-2a29c2fe6b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:06.450576 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f656540-fb90-46b7-aac4-2a29c2fe6b0d admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:06.450863 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f656540-fb90-46b7-aac4-2a29c2fe6b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:06.451116 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95ea3c-4958-4c92-a380-cff1f70a0c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:06.451228 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f656540-fb90-46b7-aac4-2a29c2fe6b0d admin admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:06.451789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f656540-fb90-46b7-aac4-2a29c2fe6b0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:31:06.451990 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95ea3c-4958-4c92-a380-cff1f70a0c91 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:06.452229 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f656540-fb90-46b7-aac4-2a29c2fe6b0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:06.452451 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95ea3c-4958-4c92-a380-cff1f70a0c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:06.453121 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95ea3c-4958-4c92-a380-cff1f70a0c91 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:06.453916 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be95ea3c-4958-4c92-a380-cff1f70a0c91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:06.454171 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f656540-fb90-46b7-aac4-2a29c2fe6b0d admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:06.456056 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be95ea3c-4958-4c92-a380-cff1f70a0c91 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:06.473352 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 795/1590] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:31:06.474802 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f656540-fb90-46b7-aac4-2a29c2fe6b0d admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:06.482667 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 796/1591] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:31:06 2022] POST /identity/v3/users => generated 284 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:31:06.484105 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95ea3c-4958-4c92-a380-cff1f70a0c91 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:06.486304 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f656540-fb90-46b7-aac4-2a29c2fe6b0d admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:06.492671 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523fb902-2308-44f1-addc-854178620e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:06.493293 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fb902-2308-44f1-addc-854178620e55 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:06.493583 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fb902-2308-44f1-addc-854178620e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:06.493867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fb902-2308-44f1-addc-854178620e55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:06.494511 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523fb902-2308-44f1-addc-854178620e55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:06.494965 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95ea3c-4958-4c92-a380-cff1f70a0c91 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:06.496485 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523fb902-2308-44f1-addc-854178620e55 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:06.499973 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7e9a7-8c53-4c79-bc4a-d10b1543c7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:06.501218 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7e9a7-8c53-4c79-bc4a-d10b1543c7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:06.501573 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7e9a7-8c53-4c79-bc4a-d10b1543c7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:06.501939 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7e9a7-8c53-4c79-bc4a-d10b1543c7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:06.502654 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd7e9a7-8c53-4c79-bc4a-d10b1543c7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:06.504335 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd7e9a7-8c53-4c79-bc4a-d10b1543c7d0 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:06.520589 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 797/1592] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:31:06.522482 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7e9a7-8c53-4c79-bc4a-d10b1543c7d0 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:06.535954 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7e9a7-8c53-4c79-bc4a-d10b1543c7d0 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:06.537978 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 796/1593] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:31:06 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:06.541939 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523fb902-2308-44f1-addc-854178620e55 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:06.605735 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:06.622704 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639ad07-65f2-4e6a-bdaa-d7fc93bb37d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:06.624727 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639ad07-65f2-4e6a-bdaa-d7fc93bb37d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:06.625009 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639ad07-65f2-4e6a-bdaa-d7fc93bb37d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:06.625326 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639ad07-65f2-4e6a-bdaa-d7fc93bb37d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:06.626629 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639ad07-65f2-4e6a-bdaa-d7fc93bb37d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:06.634513 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639ad07-65f2-4e6a-bdaa-d7fc93bb37d5 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:06.634806 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523fb902-2308-44f1-addc-854178620e55 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:06.642362 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b6cda-2e91-40e1-b81f-49941f07889c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:06.642934 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b6cda-2e91-40e1-b81f-49941f07889c admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:06.643263 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b6cda-2e91-40e1-b81f-49941f07889c admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:06.643547 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b6cda-2e91-40e1-b81f-49941f07889c admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:06.645836 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b6cda-2e91-40e1-b81f-49941f07889c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:06.649852 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b6cda-2e91-40e1-b81f-49941f07889c admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:06.663786 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 798/1594] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:06.663786 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639ad07-65f2-4e6a-bdaa-d7fc93bb37d5 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:06.667048 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-4639ad07-65f2-4e6a-bdaa-d7fc93bb37d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:06.683204 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639ad07-65f2-4e6a-bdaa-d7fc93bb37d5 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:06.687532 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 797/1595] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:31:06 2022] POST /identity/v3/users => generated 292 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:06.688393 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b6cda-2e91-40e1-b81f-49941f07889c admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:06.688672 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6f440-d47b-4db2-8754-c9dd363e0a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:06.689305 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6f440-d47b-4db2-8754-c9dd363e0a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:06.689588 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6f440-d47b-4db2-8754-c9dd363e0a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:06.690240 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6f440-d47b-4db2-8754-c9dd363e0a1f admin admin] PATH_INFO: `/v3/projects/75d7d4a46bbc4893a41847f45b5eca84` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:06.691382 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c6f440-d47b-4db2-8754-c9dd363e0a1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=75d7d4a46bbc4893a41847f45b5eca84)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:06.693324 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c6f440-d47b-4db2-8754-c9dd363e0a1f admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:06.709958 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b6cda-2e91-40e1-b81f-49941f07889c admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:06.722067 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5746e-46f9-4d3f-b611-78a9ded84b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:06.723441 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5746e-46f9-4d3f-b611-78a9ded84b81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:06.723983 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5746e-46f9-4d3f-b611-78a9ded84b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:06.724647 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5746e-46f9-4d3f-b611-78a9ded84b81 admin admin] PATH_INFO: `/v3/projects/7828b406acfa40e6bad1404e48ccfcf2/users/e7a4007e8c3a4221883d101475937039/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:06.754068 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5746e-46f9-4d3f-b611-78a9ded84b81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7828b406acfa40e6bad1404e48ccfcf2, user_id=e7a4007e8c3a4221883d101475937039, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:06.757157 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5746e-46f9-4d3f-b611-78a9ded84b81 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:06.775811 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 798/1596] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:31:06 2022] PUT /identity/v3/projects/7828b406acfa40e6bad1404e48ccfcf2/users/e7a4007e8c3a4221883d101475937039/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:06.786395 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5746e-46f9-4d3f-b611-78a9ded84b81 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:06.786637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-44c6f440-d47b-4db2-8754-c9dd363e0a1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75d7d4a46bbc4893a41847f45b5eca84', 'request_id': 'req-44c6f440-d47b-4db2-8754-c9dd363e0a1f'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:06.795058 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-44c6f440-d47b-4db2-8754-c9dd363e0a1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75d7d4a46bbc4893a41847f45b5eca84', 'request_id': 'req-44c6f440-d47b-4db2-8754-c9dd363e0a1f'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:06.806394 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-44c6f440-d47b-4db2-8754-c9dd363e0a1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75d7d4a46bbc4893a41847f45b5eca84', 'request_id': 'req-44c6f440-d47b-4db2-8754-c9dd363e0a1f'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:06.825471 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-44c6f440-d47b-4db2-8754-c9dd363e0a1f admin admin] The token cache is being invalidate because project 75d7d4a46bbc4893a41847f45b5eca84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:31:06.825875 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-44c6f440-d47b-4db2-8754-c9dd363e0a1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:06.826872 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-44c6f440-d47b-4db2-8754-c9dd363e0a1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:06.829582 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 799/1597] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:31:06 2022] DELETE /identity/v3/projects/75d7d4a46bbc4893a41847f45b5eca84 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:06.831408 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22de24-2ac2-432c-9baa-e45a078a33af None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:06.831985 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22de24-2ac2-432c-9baa-e45a078a33af None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:06.832444 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22de24-2ac2-432c-9baa-e45a078a33af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:06.869344 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5746e-46f9-4d3f-b611-78a9ded84b81 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:06.870803 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-9a22de24-2ac2-432c-9baa-e45a078a33af None None] MFA Rules not processed for user `e7a4007e8c3a4221883d101475937039`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:06.874729 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50bbbc2-48ce-48b1-9322-0e61c3d333f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:06.875460 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bbbc2-48ce-48b1-9322-0e61c3d333f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:06.875875 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bbbc2-48ce-48b1-9322-0e61c3d333f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:06.876252 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bbbc2-48ce-48b1-9322-0e61c3d333f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:06.877075 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50bbbc2-48ce-48b1-9322-0e61c3d333f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:06.886628 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-9a22de24-2ac2-432c-9baa-e45a078a33af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:06.888291 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50bbbc2-48ce-48b1-9322-0e61c3d333f0 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:06.904577 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 799/1598] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:06.908040 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd7082-f8db-443a-9e11-6b95caa71b79 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:06.908040 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd7082-f8db-443a-9e11-6b95caa71b79 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:06.908040 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd7082-f8db-443a-9e11-6b95caa71b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:06.941436 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-28dd7082-f8db-443a-9e11-6b95caa71b79 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:06.942931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-28dd7082-f8db-443a-9e11-6b95caa71b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:06.954675 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:06.968761 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 800/1599] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:06.968761 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd7082-f8db-443a-9e11-6b95caa71b79 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:06.970867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-28dd7082-f8db-443a-9e11-6b95caa71b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:06.994825 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd7082-f8db-443a-9e11-6b95caa71b79 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:07.004762 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c60c10-3823-46d2-b1b3-4897e40fcbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:07.005512 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c60c10-3823-46d2-b1b3-4897e40fcbf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:07.005869 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c60c10-3823-46d2-b1b3-4897e40fcbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:07.006250 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c60c10-3823-46d2-b1b3-4897e40fcbf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:07.007117 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c60c10-3823-46d2-b1b3-4897e40fcbf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:07.008905 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c60c10-3823-46d2-b1b3-4897e40fcbf0 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:07.023751 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 800/1600] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:07.025340 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61271e-8e56-4695-9df7-f94a9a57a874 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:07.025644 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61271e-8e56-4695-9df7-f94a9a57a874 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:07.039987 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 801/1601] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:07.040414 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61271e-8e56-4695-9df7-f94a9a57a874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:07.042040 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c60c10-3823-46d2-b1b3-4897e40fcbf0 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:07.045097 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-01c60c10-3823-46d2-b1b3-4897e40fcbf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:07.060478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c60c10-3823-46d2-b1b3-4897e40fcbf0 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:07.067811 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f579d-11cd-4ade-9eb5-b510d7cb682f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:07.067811 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f579d-11cd-4ade-9eb5-b510d7cb682f admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:07.068758 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f579d-11cd-4ade-9eb5-b510d7cb682f admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:07.068758 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f579d-11cd-4ade-9eb5-b510d7cb682f admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:07.069299 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f579d-11cd-4ade-9eb5-b510d7cb682f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:07.071832 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f579d-11cd-4ade-9eb5-b510d7cb682f admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:07.105436 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 802/1602] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:31:07 2022] POST /identity/v3/projects => generated 367 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:07.106741 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f579d-11cd-4ade-9eb5-b510d7cb682f admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:07.109768 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-ac61271e-8e56-4695-9df7-f94a9a57a874 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:07.114865 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-ac61271e-8e56-4695-9df7-f94a9a57a874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:07.230952 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f579d-11cd-4ade-9eb5-b510d7cb682f admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:07.237030 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e7cde-3931-40a4-a888-ef0febc2cca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:07.237741 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e7cde-3931-40a4-a888-ef0febc2cca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:07.238023 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e7cde-3931-40a4-a888-ef0febc2cca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:07.238301 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e7cde-3931-40a4-a888-ef0febc2cca6 admin admin] PATH_INFO: `/v3/projects/24c5301c5fd5490aabb5a3f9fba0d7d8/users/669288c421cd46a59fe76b7184d7d53e/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:07.242003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:07.260452 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 801/1603] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:07.260452 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61271e-8e56-4695-9df7-f94a9a57a874 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:07.270036 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e7cde-3931-40a4-a888-ef0febc2cca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24c5301c5fd5490aabb5a3f9fba0d7d8, user_id=669288c421cd46a59fe76b7184d7d53e, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:07.274196 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e7cde-3931-40a4-a888-ef0febc2cca6 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:07.294627 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 803/1604] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:31:07 2022] PUT /identity/v3/projects/24c5301c5fd5490aabb5a3f9fba0d7d8/users/669288c421cd46a59fe76b7184d7d53e/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:07.295641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e7cde-3931-40a4-a888-ef0febc2cca6 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:07.306927 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61271e-8e56-4695-9df7-f94a9a57a874 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:07.430660 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e2d0f-52d3-42c4-b0ae-0111d9cdc87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:07.431647 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e2d0f-52d3-42c4-b0ae-0111d9cdc87e admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:07.433491 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e2d0f-52d3-42c4-b0ae-0111d9cdc87e admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:07.434027 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e2d0f-52d3-42c4-b0ae-0111d9cdc87e admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:07.437516 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e2d0f-52d3-42c4-b0ae-0111d9cdc87e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:07.440355 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e2d0f-52d3-42c4-b0ae-0111d9cdc87e admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:07.442775 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e7cde-3931-40a4-a888-ef0febc2cca6 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:07.449762 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb0f85-e9ff-4069-a472-a67694231c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:07.450385 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb0f85-e9ff-4069-a472-a67694231c12 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:07.450671 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb0f85-e9ff-4069-a472-a67694231c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:07.451431 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb0f85-e9ff-4069-a472-a67694231c12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:07.451594 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb0f85-e9ff-4069-a472-a67694231c12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:31:07.451904 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb0f85-e9ff-4069-a472-a67694231c12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:07.462484 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb0f85-e9ff-4069-a472-a67694231c12 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:07.477040 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 802/1605] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:31:07 2022] POST /identity/v3/users => generated 290 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:07.479954 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c12d5-1848-4cad-97d9-4533e1c15dae None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:07.479954 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c12d5-1848-4cad-97d9-4533e1c15dae None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:07.480220 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c12d5-1848-4cad-97d9-4533e1c15dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:07.503593 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 804/1606] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:31:07.503593 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb0f85-e9ff-4069-a472-a67694231c12 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:07.519060 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-069c12d5-1848-4cad-97d9-4533e1c15dae None None] MFA Rules not processed for user `669288c421cd46a59fe76b7184d7d53e`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:07.519561 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb0f85-e9ff-4069-a472-a67694231c12 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:07.520661 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-069c12d5-1848-4cad-97d9-4533e1c15dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:07.534656 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c713f54-b323-4e3e-9ae9-2f25b665839e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:07.535287 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c713f54-b323-4e3e-9ae9-2f25b665839e admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:07.535570 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c713f54-b323-4e3e-9ae9-2f25b665839e admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:07.535843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c713f54-b323-4e3e-9ae9-2f25b665839e admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:07.536491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c713f54-b323-4e3e-9ae9-2f25b665839e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:07.538726 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c713f54-b323-4e3e-9ae9-2f25b665839e admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:07.553646 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 805/1607] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:07.554580 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c713f54-b323-4e3e-9ae9-2f25b665839e admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:07.566945 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c713f54-b323-4e3e-9ae9-2f25b665839e admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:07.574611 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c169403-682a-4e64-84e8-f0567dee0796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:07.575346 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c169403-682a-4e64-84e8-f0567dee0796 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:07.575692 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c169403-682a-4e64-84e8-f0567dee0796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:07.576035 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c169403-682a-4e64-84e8-f0567dee0796 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:07.576792 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c169403-682a-4e64-84e8-f0567dee0796 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:07.579229 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c169403-682a-4e64-84e8-f0567dee0796 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:07.602570 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:07.639368 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 806/1608] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:31:07 2022] POST /identity/v3/projects => generated 393 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:07.639368 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc5418-8672-4cae-a6ec-543551c3a2c7 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:07.639368 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc5418-8672-4cae-a6ec-543551c3a2c7 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:07.639368 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc5418-8672-4cae-a6ec-543551c3a2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:07.640007 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 803/1609] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:07.640748 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c12d5-1848-4cad-97d9-4533e1c15dae None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:07.652310 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c12d5-1848-4cad-97d9-4533e1c15dae None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:07.679052 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-82bc5418-8672-4cae-a6ec-543551c3a2c7 None None] MFA Rules not processed for user `2aa96af0e5cd47248b91910171bb66b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:07.686204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-82bc5418-8672-4cae-a6ec-543551c3a2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:07.753298 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c224741-db3c-4d94-9bf4-1156596297e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:07.753974 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c224741-db3c-4d94-9bf4-1156596297e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:07.754255 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c224741-db3c-4d94-9bf4-1156596297e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:07.754538 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c224741-db3c-4d94-9bf4-1156596297e6 admin admin] PATH_INFO: `/v3/projects/58c1154d6fba42168458977350f39e27/users/ab7ffd656edc423690127f909a47ba64/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:07.773040 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c224741-db3c-4d94-9bf4-1156596297e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c1154d6fba42168458977350f39e27, user_id=ab7ffd656edc423690127f909a47ba64, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:07.775641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c224741-db3c-4d94-9bf4-1156596297e6 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:07.780996 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 807/1610] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:07.782135 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc5418-8672-4cae-a6ec-543551c3a2c7 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:07.791275 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 804/1611] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:31:07 2022] PUT /identity/v3/projects/58c1154d6fba42168458977350f39e27/users/ab7ffd656edc423690127f909a47ba64/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:07.792288 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c224741-db3c-4d94-9bf4-1156596297e6 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:07.797996 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc5418-8672-4cae-a6ec-543551c3a2c7 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:07.880439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:07.914283 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c224741-db3c-4d94-9bf4-1156596297e6 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:07.923561 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479faf44-a4ff-46dd-bb15-416006ddc468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:07.925095 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479faf44-a4ff-46dd-bb15-416006ddc468 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:07.925386 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479faf44-a4ff-46dd-bb15-416006ddc468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:07.925666 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479faf44-a4ff-46dd-bb15-416006ddc468 admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:07.926889 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479faf44-a4ff-46dd-bb15-416006ddc468 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:07.929080 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479faf44-a4ff-46dd-bb15-416006ddc468 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:07.947600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d588d96-2cbc-4e59-88ba-a2234fad507b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:07.949292 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d588d96-2cbc-4e59-88ba-a2234fad507b admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:07.949634 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d588d96-2cbc-4e59-88ba-a2234fad507b admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:07.949921 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d588d96-2cbc-4e59-88ba-a2234fad507b admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:07.950713 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d588d96-2cbc-4e59-88ba-a2234fad507b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:07.953003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d588d96-2cbc-4e59-88ba-a2234fad507b admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:07.966902 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 805/1612] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:31:07 2022] POST /identity/v3/projects => generated 381 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:07.972458 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479faf44-a4ff-46dd-bb15-416006ddc468 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:07.975965 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-479faf44-a4ff-46dd-bb15-416006ddc468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:07.983076 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 808/1613] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:31:07 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:07.984324 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d588d96-2cbc-4e59-88ba-a2234fad507b admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:07.997107 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d588d96-2cbc-4e59-88ba-a2234fad507b admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:08.064407 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:08.069877 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479faf44-a4ff-46dd-bb15-416006ddc468 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:08.075751 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3cf59-a74e-435a-a871-b97e6029eb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:08.076451 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3cf59-a74e-435a-a871-b97e6029eb1b admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:08.077088 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3cf59-a74e-435a-a871-b97e6029eb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:08.077436 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3cf59-a74e-435a-a871-b97e6029eb1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:08.078478 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ae2d7-9bc8-4ff0-b582-8f5b3a11fdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:08.079633 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3cf59-a74e-435a-a871-b97e6029eb1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:08.079750 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ae2d7-9bc8-4ff0-b582-8f5b3a11fdbf admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:08.080119 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ae2d7-9bc8-4ff0-b582-8f5b3a11fdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:08.080520 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ae2d7-9bc8-4ff0-b582-8f5b3a11fdbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:08.081256 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ae2d7-9bc8-4ff0-b582-8f5b3a11fdbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:08.081997 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3cf59-a74e-435a-a871-b97e6029eb1b admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:08.084846 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ae2d7-9bc8-4ff0-b582-8f5b3a11fdbf admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:08.094293 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 809/1614] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:08.095440 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3cf59-a74e-435a-a871-b97e6029eb1b admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:08.106181 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3cf59-a74e-435a-a871-b97e6029eb1b admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:08.113644 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561172a1-f05b-40e5-8c93-f5fa03967339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:08.114522 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561172a1-f05b-40e5-8c93-f5fa03967339 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:08.114978 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561172a1-f05b-40e5-8c93-f5fa03967339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:08.115441 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561172a1-f05b-40e5-8c93-f5fa03967339 admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:08.116259 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561172a1-f05b-40e5-8c93-f5fa03967339 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:08.118416 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561172a1-f05b-40e5-8c93-f5fa03967339 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:08.124755 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 806/1615] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:31:07 2022] POST /identity/v3/projects => generated 371 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:08.126529 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ae2d7-9bc8-4ff0-b582-8f5b3a11fdbf admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:08.145671 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 810/1616] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:31:08 2022] POST /identity/v3/users => generated 297 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:08.146837 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561172a1-f05b-40e5-8c93-f5fa03967339 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:08.158462 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561172a1-f05b-40e5-8c93-f5fa03967339 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:08.222118 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ae2d7-9bc8-4ff0-b582-8f5b3a11fdbf admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:08.225668 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596f462-f5b0-491d-95c3-102490231503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:08.226496 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596f462-f5b0-491d-95c3-102490231503 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:08.226861 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596f462-f5b0-491d-95c3-102490231503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:08.227508 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5c75f-9a32-41ff-a82a-1bb66722eb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:08.228127 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5c75f-9a32-41ff-a82a-1bb66722eb95 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:08.228416 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5c75f-9a32-41ff-a82a-1bb66722eb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:08.228728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5c75f-9a32-41ff-a82a-1bb66722eb95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:08.229398 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5c75f-9a32-41ff-a82a-1bb66722eb95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:08.230995 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5c75f-9a32-41ff-a82a-1bb66722eb95 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:08.235843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596f462-f5b0-491d-95c3-102490231503 admin admin] PATH_INFO: `/v3/projects/58c1154d6fba42168458977350f39e27/users/ab7ffd656edc423690127f909a47ba64/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:08.242551 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 807/1617] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:08.243361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5c75f-9a32-41ff-a82a-1bb66722eb95 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:08.246408 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e596f462-f5b0-491d-95c3-102490231503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c1154d6fba42168458977350f39e27, user_id=ab7ffd656edc423690127f909a47ba64, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:08.249146 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e596f462-f5b0-491d-95c3-102490231503 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:08.253650 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5c75f-9a32-41ff-a82a-1bb66722eb95 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:08.258689 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a1efe-883d-423c-900c-75b5aaf16f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:08.259376 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a1efe-883d-423c-900c-75b5aaf16f20 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:08.260009 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a1efe-883d-423c-900c-75b5aaf16f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:08.260364 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a1efe-883d-423c-900c-75b5aaf16f20 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:08.261115 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a1efe-883d-423c-900c-75b5aaf16f20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:08.263256 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a1efe-883d-423c-900c-75b5aaf16f20 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:08.285215 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 811/1618] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:31:08 2022] PUT /identity/v3/projects/58c1154d6fba42168458977350f39e27/users/ab7ffd656edc423690127f909a47ba64/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:08.286008 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596f462-f5b0-491d-95c3-102490231503 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:08.310966 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 808/1619] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:31:08 2022] POST /identity/v3/users => generated 292 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:08.311876 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a1efe-883d-423c-900c-75b5aaf16f20 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:08.342833 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a1efe-883d-423c-900c-75b5aaf16f20 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:08.360989 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:08.385157 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596f462-f5b0-491d-95c3-102490231503 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:08.390310 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4278924-1108-4b20-be5b-526665ff5874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:08.391226 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4278924-1108-4b20-be5b-526665ff5874 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:08.391677 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4278924-1108-4b20-be5b-526665ff5874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:08.391979 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4278924-1108-4b20-be5b-526665ff5874 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:08.393380 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4278924-1108-4b20-be5b-526665ff5874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:08.395361 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4278924-1108-4b20-be5b-526665ff5874 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:08.408082 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 812/1620] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:08.409745 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f42ac3-607d-46e3-97b1-4842d4329299 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:08.410086 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f42ac3-607d-46e3-97b1-4842d4329299 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:08.410367 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f42ac3-607d-46e3-97b1-4842d4329299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:08.444766 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-d1f42ac3-607d-46e3-97b1-4842d4329299 None None] MFA Rules not processed for user `ab7ffd656edc423690127f909a47ba64`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:08.446095 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-d1f42ac3-607d-46e3-97b1-4842d4329299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:08.448906 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c739a39-d1e8-4526-a7f7-30e49ea18a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:08.449543 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c739a39-d1e8-4526-a7f7-30e49ea18a38 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:08.449827 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c739a39-d1e8-4526-a7f7-30e49ea18a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:08.450109 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c739a39-d1e8-4526-a7f7-30e49ea18a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:08.450771 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c739a39-d1e8-4526-a7f7-30e49ea18a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:08.452393 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c739a39-d1e8-4526-a7f7-30e49ea18a38 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:08.465107 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 809/1621] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:08.466032 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c739a39-d1e8-4526-a7f7-30e49ea18a38 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:08.479932 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c739a39-d1e8-4526-a7f7-30e49ea18a38 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:08.484763 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4efe1-390b-4ea7-96a6-403e0c7a4d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:08.486009 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4efe1-390b-4ea7-96a6-403e0c7a4d31 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:08.486293 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4efe1-390b-4ea7-96a6-403e0c7a4d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:08.486565 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4efe1-390b-4ea7-96a6-403e0c7a4d31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:08.487210 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4efe1-390b-4ea7-96a6-403e0c7a4d31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:08.488853 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4efe1-390b-4ea7-96a6-403e0c7a4d31 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:08.499513 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 810/1622] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:08.500295 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4efe1-390b-4ea7-96a6-403e0c7a4d31 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:08.510686 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4efe1-390b-4ea7-96a6-403e0c7a4d31 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:08.515549 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044cf224-d704-4575-a1c7-c9447a2c9efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:08.516383 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cf224-d704-4575-a1c7-c9447a2c9efb admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:08.516840 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cf224-d704-4575-a1c7-c9447a2c9efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:08.517117 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cf224-d704-4575-a1c7-c9447a2c9efb admin admin] PATH_INFO: `/v3/projects/a754b7b9207445a7b291ba58e65f62ef/users/ece5740a6fca45c188e49f37f26dffa2/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:08.534853 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044cf224-d704-4575-a1c7-c9447a2c9efb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a754b7b9207445a7b291ba58e65f62ef, user_id=ece5740a6fca45c188e49f37f26dffa2, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:08.535512 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 813/1623] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:08.539844 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f42ac3-607d-46e3-97b1-4842d4329299 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:08.539957 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044cf224-d704-4575-a1c7-c9447a2c9efb admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:08.547827 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f42ac3-607d-46e3-97b1-4842d4329299 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:08.553315 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 811/1624] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:31:08 2022] PUT /identity/v3/projects/a754b7b9207445a7b291ba58e65f62ef/users/ece5740a6fca45c188e49f37f26dffa2/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:08.553989 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044cf224-d704-4575-a1c7-c9447a2c9efb admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:08.580512 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:08.608625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d82b05-585a-4902-a85e-f224c040b10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:08.609352 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d82b05-585a-4902-a85e-f224c040b10b admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:08.609637 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d82b05-585a-4902-a85e-f224c040b10b admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:08.610440 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d82b05-585a-4902-a85e-f224c040b10b admin admin] PATH_INFO: `/v3/projects/b0caf64c53b848109c66b21df9d2d305/users/b159606b2f8646b18ce8aed30c2ff71e/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:08.623669 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044cf224-d704-4575-a1c7-c9447a2c9efb admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:08.626770 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d82b05-585a-4902-a85e-f224c040b10b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0caf64c53b848109c66b21df9d2d305, user_id=b159606b2f8646b18ce8aed30c2ff71e, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:08.629145 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02268085-9bdf-4679-ba65-4d96668fbde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:08.629838 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02268085-9bdf-4679-ba65-4d96668fbde3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:08.630124 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02268085-9bdf-4679-ba65-4d96668fbde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:08.630398 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02268085-9bdf-4679-ba65-4d96668fbde3 admin admin] PATH_INFO: `/v3/projects/9c38219a711348d291c745b61712b00f/users/42faf3691c8745fa89eb7f49aec3a8ca/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:08.630538 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d82b05-585a-4902-a85e-f224c040b10b admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:08.645738 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 814/1625] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:31:08 2022] PUT /identity/v3/projects/b0caf64c53b848109c66b21df9d2d305/users/b159606b2f8646b18ce8aed30c2ff71e/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:08.646204 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02268085-9bdf-4679-ba65-4d96668fbde3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c38219a711348d291c745b61712b00f, user_id=42faf3691c8745fa89eb7f49aec3a8ca, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:08.646676 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d82b05-585a-4902-a85e-f224c040b10b admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:08.648215 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-68d82b05-585a-4902-a85e-f224c040b10b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:08.649020 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02268085-9bdf-4679-ba65-4d96668fbde3 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:08.662615 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 812/1626] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:31:08 2022] PUT /identity/v3/projects/9c38219a711348d291c745b61712b00f/users/42faf3691c8745fa89eb7f49aec3a8ca/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:08.663434 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02268085-9bdf-4679-ba65-4d96668fbde3 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:08.709324 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:08.723401 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d82b05-585a-4902-a85e-f224c040b10b admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:08.737592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02268085-9bdf-4679-ba65-4d96668fbde3 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:08.742426 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea6399-6186-4f2e-83b2-bd6b99fc6de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:08.743111 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea6399-6186-4f2e-83b2-bd6b99fc6de2 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:08.743462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea6399-6186-4f2e-83b2-bd6b99fc6de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:08.743814 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea6399-6186-4f2e-83b2-bd6b99fc6de2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:08.744529 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea6399-6186-4f2e-83b2-bd6b99fc6de2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:08.746358 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea6399-6186-4f2e-83b2-bd6b99fc6de2 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:08.760971 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 813/1627] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:08.760971 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7773c-75f7-4bc0-84a9-7c4ecc259db0 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:08.760971 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7773c-75f7-4bc0-84a9-7c4ecc259db0 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:08.760971 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7773c-75f7-4bc0-84a9-7c4ecc259db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:08.783537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40d40a-57da-44e6-b3f4-9f6c14c9e729 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:08.784508 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40d40a-57da-44e6-b3f4-9f6c14c9e729 service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:08.784930 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40d40a-57da-44e6-b3f4-9f6c14c9e729 service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:08.785281 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40d40a-57da-44e6-b3f4-9f6c14c9e729 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:08.789098 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-67c7773c-75f7-4bc0-84a9-7c4ecc259db0 None None] MFA Rules not processed for user `b159606b2f8646b18ce8aed30c2ff71e`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:08.790305 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-67c7773c-75f7-4bc0-84a9-7c4ecc259db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:08.855460 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40d40a-57da-44e6-b3f4-9f6c14c9e729 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:08.856967 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40d40a-57da-44e6-b3f4-9f6c14c9e729 service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:08.873943 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 814/1628] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:08.874263 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 815/1629] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:08.875031 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7773c-75f7-4bc0-84a9-7c4ecc259db0 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:08.875169 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40d40a-57da-44e6-b3f4-9f6c14c9e729 service cinder] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:08.888497 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7773c-75f7-4bc0-84a9-7c4ecc259db0 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:08.888687 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40d40a-57da-44e6-b3f4-9f6c14c9e729 service cinder] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:08.893482 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09b6fc-b05c-43ea-9deb-57697a8c1c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:08.893610 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f44774-9dba-4bd1-84d0-519e709079d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:08.894387 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09b6fc-b05c-43ea-9deb-57697a8c1c95 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:08.894512 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f44774-9dba-4bd1-84d0-519e709079d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:08.894512 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f44774-9dba-4bd1-84d0-519e709079d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:08.894646 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09b6fc-b05c-43ea-9deb-57697a8c1c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:08.894797 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f44774-9dba-4bd1-84d0-519e709079d2 admin admin] PATH_INFO: `/v3/projects/a754b7b9207445a7b291ba58e65f62ef/users/ece5740a6fca45c188e49f37f26dffa2/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:08.894891 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09b6fc-b05c-43ea-9deb-57697a8c1c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:08.895486 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09b6fc-b05c-43ea-9deb-57697a8c1c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:08.896716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f44774-9dba-4bd1-84d0-519e709079d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a754b7b9207445a7b291ba58e65f62ef, user_id=ece5740a6fca45c188e49f37f26dffa2, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:08.897145 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09b6fc-b05c-43ea-9deb-57697a8c1c95 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:08.899554 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f44774-9dba-4bd1-84d0-519e709079d2 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:08.909296 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 815/1630] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:08.910329 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09b6fc-b05c-43ea-9deb-57697a8c1c95 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:08.912225 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 816/1631] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:31:08 2022] PUT /identity/v3/projects/a754b7b9207445a7b291ba58e65f62ef/users/ece5740a6fca45c188e49f37f26dffa2/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:08.921524 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f44774-9dba-4bd1-84d0-519e709079d2 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:08.921995 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09b6fc-b05c-43ea-9deb-57697a8c1c95 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:08.940856 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:08.991184 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961cc24-d492-474e-b852-784be88169de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:08.991797 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961cc24-d492-474e-b852-784be88169de admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:08.992070 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961cc24-d492-474e-b852-784be88169de admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:08.992349 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961cc24-d492-474e-b852-784be88169de admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:08.993019 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961cc24-d492-474e-b852-784be88169de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:08.994915 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961cc24-d492-474e-b852-784be88169de admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:08.995940 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f44774-9dba-4bd1-84d0-519e709079d2 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:09.000679 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2da8f-d7c8-4ae9-91dc-1e24cca1ae2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:09.001338 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2da8f-d7c8-4ae9-91dc-1e24cca1ae2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:09.001621 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2da8f-d7c8-4ae9-91dc-1e24cca1ae2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:09.001898 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2da8f-d7c8-4ae9-91dc-1e24cca1ae2d admin admin] PATH_INFO: `/v3/projects/9c38219a711348d291c745b61712b00f/users/42faf3691c8745fa89eb7f49aec3a8ca/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:09.003839 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2da8f-d7c8-4ae9-91dc-1e24cca1ae2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c38219a711348d291c745b61712b00f, user_id=42faf3691c8745fa89eb7f49aec3a8ca, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:09.006542 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2da8f-d7c8-4ae9-91dc-1e24cca1ae2d admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:09.017963 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 817/1632] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:31:08 2022] PUT /identity/v3/projects/9c38219a711348d291c745b61712b00f/users/42faf3691c8745fa89eb7f49aec3a8ca/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:09.019175 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbbb2f-28db-43a1-8221-49f47bd5e6a7 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:09.019467 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbbb2f-28db-43a1-8221-49f47bd5e6a7 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:09.019756 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbbb2f-28db-43a1-8221-49f47bd5e6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:09.025973 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 816/1633] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:31:08 2022] POST /identity/v3/projects => generated 391 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:09.027277 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961cc24-d492-474e-b852-784be88169de admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:09.050812 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-6acbbb2f-28db-43a1-8221-49f47bd5e6a7 None None] MFA Rules not processed for user `ece5740a6fca45c188e49f37f26dffa2`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:09.052266 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-6acbbb2f-28db-43a1-8221-49f47bd5e6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:09.072423 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:09.099623 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961cc24-d492-474e-b852-784be88169de admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:09.105494 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b98404-12b6-479b-acd2-f5fecf18ff81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:09.106829 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b98404-12b6-479b-acd2-f5fecf18ff81 service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:09.107173 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b98404-12b6-479b-acd2-f5fecf18ff81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:09.107455 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b98404-12b6-479b-acd2-f5fecf18ff81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:09.145508 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 818/1634] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:09 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:09.147162 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acbbb2f-28db-43a1-8221-49f47bd5e6a7 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:09.181112 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b98404-12b6-479b-acd2-f5fecf18ff81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:09.182894 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b98404-12b6-479b-acd2-f5fecf18ff81 service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:09.199078 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 817/1635] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:09.212802 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b98404-12b6-479b-acd2-f5fecf18ff81 service cinder] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:09.215530 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-94b98404-12b6-479b-acd2-f5fecf18ff81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:09.222585 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acbbb2f-28db-43a1-8221-49f47bd5e6a7 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:09.233376 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e35c2-e756-4578-a141-21242c3fb00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:09.234024 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e35c2-e756-4578-a141-21242c3fb00e admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:09.234312 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e35c2-e756-4578-a141-21242c3fb00e admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:09.234592 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e35c2-e756-4578-a141-21242c3fb00e admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:09.235939 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e35c2-e756-4578-a141-21242c3fb00e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:09.238480 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e35c2-e756-4578-a141-21242c3fb00e admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:09.240070 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b98404-12b6-479b-acd2-f5fecf18ff81 service cinder] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:09.252038 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6771b1-fe0a-414d-a577-135b082b8768 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:09.252917 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6771b1-fe0a-414d-a577-135b082b8768 service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:09.253363 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6771b1-fe0a-414d-a577-135b082b8768 service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:09.253780 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6771b1-fe0a-414d-a577-135b082b8768 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:09.267981 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6771b1-fe0a-414d-a577-135b082b8768 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:09.271011 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6771b1-fe0a-414d-a577-135b082b8768 service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:09.277106 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 819/1636] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:31:09 2022] POST /identity/v3/users => generated 302 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:09.280350 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e35c2-e756-4578-a141-21242c3fb00e admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:09.296469 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 818/1637] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:09.300652 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e35c2-e756-4578-a141-21242c3fb00e admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:09.315532 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ac2ff-11c9-4eb9-bb12-db0e23302911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:09.316162 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ac2ff-11c9-4eb9-bb12-db0e23302911 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:09.317613 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ac2ff-11c9-4eb9-bb12-db0e23302911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:09.317973 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ac2ff-11c9-4eb9-bb12-db0e23302911 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:09.319307 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ac2ff-11c9-4eb9-bb12-db0e23302911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:09.321271 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ac2ff-11c9-4eb9-bb12-db0e23302911 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:09.347148 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 820/1638] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:09.352014 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6771b1-fe0a-414d-a577-135b082b8768 service cinder] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:09.377041 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6771b1-fe0a-414d-a577-135b082b8768 service cinder] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:09.384316 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ade546-7baa-4b35-a119-9b29c9c9d53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:09.385178 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ade546-7baa-4b35-a119-9b29c9c9d53a admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:09.385461 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ade546-7baa-4b35-a119-9b29c9c9d53a admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:09.385720 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ade546-7baa-4b35-a119-9b29c9c9d53a admin admin] PATH_INFO: `/v3/projects/61e8e537d42f47c3aee37114883fbba7/users/db7f1bd60f654818a13784e4cded9400/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:09.417336 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ade546-7baa-4b35-a119-9b29c9c9d53a admin admin] RBAC: Authorizing `identity:create_grant(project_id=61e8e537d42f47c3aee37114883fbba7, user_id=db7f1bd60f654818a13784e4cded9400, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:09.420642 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ade546-7baa-4b35-a119-9b29c9c9d53a admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:09.466120 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ac2ff-11c9-4eb9-bb12-db0e23302911 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:09.466554 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 819/1639] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:31:09 2022] PUT /identity/v3/projects/61e8e537d42f47c3aee37114883fbba7/users/db7f1bd60f654818a13784e4cded9400/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:09.502936 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ac2ff-11c9-4eb9-bb12-db0e23302911 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:09.512217 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ade546-7baa-4b35-a119-9b29c9c9d53a admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:09.584199 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:09.668967 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ade546-7baa-4b35-a119-9b29c9c9d53a admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:09.674370 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84039b-5c80-4e16-b691-dcc93e0cc426 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:09.675003 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84039b-5c80-4e16-b691-dcc93e0cc426 service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:09.675477 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84039b-5c80-4e16-b691-dcc93e0cc426 service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:09.675763 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84039b-5c80-4e16-b691-dcc93e0cc426 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:09.683671 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb6d0e-256c-4983-9797-8aab3574ed6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:09.684820 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb6d0e-256c-4983-9797-8aab3574ed6f admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:09.699229 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb6d0e-256c-4983-9797-8aab3574ed6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:09.700164 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb6d0e-256c-4983-9797-8aab3574ed6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:09.709155 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb6d0e-256c-4983-9797-8aab3574ed6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:09.713596 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb6d0e-256c-4983-9797-8aab3574ed6f admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:09.740422 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 821/1640] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:09.751828 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb6d0e-256c-4983-9797-8aab3574ed6f admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:09.775997 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84039b-5c80-4e16-b691-dcc93e0cc426 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:09.777935 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84039b-5c80-4e16-b691-dcc93e0cc426 service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:09.788749 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb6d0e-256c-4983-9797-8aab3574ed6f admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:09.805693 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 820/1641] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 20:31:09.809639 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2101572-f035-4e7b-a2eb-1495908e3862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:09.810774 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2101572-f035-4e7b-a2eb-1495908e3862 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:09.810946 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2101572-f035-4e7b-a2eb-1495908e3862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:09.811225 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2101572-f035-4e7b-a2eb-1495908e3862 admin admin] PATH_INFO: `/v3/projects/61e8e537d42f47c3aee37114883fbba7/users/db7f1bd60f654818a13784e4cded9400/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:09.816583 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2101572-f035-4e7b-a2eb-1495908e3862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61e8e537d42f47c3aee37114883fbba7, user_id=db7f1bd60f654818a13784e4cded9400, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:09.819094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2101572-f035-4e7b-a2eb-1495908e3862 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:09.848576 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 822/1642] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:31:09 2022] PUT /identity/v3/projects/61e8e537d42f47c3aee37114883fbba7/users/db7f1bd60f654818a13784e4cded9400/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:09.859940 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0372e96-cb3f-425e-bfa5-ca06a106172f None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:09.860225 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0372e96-cb3f-425e-bfa5-ca06a106172f None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:09.860502 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0372e96-cb3f-425e-bfa5-ca06a106172f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:09.930808 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-f0372e96-cb3f-425e-bfa5-ca06a106172f None None] MFA Rules not processed for user `db7f1bd60f654818a13784e4cded9400`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:09.932312 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-f0372e96-cb3f-425e-bfa5-ca06a106172f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:10.023506 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 821/1643] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:09 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:10.038506 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2101572-f035-4e7b-a2eb-1495908e3862 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:10.087086 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:10.162945 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2101572-f035-4e7b-a2eb-1495908e3862 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:10.169614 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0f5c4-1582-4d35-9f02-ce1db8f7b01c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:10.169906 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0f5c4-1582-4d35-9f02-ce1db8f7b01c service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:10.170904 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0f5c4-1582-4d35-9f02-ce1db8f7b01c service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:10.171501 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0f5c4-1582-4d35-9f02-ce1db8f7b01c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:10.177662 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0372e96-cb3f-425e-bfa5-ca06a106172f None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:10.181744 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0f5c4-1582-4d35-9f02-ce1db8f7b01c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:10.183264 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0f5c4-1582-4d35-9f02-ce1db8f7b01c service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:10.198033 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 823/1644] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:10 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 20:31:10.254826 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0372e96-cb3f-425e-bfa5-ca06a106172f None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:10.255340 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c735d39-11b1-4e5a-a57a-23c37b0ed74f None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:10.255868 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c735d39-11b1-4e5a-a57a-23c37b0ed74f None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:10.256215 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c735d39-11b1-4e5a-a57a-23c37b0ed74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:10.259645 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93811bdc-b1e2-442a-9735-cce0e0f38521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:10.260297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93811bdc-b1e2-442a-9735-cce0e0f38521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:10.260610 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93811bdc-b1e2-442a-9735-cce0e0f38521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:10.261063 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93811bdc-b1e2-442a-9735-cce0e0f38521 admin admin] PATH_INFO: `/v3/users/669288c421cd46a59fe76b7184d7d53e` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:10.262031 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93811bdc-b1e2-442a-9735-cce0e0f38521 admin admin] RBAC: Authorizing `identity:delete_user(user_id=669288c421cd46a59fe76b7184d7d53e)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:10.263971 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93811bdc-b1e2-442a-9735-cce0e0f38521 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:10.267687 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:10.300301 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-3c735d39-11b1-4e5a-a57a-23c37b0ed74f None None] MFA Rules not processed for user `42faf3691c8745fa89eb7f49aec3a8ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:10.301802 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-3c735d39-11b1-4e5a-a57a-23c37b0ed74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:10.323173 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-93811bdc-b1e2-442a-9735-cce0e0f38521 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '669288c421cd46a59fe76b7184d7d53e'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:10.324108 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-93811bdc-b1e2-442a-9735-cce0e0f38521 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '669288c421cd46a59fe76b7184d7d53e'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:10.338164 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-93811bdc-b1e2-442a-9735-cce0e0f38521 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '669288c421cd46a59fe76b7184d7d53e'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:10.338895 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-93811bdc-b1e2-442a-9735-cce0e0f38521 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '669288c421cd46a59fe76b7184d7d53e'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:10.347388 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-93811bdc-b1e2-442a-9735-cce0e0f38521 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '669288c421cd46a59fe76b7184d7d53e'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:10.364249 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 822/1645] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:31:10 2022] DELETE /identity/v3/users/669288c421cd46a59fe76b7184d7d53e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:10.367957 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93811bdc-b1e2-442a-9735-cce0e0f38521 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:10.369415 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-93811bdc-b1e2-442a-9735-cce0e0f38521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:10.381908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 824/1646] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:10 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:10.383289 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9c1ab-ec59-491c-b703-de3f82f87581 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:10.383644 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9c1ab-ec59-491c-b703-de3f82f87581 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:10.383990 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9c1ab-ec59-491c-b703-de3f82f87581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:10.408329 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-e5d9c1ab-ec59-491c-b703-de3f82f87581 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:10.409678 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-e5d9c1ab-ec59-491c-b703-de3f82f87581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:10.436488 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93811bdc-b1e2-442a-9735-cce0e0f38521 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:10.443075 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe65cd-5ecf-42a3-83f6-e9dbbc949ff8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:10.446903 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe65cd-5ecf-42a3-83f6-e9dbbc949ff8 service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:10.447337 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe65cd-5ecf-42a3-83f6-e9dbbc949ff8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:10.447691 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe65cd-5ecf-42a3-83f6-e9dbbc949ff8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:10.449827 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-e6fe65cd-5ecf-42a3-83f6-e9dbbc949ff8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:10.484835 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 825/1647] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:10.489572 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85917cbe-c9fd-47b9-95db-0c8abf71550b None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:10.489960 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85917cbe-c9fd-47b9-95db-0c8abf71550b None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:10.490339 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85917cbe-c9fd-47b9-95db-0c8abf71550b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:10.511386 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-85917cbe-c9fd-47b9-95db-0c8abf71550b None None] MFA Rules not processed for user `2aa96af0e5cd47248b91910171bb66b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:10.512729 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-85917cbe-c9fd-47b9-95db-0c8abf71550b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:10.538063 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe65cd-5ecf-42a3-83f6-e9dbbc949ff8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:10.540740 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe65cd-5ecf-42a3-83f6-e9dbbc949ff8 service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:10.555730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 823/1648] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:10 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:10.557019 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe65cd-5ecf-42a3-83f6-e9dbbc949ff8 service cinder] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:10.558613 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-e6fe65cd-5ecf-42a3-83f6-e9dbbc949ff8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:10.602844 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:10.625334 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:10.629578 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 826/1649] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:10.643062 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85917cbe-c9fd-47b9-95db-0c8abf71550b None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:10.644687 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-85917cbe-c9fd-47b9-95db-0c8abf71550b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:10.648012 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe65cd-5ecf-42a3-83f6-e9dbbc949ff8 service cinder] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:10.652761 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdc7f9-2598-4331-b754-3ad69ab64ae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:10.653373 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdc7f9-2598-4331-b754-3ad69ab64ae8 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:10.653654 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdc7f9-2598-4331-b754-3ad69ab64ae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:10.653927 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcdc7f9-2598-4331-b754-3ad69ab64ae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:10.663978 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcdc7f9-2598-4331-b754-3ad69ab64ae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:10.665450 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcdc7f9-2598-4331-b754-3ad69ab64ae8 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:10.675926 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 824/1650] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:10.737892 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85917cbe-c9fd-47b9-95db-0c8abf71550b None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:10.743625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ee0ec-6013-4559-aa18-5abca9c3d261 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:10.744339 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ee0ec-6013-4559-aa18-5abca9c3d261 service nova] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:10.745222 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ee0ec-6013-4559-aa18-5abca9c3d261 service nova] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:10.745222 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ee0ec-6013-4559-aa18-5abca9c3d261 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:10.746948 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-be0ee0ec-6013-4559-aa18-5abca9c3d261 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:10.758399 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ee0ec-6013-4559-aa18-5abca9c3d261 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:10.760138 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ee0ec-6013-4559-aa18-5abca9c3d261 service nova] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:10.770300 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 827/1651] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 20:31:11.324959 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdc7f9-2598-4331-b754-3ad69ab64ae8 service neutron] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:11.326407 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-5bcdc7f9-2598-4331-b754-3ad69ab64ae8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:11.340730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcdc7f9-2598-4331-b754-3ad69ab64ae8 service neutron] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:11.346722 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c777382-a81c-4c85-b34d-a8586d873e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:11.347715 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c777382-a81c-4c85-b34d-a8586d873e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:11.348027 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c777382-a81c-4c85-b34d-a8586d873e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:11.348304 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c777382-a81c-4c85-b34d-a8586d873e12 admin admin] PATH_INFO: `/v3/projects/24c5301c5fd5490aabb5a3f9fba0d7d8` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:11.349455 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c777382-a81c-4c85-b34d-a8586d873e12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24c5301c5fd5490aabb5a3f9fba0d7d8)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:11.351356 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c777382-a81c-4c85-b34d-a8586d873e12 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:11.405810 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4c777382-a81c-4c85-b34d-a8586d873e12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24c5301c5fd5490aabb5a3f9fba0d7d8', 'request_id': 'req-4c777382-a81c-4c85-b34d-a8586d873e12'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:11.412443 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4c777382-a81c-4c85-b34d-a8586d873e12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24c5301c5fd5490aabb5a3f9fba0d7d8', 'request_id': 'req-4c777382-a81c-4c85-b34d-a8586d873e12'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:11.419550 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4c777382-a81c-4c85-b34d-a8586d873e12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24c5301c5fd5490aabb5a3f9fba0d7d8', 'request_id': 'req-4c777382-a81c-4c85-b34d-a8586d873e12'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:11.432657 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4c777382-a81c-4c85-b34d-a8586d873e12 admin admin] The token cache is being invalidate because project 24c5301c5fd5490aabb5a3f9fba0d7d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:31:11.432950 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4c777382-a81c-4c85-b34d-a8586d873e12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:11.433578 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4c777382-a81c-4c85-b34d-a8586d873e12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:11.435094 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 825/1652] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:31:11 2022] DELETE /identity/v3/projects/24c5301c5fd5490aabb5a3f9fba0d7d8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:11.439616 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ee0ec-6013-4559-aa18-5abca9c3d261 service nova] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:11.450338 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ee0ec-6013-4559-aa18-5abca9c3d261 service nova] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:11.510557 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a4e60-1ca9-453e-b71c-67e265a8c157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:11.511189 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a4e60-1ca9-453e-b71c-67e265a8c157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:11.511476 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a4e60-1ca9-453e-b71c-67e265a8c157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:11.511755 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a4e60-1ca9-453e-b71c-67e265a8c157 admin admin] PATH_INFO: `/v3/users/ece5740a6fca45c188e49f37f26dffa2` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:11.513046 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a4e60-1ca9-453e-b71c-67e265a8c157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ece5740a6fca45c188e49f37f26dffa2)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:11.514799 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a4e60-1ca9-453e-b71c-67e265a8c157 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:11.573100 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-055a4e60-1ca9-453e-b71c-67e265a8c157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ece5740a6fca45c188e49f37f26dffa2'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:11.574149 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-055a4e60-1ca9-453e-b71c-67e265a8c157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ece5740a6fca45c188e49f37f26dffa2'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:11.583807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-055a4e60-1ca9-453e-b71c-67e265a8c157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ece5740a6fca45c188e49f37f26dffa2'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:11.584452 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-055a4e60-1ca9-453e-b71c-67e265a8c157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ece5740a6fca45c188e49f37f26dffa2'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:11.633574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-055a4e60-1ca9-453e-b71c-67e265a8c157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ece5740a6fca45c188e49f37f26dffa2'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:11.636696 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:11.651625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 828/1653] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:31:11 2022] DELETE /identity/v3/users/ece5740a6fca45c188e49f37f26dffa2 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:12.135653 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c777382-a81c-4c85-b34d-a8586d873e12 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:12.138166 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-4c777382-a81c-4c85-b34d-a8586d873e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:12.162549 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c777382-a81c-4c85-b34d-a8586d873e12 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:12.294716 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679f853-991c-425e-83a3-fdc4dac61889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:12.295380 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679f853-991c-425e-83a3-fdc4dac61889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:12.295667 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679f853-991c-425e-83a3-fdc4dac61889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:12.299980 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679f853-991c-425e-83a3-fdc4dac61889 admin admin] PATH_INFO: `/v3/projects/a754b7b9207445a7b291ba58e65f62ef` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:12.302191 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679f853-991c-425e-83a3-fdc4dac61889 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a754b7b9207445a7b291ba58e65f62ef)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:12.304269 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679f853-991c-425e-83a3-fdc4dac61889 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:12.405457 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-7679f853-991c-425e-83a3-fdc4dac61889 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a754b7b9207445a7b291ba58e65f62ef', 'request_id': 'req-7679f853-991c-425e-83a3-fdc4dac61889'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:12.426583 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-7679f853-991c-425e-83a3-fdc4dac61889 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a754b7b9207445a7b291ba58e65f62ef', 'request_id': 'req-7679f853-991c-425e-83a3-fdc4dac61889'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:12.442923 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-7679f853-991c-425e-83a3-fdc4dac61889 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a754b7b9207445a7b291ba58e65f62ef', 'request_id': 'req-7679f853-991c-425e-83a3-fdc4dac61889'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:12.446901 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:12.472211 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-7679f853-991c-425e-83a3-fdc4dac61889 admin admin] The token cache is being invalidate because project a754b7b9207445a7b291ba58e65f62ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:31:12.472752 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-7679f853-991c-425e-83a3-fdc4dac61889 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:12.475147 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-7679f853-991c-425e-83a3-fdc4dac61889 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:12.477258 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 826/1654] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:31:12 2022] DELETE /identity/v3/projects/a754b7b9207445a7b291ba58e65f62ef => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:12.482165 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b4a03-608c-496f-8186-324b16283f2c None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:12.482648 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b4a03-608c-496f-8186-324b16283f2c None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:12.482758 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b4a03-608c-496f-8186-324b16283f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:12.535693 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-b37b4a03-608c-496f-8186-324b16283f2c None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:12.542471 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-b37b4a03-608c-496f-8186-324b16283f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:12.684809 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 829/1655] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:12.694165 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121da70-e2a3-455b-bf36-425b00e17215 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:12.694915 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121da70-e2a3-455b-bf36-425b00e17215 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:12.695522 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121da70-e2a3-455b-bf36-425b00e17215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:12.740525 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-f121da70-e2a3-455b-bf36-425b00e17215 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:12.744508 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-f121da70-e2a3-455b-bf36-425b00e17215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:12.763260 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 827/1656] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:12.767388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b4a03-608c-496f-8186-324b16283f2c None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:12.794255 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b4a03-608c-496f-8186-324b16283f2c None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:12.801674 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bc47e-96f7-4572-a9aa-0aa332bf46b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:12.802750 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bc47e-96f7-4572-a9aa-0aa332bf46b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:12.803173 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bc47e-96f7-4572-a9aa-0aa332bf46b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:12.803602 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bc47e-96f7-4572-a9aa-0aa332bf46b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:12.804425 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3bc47e-96f7-4572-a9aa-0aa332bf46b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:31:12.804920 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3bc47e-96f7-4572-a9aa-0aa332bf46b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:12.807849 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3bc47e-96f7-4572-a9aa-0aa332bf46b5 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:12.830052 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121da70-e2a3-455b-bf36-425b00e17215 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:12.832008 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 830/1657] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:31:12.851037 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121da70-e2a3-455b-bf36-425b00e17215 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:12.869338 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be55a3-f38e-4953-b8bb-52c9122e0408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:12.869978 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be55a3-f38e-4953-b8bb-52c9122e0408 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:12.870265 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be55a3-f38e-4953-b8bb-52c9122e0408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:12.870537 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be55a3-f38e-4953-b8bb-52c9122e0408 admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:12.872076 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be55a3-f38e-4953-b8bb-52c9122e0408 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:12.879237 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be55a3-f38e-4953-b8bb-52c9122e0408 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:12.924306 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 828/1658] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:31:12 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:31:12.928940 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bc47e-96f7-4572-a9aa-0aa332bf46b5 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:12.949365 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bc47e-96f7-4572-a9aa-0aa332bf46b5 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:13.042017 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b88e58-b6d1-4a3c-9403-61e8f2b656d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:13.042953 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b88e58-b6d1-4a3c-9403-61e8f2b656d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:13.043625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b88e58-b6d1-4a3c-9403-61e8f2b656d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:13.044043 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b88e58-b6d1-4a3c-9403-61e8f2b656d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:13.045367 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b88e58-b6d1-4a3c-9403-61e8f2b656d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:13.047865 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b88e58-b6d1-4a3c-9403-61e8f2b656d2 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:13.078416 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 831/1659] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:31:12 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:13.082811 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be55a3-f38e-4953-b8bb-52c9122e0408 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:13.099036 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be55a3-f38e-4953-b8bb-52c9122e0408 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:13.114250 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a9919-02c1-4993-9473-eaa1adbc9125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:13.114890 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a9919-02c1-4993-9473-eaa1adbc9125 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:13.115179 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a9919-02c1-4993-9473-eaa1adbc9125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:13.115467 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a9919-02c1-4993-9473-eaa1adbc9125 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:13.116133 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a9919-02c1-4993-9473-eaa1adbc9125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:13.117838 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a9919-02c1-4993-9473-eaa1adbc9125 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:13.134309 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 829/1660] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:13.137691 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b88e58-b6d1-4a3c-9403-61e8f2b656d2 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:13.165329 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b88e58-b6d1-4a3c-9403-61e8f2b656d2 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:13.189115 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8aa508-38b9-455f-b82f-efc17b5ce49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:13.189799 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8aa508-38b9-455f-b82f-efc17b5ce49a admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:13.190091 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8aa508-38b9-455f-b82f-efc17b5ce49a admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:13.190361 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8aa508-38b9-455f-b82f-efc17b5ce49a admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:13.191016 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8aa508-38b9-455f-b82f-efc17b5ce49a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:13.192625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8aa508-38b9-455f-b82f-efc17b5ce49a admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:13.230637 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 832/1661] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:13.234674 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a9919-02c1-4993-9473-eaa1adbc9125 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:13.262608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a9919-02c1-4993-9473-eaa1adbc9125 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:13.287045 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31cf03-de9d-4771-9263-ebb1360e2194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:13.289690 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31cf03-de9d-4771-9263-ebb1360e2194 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:13.291517 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31cf03-de9d-4771-9263-ebb1360e2194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:13.291918 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31cf03-de9d-4771-9263-ebb1360e2194 admin admin] PATH_INFO: `/v3/projects/1897bf8393cc478094b4c75594155407/users/6f62e35e06e64f7e82df77fca01b923d/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:13.342115 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31cf03-de9d-4771-9263-ebb1360e2194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1897bf8393cc478094b4c75594155407, user_id=6f62e35e06e64f7e82df77fca01b923d, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:13.351656 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31cf03-de9d-4771-9263-ebb1360e2194 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:13.387748 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 830/1662] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:31:13 2022] PUT /identity/v3/projects/1897bf8393cc478094b4c75594155407/users/6f62e35e06e64f7e82df77fca01b923d/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:13.411535 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142cb68-8369-413f-ae91-82165f870982 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:13.412649 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142cb68-8369-413f-ae91-82165f870982 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:13.412940 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142cb68-8369-413f-ae91-82165f870982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:13.509286 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-1142cb68-8369-413f-ae91-82165f870982 None None] MFA Rules not processed for user `6f62e35e06e64f7e82df77fca01b923d`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:13.509286 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-1142cb68-8369-413f-ae91-82165f870982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:13.607210 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:13.640931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 833/1663] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:31:13.723704 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31cf03-de9d-4771-9263-ebb1360e2194 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:13.725661 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-4c31cf03-de9d-4771-9263-ebb1360e2194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:13.849585 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31cf03-de9d-4771-9263-ebb1360e2194 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:13.860819 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8049e7a-c7d8-45be-8911-20017f46a484 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:13.862016 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8049e7a-c7d8-45be-8911-20017f46a484 service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:13.862413 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8049e7a-c7d8-45be-8911-20017f46a484 service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:13.862927 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8049e7a-c7d8-45be-8911-20017f46a484 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:13.892865 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8049e7a-c7d8-45be-8911-20017f46a484 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:13.894477 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8049e7a-c7d8-45be-8911-20017f46a484 service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:13.914643 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 831/1664] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:15.133199 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142cb68-8369-413f-ae91-82165f870982 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:15.135215 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-1142cb68-8369-413f-ae91-82165f870982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:15.252850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142cb68-8369-413f-ae91-82165f870982 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:15.258449 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52e808-240b-4e15-8dee-b8f639343e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:15.259583 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52e808-240b-4e15-8dee-b8f639343e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:15.260083 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52e808-240b-4e15-8dee-b8f639343e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:15.260594 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52e808-240b-4e15-8dee-b8f639343e52 admin admin] PATH_INFO: `/v3/users/b159606b2f8646b18ce8aed30c2ff71e` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:15.262564 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52e808-240b-4e15-8dee-b8f639343e52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b159606b2f8646b18ce8aed30c2ff71e)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:15.264922 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52e808-240b-4e15-8dee-b8f639343e52 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:15.365602 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-df52e808-240b-4e15-8dee-b8f639343e52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b159606b2f8646b18ce8aed30c2ff71e'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:15.366469 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-df52e808-240b-4e15-8dee-b8f639343e52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b159606b2f8646b18ce8aed30c2ff71e'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:15.382722 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-df52e808-240b-4e15-8dee-b8f639343e52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b159606b2f8646b18ce8aed30c2ff71e'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:15.397536 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-df52e808-240b-4e15-8dee-b8f639343e52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b159606b2f8646b18ce8aed30c2ff71e'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:15.434402 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-df52e808-240b-4e15-8dee-b8f639343e52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b159606b2f8646b18ce8aed30c2ff71e'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:15.468048 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 834/1665] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:31:15 2022] DELETE /identity/v3/users/b159606b2f8646b18ce8aed30c2ff71e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:15.473084 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917a5c9-6adb-426e-b986-43dbc80d5ead None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:15.474687 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917a5c9-6adb-426e-b986-43dbc80d5ead None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:15.476766 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917a5c9-6adb-426e-b986-43dbc80d5ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:15.504861 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-e917a5c9-6adb-426e-b986-43dbc80d5ead None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:15.506365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-e917a5c9-6adb-426e-b986-43dbc80d5ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:15.665841 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52e808-240b-4e15-8dee-b8f639343e52 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:15.669149 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-df52e808-240b-4e15-8dee-b8f639343e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:15.704458 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 832/1666] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:31:15.877843 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917a5c9-6adb-426e-b986-43dbc80d5ead None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:15.879682 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-e917a5c9-6adb-426e-b986-43dbc80d5ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:15.911030 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52e808-240b-4e15-8dee-b8f639343e52 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:15.937688 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1db76-4bff-4da7-9b9a-940625ae0a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:15.938657 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1db76-4bff-4da7-9b9a-940625ae0a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:15.939435 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1db76-4bff-4da7-9b9a-940625ae0a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:15.940026 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1db76-4bff-4da7-9b9a-940625ae0a02 admin admin] PATH_INFO: `/v3/users/e7a4007e8c3a4221883d101475937039` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:15.946455 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1db76-4bff-4da7-9b9a-940625ae0a02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7a4007e8c3a4221883d101475937039)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:15.951125 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1db76-4bff-4da7-9b9a-940625ae0a02 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:15.980906 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:15.984160 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:16.053166 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917a5c9-6adb-426e-b986-43dbc80d5ead None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:16.064673 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d2c20-ef36-4616-bd65-3bb4b6e844de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:16.065309 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d2c20-ef36-4616-bd65-3bb4b6e844de service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:16.065593 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d2c20-ef36-4616-bd65-3bb4b6e844de service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:16.068044 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d2c20-ef36-4616-bd65-3bb4b6e844de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:16.088108 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-3fc1db76-4bff-4da7-9b9a-940625ae0a02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7a4007e8c3a4221883d101475937039'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:16.090767 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-3fc1db76-4bff-4da7-9b9a-940625ae0a02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7a4007e8c3a4221883d101475937039'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:16.091213 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d2c20-ef36-4616-bd65-3bb4b6e844de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:16.094102 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d2c20-ef36-4616-bd65-3bb4b6e844de service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:16.108319 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-3fc1db76-4bff-4da7-9b9a-940625ae0a02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7a4007e8c3a4221883d101475937039'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:16.110670 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-3fc1db76-4bff-4da7-9b9a-940625ae0a02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7a4007e8c3a4221883d101475937039'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:16.125494 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 833/1667] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 20:31:16.142376 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-3fc1db76-4bff-4da7-9b9a-940625ae0a02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7a4007e8c3a4221883d101475937039'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:16.181018 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 835/1668] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:31:15 2022] DELETE /identity/v3/users/e7a4007e8c3a4221883d101475937039 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:16.185281 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1afb1fe-122f-409f-8be8-2da8bfa10254 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:16.185573 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1afb1fe-122f-409f-8be8-2da8bfa10254 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:16.186145 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1afb1fe-122f-409f-8be8-2da8bfa10254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:16.227095 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-c1afb1fe-122f-409f-8be8-2da8bfa10254 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:16.228636 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-c1afb1fe-122f-409f-8be8-2da8bfa10254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:16.373678 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 834/1669] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:16.442775 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1db76-4bff-4da7-9b9a-940625ae0a02 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:16.444639 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-3fc1db76-4bff-4da7-9b9a-940625ae0a02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:16.572847 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1db76-4bff-4da7-9b9a-940625ae0a02 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:16.576840 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29437b-d216-44b3-adb2-b393b7ae576a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:16.577466 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29437b-d216-44b3-adb2-b393b7ae576a service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:16.577751 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29437b-d216-44b3-adb2-b393b7ae576a service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:16.578284 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29437b-d216-44b3-adb2-b393b7ae576a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:16.592363 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29437b-d216-44b3-adb2-b393b7ae576a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:16.594080 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29437b-d216-44b3-adb2-b393b7ae576a service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:16.617015 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 836/1670] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:17.054740 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1afb1fe-122f-409f-8be8-2da8bfa10254 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:17.055513 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-c1afb1fe-122f-409f-8be8-2da8bfa10254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:17.071514 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1afb1fe-122f-409f-8be8-2da8bfa10254 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:17.078378 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe6202-fa80-4fa1-916a-388d0445fa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:17.079711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe6202-fa80-4fa1-916a-388d0445fa1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:17.080120 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe6202-fa80-4fa1-916a-388d0445fa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:17.080465 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe6202-fa80-4fa1-916a-388d0445fa1c admin admin] PATH_INFO: `/v3/projects/b0caf64c53b848109c66b21df9d2d305` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:17.081856 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe6202-fa80-4fa1-916a-388d0445fa1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0caf64c53b848109c66b21df9d2d305)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:17.083989 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe6202-fa80-4fa1-916a-388d0445fa1c admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:17.181511 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29437b-d216-44b3-adb2-b393b7ae576a service neutron] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:17.185276 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-4b29437b-d216-44b3-adb2-b393b7ae576a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:17.200091 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-a5fe6202-fa80-4fa1-916a-388d0445fa1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0caf64c53b848109c66b21df9d2d305', 'request_id': 'req-a5fe6202-fa80-4fa1-916a-388d0445fa1c'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:17.209424 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-a5fe6202-fa80-4fa1-916a-388d0445fa1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0caf64c53b848109c66b21df9d2d305', 'request_id': 'req-a5fe6202-fa80-4fa1-916a-388d0445fa1c'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:17.219128 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29437b-d216-44b3-adb2-b393b7ae576a service neutron] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:17.238141 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-a5fe6202-fa80-4fa1-916a-388d0445fa1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0caf64c53b848109c66b21df9d2d305', 'request_id': 'req-a5fe6202-fa80-4fa1-916a-388d0445fa1c'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:17.284985 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-a5fe6202-fa80-4fa1-916a-388d0445fa1c admin admin] The token cache is being invalidate because project b0caf64c53b848109c66b21df9d2d305 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:31:17.287760 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-a5fe6202-fa80-4fa1-916a-388d0445fa1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:17.290942 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-a5fe6202-fa80-4fa1-916a-388d0445fa1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:17.301273 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 835/1671] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:31:17 2022] DELETE /identity/v3/projects/b0caf64c53b848109c66b21df9d2d305 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:17.302821 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe6202-fa80-4fa1-916a-388d0445fa1c admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:17.305267 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-a5fe6202-fa80-4fa1-916a-388d0445fa1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:17.368926 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a9c62-2977-448d-afed-c67d66a0b732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:17.371780 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a9c62-2977-448d-afed-c67d66a0b732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:17.372067 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a9c62-2977-448d-afed-c67d66a0b732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:17.372349 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a9c62-2977-448d-afed-c67d66a0b732 admin admin] PATH_INFO: `/v3/projects/7828b406acfa40e6bad1404e48ccfcf2` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:17.373815 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a9c62-2977-448d-afed-c67d66a0b732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7828b406acfa40e6bad1404e48ccfcf2)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:17.377015 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a9c62-2977-448d-afed-c67d66a0b732 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:17.416496 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:17.421407 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe6202-fa80-4fa1-916a-388d0445fa1c admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:17.422953 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:17.442339 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-e74a9c62-2977-448d-afed-c67d66a0b732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7828b406acfa40e6bad1404e48ccfcf2', 'request_id': 'req-e74a9c62-2977-448d-afed-c67d66a0b732'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:17.453649 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-e74a9c62-2977-448d-afed-c67d66a0b732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7828b406acfa40e6bad1404e48ccfcf2', 'request_id': 'req-e74a9c62-2977-448d-afed-c67d66a0b732'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:17.468041 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-e74a9c62-2977-448d-afed-c67d66a0b732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7828b406acfa40e6bad1404e48ccfcf2', 'request_id': 'req-e74a9c62-2977-448d-afed-c67d66a0b732'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:17.494781 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-e74a9c62-2977-448d-afed-c67d66a0b732 admin admin] The token cache is being invalidate because project 7828b406acfa40e6bad1404e48ccfcf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:31:17.495107 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-e74a9c62-2977-448d-afed-c67d66a0b732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:17.495881 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-e74a9c62-2977-448d-afed-c67d66a0b732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:17.498968 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 837/1672] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:31:17 2022] DELETE /identity/v3/projects/7828b406acfa40e6bad1404e48ccfcf2 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:17.505926 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a9c62-2977-448d-afed-c67d66a0b732 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:17.507584 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-e74a9c62-2977-448d-afed-c67d66a0b732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:17.508577 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4c46c-bf19-420f-9c02-6dd1cb4b10ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:17.509264 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4c46c-bf19-420f-9c02-6dd1cb4b10ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:17.509556 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4c46c-bf19-420f-9c02-6dd1cb4b10ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:17.509998 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4c46c-bf19-420f-9c02-6dd1cb4b10ef admin admin] PATH_INFO: `/v3/users/db7f1bd60f654818a13784e4cded9400` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:17.511168 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4c46c-bf19-420f-9c02-6dd1cb4b10ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=db7f1bd60f654818a13784e4cded9400)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:17.513522 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4c46c-bf19-420f-9c02-6dd1cb4b10ef admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:17.524304 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a9c62-2977-448d-afed-c67d66a0b732 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:17.530609 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda1f68-f030-4a4c-a7d9-8e87573664cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:17.531281 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda1f68-f030-4a4c-a7d9-8e87573664cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:17.531573 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda1f68-f030-4a4c-a7d9-8e87573664cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:17.532028 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda1f68-f030-4a4c-a7d9-8e87573664cf admin admin] PATH_INFO: `/v3/users/ab7ffd656edc423690127f909a47ba64` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:17.533239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda1f68-f030-4a4c-a7d9-8e87573664cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab7ffd656edc423690127f909a47ba64)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:17.535943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda1f68-f030-4a4c-a7d9-8e87573664cf admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:17.577461 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-8ca4c46c-bf19-420f-9c02-6dd1cb4b10ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db7f1bd60f654818a13784e4cded9400'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:17.579382 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-8ca4c46c-bf19-420f-9c02-6dd1cb4b10ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db7f1bd60f654818a13784e4cded9400'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:17.593050 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-8ca4c46c-bf19-420f-9c02-6dd1cb4b10ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db7f1bd60f654818a13784e4cded9400'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:17.593773 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-8ca4c46c-bf19-420f-9c02-6dd1cb4b10ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db7f1bd60f654818a13784e4cded9400'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:17.595123 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-efda1f68-f030-4a4c-a7d9-8e87573664cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab7ffd656edc423690127f909a47ba64'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:17.595843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-efda1f68-f030-4a4c-a7d9-8e87573664cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab7ffd656edc423690127f909a47ba64'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:17.601576 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-8ca4c46c-bf19-420f-9c02-6dd1cb4b10ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db7f1bd60f654818a13784e4cded9400'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:17.605063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-efda1f68-f030-4a4c-a7d9-8e87573664cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab7ffd656edc423690127f909a47ba64'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:17.606069 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-efda1f68-f030-4a4c-a7d9-8e87573664cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab7ffd656edc423690127f909a47ba64'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:17.617779 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 836/1673] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:31:17 2022] DELETE /identity/v3/users/db7f1bd60f654818a13784e4cded9400 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:17.624067 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-efda1f68-f030-4a4c-a7d9-8e87573664cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab7ffd656edc423690127f909a47ba64'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:17.638614 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 838/1674] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:31:17 2022] DELETE /identity/v3/users/ab7ffd656edc423690127f909a47ba64 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:18.633341 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4c46c-bf19-420f-9c02-6dd1cb4b10ef admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:18.634954 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-8ca4c46c-bf19-420f-9c02-6dd1cb4b10ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:18.726768 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4c46c-bf19-420f-9c02-6dd1cb4b10ef admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:18.784835 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:18.800669 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda1f68-f030-4a4c-a7d9-8e87573664cf admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:18.802238 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-efda1f68-f030-4a4c-a7d9-8e87573664cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:18.868040 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ab2f0-ce99-4066-a53e-2f33757b544a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:18.869222 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ab2f0-ce99-4066-a53e-2f33757b544a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:18.869542 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ab2f0-ce99-4066-a53e-2f33757b544a admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:18.869799 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ab2f0-ce99-4066-a53e-2f33757b544a admin admin] PATH_INFO: `/v3/projects/61e8e537d42f47c3aee37114883fbba7` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:18.874914 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ab2f0-ce99-4066-a53e-2f33757b544a admin admin] RBAC: Authorizing `identity:delete_project(project_id=61e8e537d42f47c3aee37114883fbba7)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:18.878401 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ab2f0-ce99-4066-a53e-2f33757b544a admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:18.930794 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda1f68-f030-4a4c-a7d9-8e87573664cf admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:18.941165 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695940f-8b06-4cb9-bcf6-7ea58b9d7a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:18.955052 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695940f-8b06-4cb9-bcf6-7ea58b9d7a3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:18.955052 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695940f-8b06-4cb9-bcf6-7ea58b9d7a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:18.955351 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695940f-8b06-4cb9-bcf6-7ea58b9d7a3c admin admin] PATH_INFO: `/v3/projects/58c1154d6fba42168458977350f39e27` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:18.959083 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695940f-8b06-4cb9-bcf6-7ea58b9d7a3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=58c1154d6fba42168458977350f39e27)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:18.960426 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-1d3ab2f0-ce99-4066-a53e-2f33757b544a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61e8e537d42f47c3aee37114883fbba7', 'request_id': 'req-1d3ab2f0-ce99-4066-a53e-2f33757b544a'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:18.964069 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695940f-8b06-4cb9-bcf6-7ea58b9d7a3c admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:18.969997 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-1d3ab2f0-ce99-4066-a53e-2f33757b544a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61e8e537d42f47c3aee37114883fbba7', 'request_id': 'req-1d3ab2f0-ce99-4066-a53e-2f33757b544a'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:18.985820 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-1d3ab2f0-ce99-4066-a53e-2f33757b544a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61e8e537d42f47c3aee37114883fbba7', 'request_id': 'req-1d3ab2f0-ce99-4066-a53e-2f33757b544a'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:19.012888 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-1d3ab2f0-ce99-4066-a53e-2f33757b544a admin admin] The token cache is being invalidate because project 61e8e537d42f47c3aee37114883fbba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:31:19.013780 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-1d3ab2f0-ce99-4066-a53e-2f33757b544a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:19.014797 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-1d3ab2f0-ce99-4066-a53e-2f33757b544a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:19.020410 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 837/1675] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:31:18 2022] DELETE /identity/v3/projects/61e8e537d42f47c3aee37114883fbba7 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:19.022653 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48605962-2719-4c83-9e2c-10dab63b6d58 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:19.023096 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48605962-2719-4c83-9e2c-10dab63b6d58 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:19.023529 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:19.024479 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48605962-2719-4c83-9e2c-10dab63b6d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:19.040414 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0695940f-8b06-4cb9-bcf6-7ea58b9d7a3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58c1154d6fba42168458977350f39e27', 'request_id': 'req-0695940f-8b06-4cb9-bcf6-7ea58b9d7a3c'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:19.048268 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0695940f-8b06-4cb9-bcf6-7ea58b9d7a3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58c1154d6fba42168458977350f39e27', 'request_id': 'req-0695940f-8b06-4cb9-bcf6-7ea58b9d7a3c'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:19.056512 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-48605962-2719-4c83-9e2c-10dab63b6d58 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:19.059171 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-48605962-2719-4c83-9e2c-10dab63b6d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:19.059955 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0695940f-8b06-4cb9-bcf6-7ea58b9d7a3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58c1154d6fba42168458977350f39e27', 'request_id': 'req-0695940f-8b06-4cb9-bcf6-7ea58b9d7a3c'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:19.074335 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0695940f-8b06-4cb9-bcf6-7ea58b9d7a3c admin admin] The token cache is being invalidate because project 58c1154d6fba42168458977350f39e27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:31:19.075054 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0695940f-8b06-4cb9-bcf6-7ea58b9d7a3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:19.076761 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0695940f-8b06-4cb9-bcf6-7ea58b9d7a3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:19.080101 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 839/1676] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:31:18 2022] DELETE /identity/v3/projects/58c1154d6fba42168458977350f39e27 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:19.084741 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e84bd3-06a3-45a2-89cd-534a5c80144c None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:19.085413 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e84bd3-06a3-45a2-89cd-534a5c80144c None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:19.086868 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e84bd3-06a3-45a2-89cd-534a5c80144c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:19.112951 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-74e84bd3-06a3-45a2-89cd-534a5c80144c None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:19.114721 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-74e84bd3-06a3-45a2-89cd-534a5c80144c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:19.147545 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 838/1677] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:19.156034 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d4100-e846-474d-8eb5-f79870ebf7c7 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:19.156390 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d4100-e846-474d-8eb5-f79870ebf7c7 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:19.157372 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d4100-e846-474d-8eb5-f79870ebf7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:19.197454 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-948d4100-e846-474d-8eb5-f79870ebf7c7 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:19.199384 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-948d4100-e846-474d-8eb5-f79870ebf7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:19.204683 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 840/1678] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:19.210898 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 839/1679] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:19.214263 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916b4d5-756b-424c-990e-32d3bf2b755d None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:19.214634 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916b4d5-756b-424c-990e-32d3bf2b755d None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:19.215174 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916b4d5-756b-424c-990e-32d3bf2b755d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:19.215267 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d4100-e846-474d-8eb5-f79870ebf7c7 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:19.230064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d4100-e846-474d-8eb5-f79870ebf7c7 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:19.238542 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc20a65-d1a2-45a5-8e31-b96967c86c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:19.239533 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc20a65-d1a2-45a5-8e31-b96967c86c1f admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:19.240000 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc20a65-d1a2-45a5-8e31-b96967c86c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:19.240605 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc20a65-d1a2-45a5-8e31-b96967c86c1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:19.241543 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc20a65-d1a2-45a5-8e31-b96967c86c1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:31:19.242033 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc20a65-d1a2-45a5-8e31-b96967c86c1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:19.243899 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc20a65-d1a2-45a5-8e31-b96967c86c1f admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:19.256072 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-3916b4d5-756b-424c-990e-32d3bf2b755d None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:19.257541 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-3916b4d5-756b-424c-990e-32d3bf2b755d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:19.272301 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 840/1680] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:31:19.273169 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc20a65-d1a2-45a5-8e31-b96967c86c1f admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:19.283843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 841/1681] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:19.285632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc20a65-d1a2-45a5-8e31-b96967c86c1f admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:19.288750 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916b4d5-756b-424c-990e-32d3bf2b755d None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:19.301581 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916b4d5-756b-424c-990e-32d3bf2b755d None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:19.309036 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244fbfe-8e4a-4b3b-bbaf-6e46e8bff91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:19.310067 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244fbfe-8e4a-4b3b-bbaf-6e46e8bff91d admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:19.310293 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244fbfe-8e4a-4b3b-bbaf-6e46e8bff91d admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:19.310541 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b0884-5e50-4a77-ae85-ad86f15f77ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:19.310751 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244fbfe-8e4a-4b3b-bbaf-6e46e8bff91d admin admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:19.311755 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244fbfe-8e4a-4b3b-bbaf-6e46e8bff91d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:31:19.312711 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244fbfe-8e4a-4b3b-bbaf-6e46e8bff91d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:19.314083 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b0884-5e50-4a77-ae85-ad86f15f77ff admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:19.315532 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244fbfe-8e4a-4b3b-bbaf-6e46e8bff91d admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:19.316209 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b0884-5e50-4a77-ae85-ad86f15f77ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:19.316331 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b0884-5e50-4a77-ae85-ad86f15f77ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:19.320480 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b0884-5e50-4a77-ae85-ad86f15f77ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:19.346141 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 842/1682] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:31:19.347141 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244fbfe-8e4a-4b3b-bbaf-6e46e8bff91d admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:19.349183 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b0884-5e50-4a77-ae85-ad86f15f77ff admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:19.360650 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244fbfe-8e4a-4b3b-bbaf-6e46e8bff91d admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:19.367780 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dd03d-2552-40c6-a4ba-c3f8b2e556b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:19.368662 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dd03d-2552-40c6-a4ba-c3f8b2e556b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:19.369074 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dd03d-2552-40c6-a4ba-c3f8b2e556b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:19.369453 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dd03d-2552-40c6-a4ba-c3f8b2e556b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:19.370272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6dd03d-2552-40c6-a4ba-c3f8b2e556b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:19.372678 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6dd03d-2552-40c6-a4ba-c3f8b2e556b2 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:19.420356 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 843/1683] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:31:19 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:19.421483 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dd03d-2552-40c6-a4ba-c3f8b2e556b2 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:19.433224 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 841/1684] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:31:19 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:19.437840 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b0884-5e50-4a77-ae85-ad86f15f77ff admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:19.478274 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:19.573342 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dd03d-2552-40c6-a4ba-c3f8b2e556b2 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:19.627674 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b0884-5e50-4a77-ae85-ad86f15f77ff admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:19.632221 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:19.647086 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaea046-695c-40fb-a115-21ed81a52533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:19.647898 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaea046-695c-40fb-a115-21ed81a52533 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:19.648284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaea046-695c-40fb-a115-21ed81a52533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:19.648688 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaea046-695c-40fb-a115-21ed81a52533 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:19.649511 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaea046-695c-40fb-a115-21ed81a52533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:19.653957 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaea046-695c-40fb-a115-21ed81a52533 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:19.699492 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf086b9-598b-43c4-b9ee-b0eb5868ae60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:19.701284 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf086b9-598b-43c4-b9ee-b0eb5868ae60 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:19.701284 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf086b9-598b-43c4-b9ee-b0eb5868ae60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:19.701284 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf086b9-598b-43c4-b9ee-b0eb5868ae60 admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:19.701774 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf086b9-598b-43c4-b9ee-b0eb5868ae60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:19.704019 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf086b9-598b-43c4-b9ee-b0eb5868ae60 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:19.717371 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 842/1685] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:31:19 2022] POST /identity/v3/users => generated 290 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:31:19.720529 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaea046-695c-40fb-a115-21ed81a52533 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:19.743448 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaea046-695c-40fb-a115-21ed81a52533 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:19.750325 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af7843-2a42-4b06-8b03-36b81e77a987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:19.750995 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af7843-2a42-4b06-8b03-36b81e77a987 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:19.751285 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af7843-2a42-4b06-8b03-36b81e77a987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:19.751571 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af7843-2a42-4b06-8b03-36b81e77a987 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:19.752283 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af7843-2a42-4b06-8b03-36b81e77a987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:19.753912 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af7843-2a42-4b06-8b03-36b81e77a987 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:19.759585 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 844/1686] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:31:19 2022] POST /identity/v3/users => generated 292 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:19.764260 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf086b9-598b-43c4-b9ee-b0eb5868ae60 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:19.770908 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 843/1687] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:19.771822 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af7843-2a42-4b06-8b03-36b81e77a987 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:19.783720 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af7843-2a42-4b06-8b03-36b81e77a987 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:19.789048 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf086b9-598b-43c4-b9ee-b0eb5868ae60 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:19.789251 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4879b8e-c388-4cd7-8a0c-c50abd6b0720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:19.790063 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4879b8e-c388-4cd7-8a0c-c50abd6b0720 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:19.790271 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4879b8e-c388-4cd7-8a0c-c50abd6b0720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:19.791149 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4879b8e-c388-4cd7-8a0c-c50abd6b0720 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:19.791935 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4879b8e-c388-4cd7-8a0c-c50abd6b0720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:19.793575 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4879b8e-c388-4cd7-8a0c-c50abd6b0720 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:19.799803 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b5fe2-9f9d-40a3-b0c5-8a4fa5f816f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:19.800580 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b5fe2-9f9d-40a3-b0c5-8a4fa5f816f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:19.800972 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b5fe2-9f9d-40a3-b0c5-8a4fa5f816f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:19.801509 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b5fe2-9f9d-40a3-b0c5-8a4fa5f816f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:19.802124 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b5fe2-9f9d-40a3-b0c5-8a4fa5f816f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:19.805182 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b5fe2-9f9d-40a3-b0c5-8a4fa5f816f1 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:19.805664 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 844/1688] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:19.811574 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4879b8e-c388-4cd7-8a0c-c50abd6b0720 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:19.822266 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4879b8e-c388-4cd7-8a0c-c50abd6b0720 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:19.824378 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 845/1689] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:19.825763 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b5fe2-9f9d-40a3-b0c5-8a4fa5f816f1 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:19.827293 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364620d-80be-49d8-9028-b1303cf1ba39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:19.828238 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364620d-80be-49d8-9028-b1303cf1ba39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:19.829063 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364620d-80be-49d8-9028-b1303cf1ba39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:19.829828 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364620d-80be-49d8-9028-b1303cf1ba39 admin admin] PATH_INFO: `/v3/projects/8f7817a61b754761b21d3b98ddcf41c5/users/24e64869ab0c4ee483628ae0a9385834/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:19.862291 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b5fe2-9f9d-40a3-b0c5-8a4fa5f816f1 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:19.870695 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364620d-80be-49d8-9028-b1303cf1ba39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f7817a61b754761b21d3b98ddcf41c5, user_id=24e64869ab0c4ee483628ae0a9385834, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:19.871901 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442d063-211f-4012-86ec-8da0a6e4ef97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:19.873001 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442d063-211f-4012-86ec-8da0a6e4ef97 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:19.873478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442d063-211f-4012-86ec-8da0a6e4ef97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:19.873800 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442d063-211f-4012-86ec-8da0a6e4ef97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:19.875371 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2442d063-211f-4012-86ec-8da0a6e4ef97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:19.875534 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364620d-80be-49d8-9028-b1303cf1ba39 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:19.877252 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2442d063-211f-4012-86ec-8da0a6e4ef97 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:19.890206 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 846/1690] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:19.895078 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442d063-211f-4012-86ec-8da0a6e4ef97 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:19.906460 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442d063-211f-4012-86ec-8da0a6e4ef97 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:19.910986 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 845/1691] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:31:19 2022] PUT /identity/v3/projects/8f7817a61b754761b21d3b98ddcf41c5/users/24e64869ab0c4ee483628ae0a9385834/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:19.912596 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32afc34-3721-496e-ae8e-d91093cce1f6 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:19.912880 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32afc34-3721-496e-ae8e-d91093cce1f6 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:19.913171 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32afc34-3721-496e-ae8e-d91093cce1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:19.957867 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-c32afc34-3721-496e-ae8e-d91093cce1f6 None None] MFA Rules not processed for user `24e64869ab0c4ee483628ae0a9385834`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:19.959100 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-c32afc34-3721-496e-ae8e-d91093cce1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:19.996213 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799f5b6-3432-461e-b610-6aa32d51efd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:19.997556 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799f5b6-3432-461e-b610-6aa32d51efd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:19.998064 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799f5b6-3432-461e-b610-6aa32d51efd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:19.998458 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799f5b6-3432-461e-b610-6aa32d51efd0 admin admin] PATH_INFO: `/v3/projects/319de54e2d6b43a4a517a8f5b3032c63/users/d5531130e8bb4f3ba0f1de1d2639dace/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:20.019376 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799f5b6-3432-461e-b610-6aa32d51efd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=319de54e2d6b43a4a517a8f5b3032c63, user_id=d5531130e8bb4f3ba0f1de1d2639dace, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:20.022139 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799f5b6-3432-461e-b610-6aa32d51efd0 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:20.039591 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 847/1692] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:31:19 2022] PUT /identity/v3/projects/319de54e2d6b43a4a517a8f5b3032c63/users/d5531130e8bb4f3ba0f1de1d2639dace/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:20.050771 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce2832-7e83-47c5-a7cf-6f90fea68271 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:20.051147 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce2832-7e83-47c5-a7cf-6f90fea68271 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:20.051569 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce2832-7e83-47c5-a7cf-6f90fea68271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:20.091969 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-81ce2832-7e83-47c5-a7cf-6f90fea68271 None None] MFA Rules not processed for user `d5531130e8bb4f3ba0f1de1d2639dace`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:20.093461 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-81ce2832-7e83-47c5-a7cf-6f90fea68271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:20.112481 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 846/1693] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:20.119181 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32afc34-3721-496e-ae8e-d91093cce1f6 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:20.131489 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32afc34-3721-496e-ae8e-d91093cce1f6 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:20.197048 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 848/1694] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:20.201377 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce2832-7e83-47c5-a7cf-6f90fea68271 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:20.218771 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:20.221148 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:20.242638 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b3ca6-cedb-4764-9720-1fb3a6761ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:20.243434 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b3ca6-cedb-4764-9720-1fb3a6761ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:20.243788 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b3ca6-cedb-4764-9720-1fb3a6761ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:20.244454 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b3ca6-cedb-4764-9720-1fb3a6761ce2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:20.245419 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b3ca6-cedb-4764-9720-1fb3a6761ce2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:20.249073 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b3ca6-cedb-4764-9720-1fb3a6761ce2 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:20.305407 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 847/1695] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:31:20 2022] POST /identity/v3/projects => generated 377 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:20.308973 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b3ca6-cedb-4764-9720-1fb3a6761ce2 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:20.331486 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce2832-7e83-47c5-a7cf-6f90fea68271 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:20.444870 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed328f4-1b31-4f1d-bc04-0b42290183dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:20.445499 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed328f4-1b31-4f1d-bc04-0b42290183dd admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:20.445790 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed328f4-1b31-4f1d-bc04-0b42290183dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:20.446072 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed328f4-1b31-4f1d-bc04-0b42290183dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:20.446772 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed328f4-1b31-4f1d-bc04-0b42290183dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:20.448766 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed328f4-1b31-4f1d-bc04-0b42290183dd admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:20.492706 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 849/1696] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:31:20 2022] POST /identity/v3/projects => generated 383 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:31:20.494568 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed328f4-1b31-4f1d-bc04-0b42290183dd admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:20.545739 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b3ca6-cedb-4764-9720-1fb3a6761ce2 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:20.600892 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed328f4-1b31-4f1d-bc04-0b42290183dd admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:20.606599 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605a9bd-7f40-43ce-8052-c3f8996472c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:20.607399 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605a9bd-7f40-43ce-8052-c3f8996472c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:20.607688 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605a9bd-7f40-43ce-8052-c3f8996472c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:20.607982 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605a9bd-7f40-43ce-8052-c3f8996472c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:20.608817 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605a9bd-7f40-43ce-8052-c3f8996472c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:20.610730 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605a9bd-7f40-43ce-8052-c3f8996472c4 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:20.627001 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a2428-2f5d-4269-bb67-e1834070c7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:20.627802 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a2428-2f5d-4269-bb67-e1834070c7bd admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:20.628282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a2428-2f5d-4269-bb67-e1834070c7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:20.628875 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a2428-2f5d-4269-bb67-e1834070c7bd admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:20.629611 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a2428-2f5d-4269-bb67-e1834070c7bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:20.632494 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a2428-2f5d-4269-bb67-e1834070c7bd admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:20.636652 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 850/1697] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:31:20 2022] POST /identity/v3/users => generated 298 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:20.639780 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605a9bd-7f40-43ce-8052-c3f8996472c4 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:20.655991 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605a9bd-7f40-43ce-8052-c3f8996472c4 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:20.662152 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4750cf5-c84c-422c-b1c2-5535eda025e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:20.662891 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4750cf5-c84c-422c-b1c2-5535eda025e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:20.663269 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4750cf5-c84c-422c-b1c2-5535eda025e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:20.663640 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4750cf5-c84c-422c-b1c2-5535eda025e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:20.664393 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4750cf5-c84c-422c-b1c2-5535eda025e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:20.665397 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 848/1698] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:31:20 2022] POST /identity/v3/users => generated 289 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:31:20.666259 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4750cf5-c84c-422c-b1c2-5535eda025e9 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:20.669735 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a2428-2f5d-4269-bb67-e1834070c7bd admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:20.681312 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 851/1699] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:31:20.684574 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a2428-2f5d-4269-bb67-e1834070c7bd admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:20.685245 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4750cf5-c84c-422c-b1c2-5535eda025e9 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:20.695274 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd340129-b82b-4960-bb29-4c7ef7924a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:20.695903 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd340129-b82b-4960-bb29-4c7ef7924a2f admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:20.696315 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd340129-b82b-4960-bb29-4c7ef7924a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:20.696477 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd340129-b82b-4960-bb29-4c7ef7924a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:20.697162 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd340129-b82b-4960-bb29-4c7ef7924a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:20.698772 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd340129-b82b-4960-bb29-4c7ef7924a2f admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:20.699660 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4750cf5-c84c-422c-b1c2-5535eda025e9 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:20.707842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b30a9e-3bc1-4943-8084-71387836908f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:20.707842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b30a9e-3bc1-4943-8084-71387836908f admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:20.707842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b30a9e-3bc1-4943-8084-71387836908f admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:20.707842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b30a9e-3bc1-4943-8084-71387836908f admin admin] PATH_INFO: `/v3/projects/bda47a853ea043aca0cfe319b5e91918/users/c8f02c04623449a788ca929256554a0b/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:20.720123 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 849/1700] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:31:20.721311 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd340129-b82b-4960-bb29-4c7ef7924a2f admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:20.723308 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b30a9e-3bc1-4943-8084-71387836908f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bda47a853ea043aca0cfe319b5e91918, user_id=c8f02c04623449a788ca929256554a0b, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:20.726782 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b30a9e-3bc1-4943-8084-71387836908f admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:20.731140 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:20.732684 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd340129-b82b-4960-bb29-4c7ef7924a2f admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:20.739208 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d144f-bc57-4a71-9065-868605b5b856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:20.740023 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d144f-bc57-4a71-9065-868605b5b856 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:20.749055 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 852/1701] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:31:20 2022] PUT /identity/v3/projects/bda47a853ea043aca0cfe319b5e91918/users/c8f02c04623449a788ca929256554a0b/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:20.749965 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b30a9e-3bc1-4943-8084-71387836908f admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:20.751794 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d144f-bc57-4a71-9065-868605b5b856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:20.752656 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d144f-bc57-4a71-9065-868605b5b856 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:20.755482 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d144f-bc57-4a71-9065-868605b5b856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:20.757289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d144f-bc57-4a71-9065-868605b5b856 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:20.780624 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 850/1702] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:20.786453 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d144f-bc57-4a71-9065-868605b5b856 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:20.808359 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d144f-bc57-4a71-9065-868605b5b856 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:20.835123 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b30a9e-3bc1-4943-8084-71387836908f admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:20.852953 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73d71c-bca6-435b-a75a-3a05ecbd3df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:20.852953 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73d71c-bca6-435b-a75a-3a05ecbd3df2 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:20.852953 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73d71c-bca6-435b-a75a-3a05ecbd3df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:20.852953 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73d71c-bca6-435b-a75a-3a05ecbd3df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:20.853860 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f73d71c-bca6-435b-a75a-3a05ecbd3df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:20.853860 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f73d71c-bca6-435b-a75a-3a05ecbd3df2 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:20.861175 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 853/1703] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:20.862288 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73d71c-bca6-435b-a75a-3a05ecbd3df2 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:20.878098 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73d71c-bca6-435b-a75a-3a05ecbd3df2 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:20.883813 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288827a-cbf8-4c34-9928-979066769494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:20.884586 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288827a-cbf8-4c34-9928-979066769494 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:20.884932 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288827a-cbf8-4c34-9928-979066769494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:20.885305 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288827a-cbf8-4c34-9928-979066769494 admin admin] PATH_INFO: `/v3/projects/bda47a853ea043aca0cfe319b5e91918/users/c8f02c04623449a788ca929256554a0b/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:20.887889 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288827a-cbf8-4c34-9928-979066769494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bda47a853ea043aca0cfe319b5e91918, user_id=c8f02c04623449a788ca929256554a0b, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:20.890241 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288827a-cbf8-4c34-9928-979066769494 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:20.916011 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 854/1704] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:31:20 2022] PUT /identity/v3/projects/bda47a853ea043aca0cfe319b5e91918/users/c8f02c04623449a788ca929256554a0b/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:20.918668 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:20.918858 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095340d2-b706-410f-9dab-1887fc2b1876 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:20.919416 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095340d2-b706-410f-9dab-1887fc2b1876 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:20.919416 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095340d2-b706-410f-9dab-1887fc2b1876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:20.937466 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b9a41-aaa1-4ed9-8af2-1636516ed9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:20.939172 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b9a41-aaa1-4ed9-8af2-1636516ed9a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:20.939596 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b9a41-aaa1-4ed9-8af2-1636516ed9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:20.940213 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b9a41-aaa1-4ed9-8af2-1636516ed9a1 admin admin] PATH_INFO: `/v3/projects/0ef24cca40c54aec9f98098f5093a84e/users/3b299dc12d9740bca6d2ccb4969b0819/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:20.963039 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b9a41-aaa1-4ed9-8af2-1636516ed9a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ef24cca40c54aec9f98098f5093a84e, user_id=3b299dc12d9740bca6d2ccb4969b0819, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:20.965957 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b9a41-aaa1-4ed9-8af2-1636516ed9a1 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:20.979730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 851/1705] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:31:20 2022] PUT /identity/v3/projects/0ef24cca40c54aec9f98098f5093a84e/users/3b299dc12d9740bca6d2ccb4969b0819/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:20.990592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a449b-e9c6-4a08-9436-7b37f35b4cd0 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:20.990873 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a449b-e9c6-4a08-9436-7b37f35b4cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:20.991146 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a449b-e9c6-4a08-9436-7b37f35b4cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:20.994980 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-095340d2-b706-410f-9dab-1887fc2b1876 None None] MFA Rules not processed for user `c8f02c04623449a788ca929256554a0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:20.996207 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-095340d2-b706-410f-9dab-1887fc2b1876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:21.043802 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-610a449b-e9c6-4a08-9436-7b37f35b4cd0 None None] MFA Rules not processed for user `3b299dc12d9740bca6d2ccb4969b0819`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:21.045448 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-610a449b-e9c6-4a08-9436-7b37f35b4cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:21.087565 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 855/1706] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:20 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:21.101559 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095340d2-b706-410f-9dab-1887fc2b1876 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:21.103060 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-095340d2-b706-410f-9dab-1887fc2b1876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:21.152538 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 852/1707] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:21.157000 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a449b-e9c6-4a08-9436-7b37f35b4cd0 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:21.211696 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095340d2-b706-410f-9dab-1887fc2b1876 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:21.217946 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28901efd-9f82-4c7a-9ff2-15d3c0c2e2a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:21.219289 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28901efd-9f82-4c7a-9ff2-15d3c0c2e2a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:21.219643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28901efd-9f82-4c7a-9ff2-15d3c0c2e2a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:21.219993 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28901efd-9f82-4c7a-9ff2-15d3c0c2e2a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:21.245175 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:21.295073 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a449b-e9c6-4a08-9436-7b37f35b4cd0 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:21.309693 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fcba2-f18d-40c7-87cb-e1f0c423351e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:21.311030 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fcba2-f18d-40c7-87cb-e1f0c423351e admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:21.311321 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fcba2-f18d-40c7-87cb-e1f0c423351e admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:21.311904 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fcba2-f18d-40c7-87cb-e1f0c423351e admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:21.312501 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098fcba2-f18d-40c7-87cb-e1f0c423351e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:21.315059 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098fcba2-f18d-40c7-87cb-e1f0c423351e admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:21.356418 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28901efd-9f82-4c7a-9ff2-15d3c0c2e2a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:21.358097 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28901efd-9f82-4c7a-9ff2-15d3c0c2e2a6 service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:21.369325 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 856/1708] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 20:31:21.386143 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 853/1709] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:31:21 2022] POST /identity/v3/projects => generated 379 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:31:21.390291 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28901efd-9f82-4c7a-9ff2-15d3c0c2e2a6 service cinder] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:21.402684 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28901efd-9f82-4c7a-9ff2-15d3c0c2e2a6 service cinder] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:21.505725 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a81ad-a30e-480b-aa6f-74e505277160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:21.506716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a81ad-a30e-480b-aa6f-74e505277160 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:21.507204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a81ad-a30e-480b-aa6f-74e505277160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:21.507627 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a81ad-a30e-480b-aa6f-74e505277160 admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:21.509203 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a81ad-a30e-480b-aa6f-74e505277160 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:21.511759 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a81ad-a30e-480b-aa6f-74e505277160 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:21.550901 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 857/1710] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:31:21 2022] POST /identity/v3/users => generated 296 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:21.553343 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fcba2-f18d-40c7-87cb-e1f0c423351e admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:21.566681 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fcba2-f18d-40c7-87cb-e1f0c423351e admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:21.572467 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61663878-4a40-4a95-8f8e-6f0e0057acf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:21.573134 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61663878-4a40-4a95-8f8e-6f0e0057acf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:21.573501 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61663878-4a40-4a95-8f8e-6f0e0057acf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:21.573779 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61663878-4a40-4a95-8f8e-6f0e0057acf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:21.574583 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61663878-4a40-4a95-8f8e-6f0e0057acf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:21.576338 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61663878-4a40-4a95-8f8e-6f0e0057acf6 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:21.587784 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 854/1711] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:21.592153 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a81ad-a30e-480b-aa6f-74e505277160 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:21.602842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a81ad-a30e-480b-aa6f-74e505277160 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:21.607800 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567d78c-0e4b-4e5c-b1a1-1e05b661add3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:21.608498 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567d78c-0e4b-4e5c-b1a1-1e05b661add3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:21.608811 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567d78c-0e4b-4e5c-b1a1-1e05b661add3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:21.609117 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567d78c-0e4b-4e5c-b1a1-1e05b661add3 admin admin] PATH_INFO: `/v3/projects/a41b98c783454c759677e62dafded396/users/487174298f864bf6974f0389e4953d06/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:21.625512 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567d78c-0e4b-4e5c-b1a1-1e05b661add3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a41b98c783454c759677e62dafded396, user_id=487174298f864bf6974f0389e4953d06, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:21.628769 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567d78c-0e4b-4e5c-b1a1-1e05b661add3 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:21.641869 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 858/1712] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:31:21 2022] PUT /identity/v3/projects/a41b98c783454c759677e62dafded396/users/487174298f864bf6974f0389e4953d06/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:31:21.646062 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61663878-4a40-4a95-8f8e-6f0e0057acf6 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:21.656503 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61663878-4a40-4a95-8f8e-6f0e0057acf6 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:21.700033 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:21.725429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c405d8-e829-4a50-8cae-7ac458415354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:21.726057 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c405d8-e829-4a50-8cae-7ac458415354 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:21.726340 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c405d8-e829-4a50-8cae-7ac458415354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:21.726727 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c405d8-e829-4a50-8cae-7ac458415354 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:21.727378 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c405d8-e829-4a50-8cae-7ac458415354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:21.729040 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c405d8-e829-4a50-8cae-7ac458415354 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:21.753758 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 855/1713] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:21.759220 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567d78c-0e4b-4e5c-b1a1-1e05b661add3 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:21.774532 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567d78c-0e4b-4e5c-b1a1-1e05b661add3 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:21.783023 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5dd70f-3db6-4b76-9cc7-7fd501077edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:21.783666 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5dd70f-3db6-4b76-9cc7-7fd501077edd admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:21.784021 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5dd70f-3db6-4b76-9cc7-7fd501077edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:21.784577 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5dd70f-3db6-4b76-9cc7-7fd501077edd admin admin] PATH_INFO: `/v3/projects/a41b98c783454c759677e62dafded396/users/487174298f864bf6974f0389e4953d06/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:21.812030 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5dd70f-3db6-4b76-9cc7-7fd501077edd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a41b98c783454c759677e62dafded396, user_id=487174298f864bf6974f0389e4953d06, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:21.817099 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5dd70f-3db6-4b76-9cc7-7fd501077edd admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:21.836684 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 859/1714] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:31:21 2022] PUT /identity/v3/projects/a41b98c783454c759677e62dafded396/users/487174298f864bf6974f0389e4953d06/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:31:21.843537 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40100ed8-601c-4ae0-aba5-28221ab0a1c4 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:21.846078 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40100ed8-601c-4ae0-aba5-28221ab0a1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:21.846455 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40100ed8-601c-4ae0-aba5-28221ab0a1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:21.883916 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-40100ed8-601c-4ae0-aba5-28221ab0a1c4 None None] MFA Rules not processed for user `487174298f864bf6974f0389e4953d06`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:21.885161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-40100ed8-601c-4ae0-aba5-28221ab0a1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:21.951577 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 856/1715] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:21 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:21.963364 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5dd70f-3db6-4b76-9cc7-7fd501077edd admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:22.021416 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5dd70f-3db6-4b76-9cc7-7fd501077edd admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:22.025445 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3bd0a-1c4e-4dc1-8924-c282b1641d88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:22.026063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3bd0a-1c4e-4dc1-8924-c282b1641d88 service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:22.026347 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3bd0a-1c4e-4dc1-8924-c282b1641d88 service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:22.026626 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3bd0a-1c4e-4dc1-8924-c282b1641d88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:22.036088 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3bd0a-1c4e-4dc1-8924-c282b1641d88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:22.037584 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3bd0a-1c4e-4dc1-8924-c282b1641d88 service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:22.047863 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 860/1716] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:21 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:22.092329 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40100ed8-601c-4ae0-aba5-28221ab0a1c4 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:22.094389 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-40100ed8-601c-4ae0-aba5-28221ab0a1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:22.107188 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40100ed8-601c-4ae0-aba5-28221ab0a1c4 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:22.112123 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a9b3d-8eea-4792-a7d5-3ddd3d9c8b45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:22.113001 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a9b3d-8eea-4792-a7d5-3ddd3d9c8b45 service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:22.113386 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a9b3d-8eea-4792-a7d5-3ddd3d9c8b45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:22.113806 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a9b3d-8eea-4792-a7d5-3ddd3d9c8b45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:22.177415 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a9b3d-8eea-4792-a7d5-3ddd3d9c8b45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:22.178915 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a9b3d-8eea-4792-a7d5-3ddd3d9c8b45 service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:22.189404 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 857/1717] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:25.178768 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3bd0a-1c4e-4dc1-8924-c282b1641d88 service cinder] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:25.214891 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:25.319375 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3bd0a-1c4e-4dc1-8924-c282b1641d88 service cinder] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:25.324308 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66b69d-083f-4e90-8c21-9a152cdf1d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:25.325079 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66b69d-083f-4e90-8c21-9a152cdf1d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:25.325424 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66b69d-083f-4e90-8c21-9a152cdf1d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:25.325768 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66b69d-083f-4e90-8c21-9a152cdf1d8f admin admin] PATH_INFO: `/v3/users/24e64869ab0c4ee483628ae0a9385834` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:25.327154 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66b69d-083f-4e90-8c21-9a152cdf1d8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=24e64869ab0c4ee483628ae0a9385834)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:25.329492 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66b69d-083f-4e90-8c21-9a152cdf1d8f admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:25.407894 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8d66b69d-083f-4e90-8c21-9a152cdf1d8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24e64869ab0c4ee483628ae0a9385834'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:25.414207 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8d66b69d-083f-4e90-8c21-9a152cdf1d8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24e64869ab0c4ee483628ae0a9385834'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:25.423822 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8d66b69d-083f-4e90-8c21-9a152cdf1d8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24e64869ab0c4ee483628ae0a9385834'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:25.424854 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8d66b69d-083f-4e90-8c21-9a152cdf1d8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24e64869ab0c4ee483628ae0a9385834'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:25.448534 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8d66b69d-083f-4e90-8c21-9a152cdf1d8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24e64869ab0c4ee483628ae0a9385834'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:25.469940 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 861/1718] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:31:25 2022] DELETE /identity/v3/users/24e64869ab0c4ee483628ae0a9385834 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:25.471843 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bafff-ba37-4d83-80fa-cb670b552ac2 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:25.472280 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bafff-ba37-4d83-80fa-cb670b552ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:25.472447 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bafff-ba37-4d83-80fa-cb670b552ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:25.507841 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-e63bafff-ba37-4d83-80fa-cb670b552ac2 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:25.512817 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-e63bafff-ba37-4d83-80fa-cb670b552ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:25.623365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:25.641200 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 858/1719] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:25.652566 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66b69d-083f-4e90-8c21-9a152cdf1d8f admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:25.654110 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-8d66b69d-083f-4e90-8c21-9a152cdf1d8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:25.744688 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66b69d-083f-4e90-8c21-9a152cdf1d8f admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:25.750738 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc4777-f5db-49c5-a417-d4c061ad3ccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:25.751482 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc4777-f5db-49c5-a417-d4c061ad3ccf service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:25.751816 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc4777-f5db-49c5-a417-d4c061ad3ccf service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:25.752100 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc4777-f5db-49c5-a417-d4c061ad3ccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:25.765710 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc4777-f5db-49c5-a417-d4c061ad3ccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:25.767815 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc4777-f5db-49c5-a417-d4c061ad3ccf service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:25.784650 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 862/1720] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:25.970209 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bafff-ba37-4d83-80fa-cb670b552ac2 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:25.972349 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-e63bafff-ba37-4d83-80fa-cb670b552ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:26.078829 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bafff-ba37-4d83-80fa-cb670b552ac2 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:26.082652 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb397c-dc00-4a66-8c43-2f674bf15dac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:26.083359 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb397c-dc00-4a66-8c43-2f674bf15dac service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:26.083729 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb397c-dc00-4a66-8c43-2f674bf15dac service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:26.084086 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb397c-dc00-4a66-8c43-2f674bf15dac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:26.090081 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-c3fb397c-dc00-4a66-8c43-2f674bf15dac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:26.174043 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb397c-dc00-4a66-8c43-2f674bf15dac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:26.176248 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb397c-dc00-4a66-8c43-2f674bf15dac service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:26.187383 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 859/1721] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:25 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:26.527771 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc4777-f5db-49c5-a417-d4c061ad3ccf service neutron] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:26.530066 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-88fc4777-f5db-49c5-a417-d4c061ad3ccf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:26.565413 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc4777-f5db-49c5-a417-d4c061ad3ccf service neutron] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:26.580736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b672b-4408-417c-bd39-dc484d7ef826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:26.581391 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b672b-4408-417c-bd39-dc484d7ef826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:26.581674 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b672b-4408-417c-bd39-dc484d7ef826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:26.581951 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b672b-4408-417c-bd39-dc484d7ef826 admin admin] PATH_INFO: `/v3/projects/8f7817a61b754761b21d3b98ddcf41c5` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:26.583188 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b672b-4408-417c-bd39-dc484d7ef826 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f7817a61b754761b21d3b98ddcf41c5)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:26.586259 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b672b-4408-417c-bd39-dc484d7ef826 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:26.631433 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:26.647832 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-299b672b-4408-417c-bd39-dc484d7ef826 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f7817a61b754761b21d3b98ddcf41c5', 'request_id': 'req-299b672b-4408-417c-bd39-dc484d7ef826'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:26.655035 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-299b672b-4408-417c-bd39-dc484d7ef826 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f7817a61b754761b21d3b98ddcf41c5', 'request_id': 'req-299b672b-4408-417c-bd39-dc484d7ef826'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:26.665100 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-299b672b-4408-417c-bd39-dc484d7ef826 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f7817a61b754761b21d3b98ddcf41c5', 'request_id': 'req-299b672b-4408-417c-bd39-dc484d7ef826'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:26.684184 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-299b672b-4408-417c-bd39-dc484d7ef826 admin admin] The token cache is being invalidate because project 8f7817a61b754761b21d3b98ddcf41c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:31:26.684610 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-299b672b-4408-417c-bd39-dc484d7ef826 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:26.685402 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-299b672b-4408-417c-bd39-dc484d7ef826 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:26.687923 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 863/1722] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:31:26 2022] DELETE /identity/v3/projects/8f7817a61b754761b21d3b98ddcf41c5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:26.693051 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb397c-dc00-4a66-8c43-2f674bf15dac service cinder] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:26.714817 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb397c-dc00-4a66-8c43-2f674bf15dac service cinder] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:26.795458 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f825f-33d3-4b29-9c99-bd1f308cba55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:26.796302 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f825f-33d3-4b29-9c99-bd1f308cba55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:26.796614 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f825f-33d3-4b29-9c99-bd1f308cba55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:26.796958 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f825f-33d3-4b29-9c99-bd1f308cba55 admin admin] PATH_INFO: `/v3/users/3b299dc12d9740bca6d2ccb4969b0819` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:26.799051 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f825f-33d3-4b29-9c99-bd1f308cba55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b299dc12d9740bca6d2ccb4969b0819)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:26.801551 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f825f-33d3-4b29-9c99-bd1f308cba55 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:26.855142 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b672b-4408-417c-bd39-dc484d7ef826 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:26.857001 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-299b672b-4408-417c-bd39-dc484d7ef826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:26.872644 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4d6f825f-33d3-4b29-9c99-bd1f308cba55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b299dc12d9740bca6d2ccb4969b0819'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:26.873417 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4d6f825f-33d3-4b29-9c99-bd1f308cba55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b299dc12d9740bca6d2ccb4969b0819'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:26.877372 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b672b-4408-417c-bd39-dc484d7ef826 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:26.879078 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:26.885660 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbecff-37af-4051-8ed1-707004a4d2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:26.886995 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbecff-37af-4051-8ed1-707004a4d2f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:26.888908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbecff-37af-4051-8ed1-707004a4d2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:26.890694 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbecff-37af-4051-8ed1-707004a4d2f3 admin admin] PATH_INFO: `/v3/users/6f62e35e06e64f7e82df77fca01b923d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:26.892581 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dbecff-37af-4051-8ed1-707004a4d2f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f62e35e06e64f7e82df77fca01b923d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:26.897792 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4d6f825f-33d3-4b29-9c99-bd1f308cba55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b299dc12d9740bca6d2ccb4969b0819'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:26.898133 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dbecff-37af-4051-8ed1-707004a4d2f3 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:26.898711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4d6f825f-33d3-4b29-9c99-bd1f308cba55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b299dc12d9740bca6d2ccb4969b0819'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:26.908965 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4d6f825f-33d3-4b29-9c99-bd1f308cba55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b299dc12d9740bca6d2ccb4969b0819'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:26.925304 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 860/1723] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:31:26 2022] DELETE /identity/v3/users/3b299dc12d9740bca6d2ccb4969b0819 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:31:26.967751 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-a3dbecff-37af-4051-8ed1-707004a4d2f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f62e35e06e64f7e82df77fca01b923d'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:26.968522 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-a3dbecff-37af-4051-8ed1-707004a4d2f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f62e35e06e64f7e82df77fca01b923d'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:26.978478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-a3dbecff-37af-4051-8ed1-707004a4d2f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f62e35e06e64f7e82df77fca01b923d'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:26.979256 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-a3dbecff-37af-4051-8ed1-707004a4d2f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f62e35e06e64f7e82df77fca01b923d'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:27.006013 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-a3dbecff-37af-4051-8ed1-707004a4d2f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f62e35e06e64f7e82df77fca01b923d'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:27.026236 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 864/1724] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:31:26 2022] DELETE /identity/v3/users/6f62e35e06e64f7e82df77fca01b923d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:27.031086 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53143c53-83c6-444c-bfe6-fb1d5bcb00ee None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:27.031608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53143c53-83c6-444c-bfe6-fb1d5bcb00ee None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:27.032521 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53143c53-83c6-444c-bfe6-fb1d5bcb00ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:27.059563 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-53143c53-83c6-444c-bfe6-fb1d5bcb00ee None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:27.063931 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-53143c53-83c6-444c-bfe6-fb1d5bcb00ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:27.197690 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 861/1725] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:27.210971 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbecff-37af-4051-8ed1-707004a4d2f3 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:27.213270 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-a3dbecff-37af-4051-8ed1-707004a4d2f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:27.299746 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53143c53-83c6-444c-bfe6-fb1d5bcb00ee None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:27.301339 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-53143c53-83c6-444c-bfe6-fb1d5bcb00ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:27.311132 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbecff-37af-4051-8ed1-707004a4d2f3 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:27.318277 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53143c53-83c6-444c-bfe6-fb1d5bcb00ee None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:27.319542 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0eec79-3db4-4581-aa64-a2cc68bbb125 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:27.320193 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0eec79-3db4-4581-aa64-a2cc68bbb125 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:27.320536 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0eec79-3db4-4581-aa64-a2cc68bbb125 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:27.320842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0eec79-3db4-4581-aa64-a2cc68bbb125 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:27.338620 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0eec79-3db4-4581-aa64-a2cc68bbb125 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:27.340098 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0eec79-3db4-4581-aa64-a2cc68bbb125 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:27.341611 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63c812-878e-4ca0-9fdf-b6c86aa138cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:27.342278 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63c812-878e-4ca0-9fdf-b6c86aa138cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:27.342537 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63c812-878e-4ca0-9fdf-b6c86aa138cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:27.342817 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63c812-878e-4ca0-9fdf-b6c86aa138cb admin admin] PATH_INFO: `/v3/projects/0ef24cca40c54aec9f98098f5093a84e` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:27.344091 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63c812-878e-4ca0-9fdf-b6c86aa138cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ef24cca40c54aec9f98098f5093a84e)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:27.347380 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63c812-878e-4ca0-9fdf-b6c86aa138cb admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:27.358668 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 865/1726] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:27.413756 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-aa63c812-878e-4ca0-9fdf-b6c86aa138cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ef24cca40c54aec9f98098f5093a84e', 'request_id': 'req-aa63c812-878e-4ca0-9fdf-b6c86aa138cb'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:27.422970 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-aa63c812-878e-4ca0-9fdf-b6c86aa138cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ef24cca40c54aec9f98098f5093a84e', 'request_id': 'req-aa63c812-878e-4ca0-9fdf-b6c86aa138cb'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:27.432765 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-aa63c812-878e-4ca0-9fdf-b6c86aa138cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ef24cca40c54aec9f98098f5093a84e', 'request_id': 'req-aa63c812-878e-4ca0-9fdf-b6c86aa138cb'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:27.447837 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-aa63c812-878e-4ca0-9fdf-b6c86aa138cb admin admin] The token cache is being invalidate because project 0ef24cca40c54aec9f98098f5093a84e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:31:27.448138 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-aa63c812-878e-4ca0-9fdf-b6c86aa138cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:27.448896 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-aa63c812-878e-4ca0-9fdf-b6c86aa138cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:27.456880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0eec79-3db4-4581-aa64-a2cc68bbb125 service neutron] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:27.464657 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 862/1727] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:31:27 2022] DELETE /identity/v3/projects/0ef24cca40c54aec9f98098f5093a84e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:27.467026 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0eec79-3db4-4581-aa64-a2cc68bbb125 service neutron] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:27.501716 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de92d7-83bd-48fd-af6e-109c56d799e7 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:27.502103 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de92d7-83bd-48fd-af6e-109c56d799e7 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:27.502458 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de92d7-83bd-48fd-af6e-109c56d799e7 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:27.504208 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 863/1728] 10.222.0.23 () {54 vars in 921 bytes} [Wed Nov 2 20:31:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:31:27.533299 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ac3a8-d9e0-405d-b40d-61e4c2d71339 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:27.537363 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ac3a8-d9e0-405d-b40d-61e4c2d71339 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:27.540960 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ac3a8-d9e0-405d-b40d-61e4c2d71339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:27.555689 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:27.584082 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-339ac3a8-d9e0-405d-b40d-61e4c2d71339 None None] MFA Rules not processed for user `603a9f31ae814003a2cbd02f964f4ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:27.586595 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-339ac3a8-d9e0-405d-b40d-61e4c2d71339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:27.616465 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21238c8c-cd6b-48a1-8e37-7b4d81401b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:27.618003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21238c8c-cd6b-48a1-8e37-7b4d81401b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:27.618592 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21238c8c-cd6b-48a1-8e37-7b4d81401b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:27.619131 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21238c8c-cd6b-48a1-8e37-7b4d81401b87 admin admin] PATH_INFO: `/v3/users/487174298f864bf6974f0389e4953d06` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:27.620638 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21238c8c-cd6b-48a1-8e37-7b4d81401b87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=487174298f864bf6974f0389e4953d06)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:27.640334 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21238c8c-cd6b-48a1-8e37-7b4d81401b87 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:27.689537 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:27.713632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 864/1729] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Nov 2 20:31:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:27.730611 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ac3a8-d9e0-405d-b40d-61e4c2d71339 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:27.732060 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-339ac3a8-d9e0-405d-b40d-61e4c2d71339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:27.755099 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ac3a8-d9e0-405d-b40d-61e4c2d71339 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:27.770355 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e9ded-3e98-4069-9f3f-2cc79a96832c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603a9f31ae814003a2cbd02f964f4ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:27.770999 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e9ded-3e98-4069-9f3f-2cc79a96832c service placement] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:27.771291 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e9ded-3e98-4069-9f3f-2cc79a96832c service placement] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:27.771571 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e9ded-3e98-4069-9f3f-2cc79a96832c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:27.785549 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-21238c8c-cd6b-48a1-8e37-7b4d81401b87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '487174298f864bf6974f0389e4953d06'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:27.788957 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-21238c8c-cd6b-48a1-8e37-7b4d81401b87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '487174298f864bf6974f0389e4953d06'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:27.803109 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e9ded-3e98-4069-9f3f-2cc79a96832c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:27.804765 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e9ded-3e98-4069-9f3f-2cc79a96832c service placement] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:27.806075 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-21238c8c-cd6b-48a1-8e37-7b4d81401b87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '487174298f864bf6974f0389e4953d06'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:27.806835 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-21238c8c-cd6b-48a1-8e37-7b4d81401b87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '487174298f864bf6974f0389e4953d06'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:27.828691 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 865/1730] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:27.830241 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e9ded-3e98-4069-9f3f-2cc79a96832c service placement] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:27.831984 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-7a0e9ded-3e98-4069-9f3f-2cc79a96832c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:27.838650 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-21238c8c-cd6b-48a1-8e37-7b4d81401b87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '487174298f864bf6974f0389e4953d06'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:27.866237 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e9ded-3e98-4069-9f3f-2cc79a96832c service placement] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:27.872975 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 866/1731] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:31:27 2022] DELETE /identity/v3/users/487174298f864bf6974f0389e4953d06 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:31:27.894062 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5ac16-af11-4ace-a941-c1abc56c666f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:27.894668 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5ac16-af11-4ace-a941-c1abc56c666f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:27.894940 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5ac16-af11-4ace-a941-c1abc56c666f admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:27.895221 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5ac16-af11-4ace-a941-c1abc56c666f admin admin] PATH_INFO: `/v3/users/f3d134d3ee554ddbbbf22644945b93cd` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:27.897708 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5ac16-af11-4ace-a941-c1abc56c666f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3d134d3ee554ddbbbf22644945b93cd)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:27.900874 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5ac16-af11-4ace-a941-c1abc56c666f admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:28.007500 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21238c8c-cd6b-48a1-8e37-7b4d81401b87 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:28.012855 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-21238c8c-cd6b-48a1-8e37-7b4d81401b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:28.063965 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-5eb5ac16-af11-4ace-a941-c1abc56c666f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3d134d3ee554ddbbbf22644945b93cd'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:28.065565 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-5eb5ac16-af11-4ace-a941-c1abc56c666f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3d134d3ee554ddbbbf22644945b93cd'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:28.122352 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-5eb5ac16-af11-4ace-a941-c1abc56c666f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3d134d3ee554ddbbbf22644945b93cd'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:28.124158 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-5eb5ac16-af11-4ace-a941-c1abc56c666f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3d134d3ee554ddbbbf22644945b93cd'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:28.166277 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-5eb5ac16-af11-4ace-a941-c1abc56c666f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3d134d3ee554ddbbbf22644945b93cd'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:28.196473 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 866/1732] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:31:27 2022] DELETE /identity/v3/users/f3d134d3ee554ddbbbf22644945b93cd => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:28.207946 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21238c8c-cd6b-48a1-8e37-7b4d81401b87 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:28.302824 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072ddef-e028-4d03-a70c-fe20776ee42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:28.303979 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072ddef-e028-4d03-a70c-fe20776ee42a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:28.304581 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072ddef-e028-4d03-a70c-fe20776ee42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:28.305158 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072ddef-e028-4d03-a70c-fe20776ee42a admin admin] PATH_INFO: `/v3/projects/1897bf8393cc478094b4c75594155407` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:28.309840 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5072ddef-e028-4d03-a70c-fe20776ee42a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1897bf8393cc478094b4c75594155407)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:28.312141 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5072ddef-e028-4d03-a70c-fe20776ee42a admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:28.314720 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:28.383541 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-5072ddef-e028-4d03-a70c-fe20776ee42a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1897bf8393cc478094b4c75594155407', 'request_id': 'req-5072ddef-e028-4d03-a70c-fe20776ee42a'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:28.391391 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-5072ddef-e028-4d03-a70c-fe20776ee42a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1897bf8393cc478094b4c75594155407', 'request_id': 'req-5072ddef-e028-4d03-a70c-fe20776ee42a'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:28.401137 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-5072ddef-e028-4d03-a70c-fe20776ee42a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1897bf8393cc478094b4c75594155407', 'request_id': 'req-5072ddef-e028-4d03-a70c-fe20776ee42a'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:28.403087 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5ac16-af11-4ace-a941-c1abc56c666f admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:28.405305 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-5eb5ac16-af11-4ace-a941-c1abc56c666f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:28.425388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-5072ddef-e028-4d03-a70c-fe20776ee42a admin admin] The token cache is being invalidate because project 1897bf8393cc478094b4c75594155407 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:31:28.426999 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-5072ddef-e028-4d03-a70c-fe20776ee42a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:28.427423 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-5072ddef-e028-4d03-a70c-fe20776ee42a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:28.430498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5ac16-af11-4ace-a941-c1abc56c666f admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:28.434333 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 867/1733] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:31:27 2022] DELETE /identity/v3/projects/1897bf8393cc478094b4c75594155407 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:28.435531 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072ddef-e028-4d03-a70c-fe20776ee42a admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:28.437133 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-5072ddef-e028-4d03-a70c-fe20776ee42a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:28.501823 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29ecee-e6f0-4e6a-b5c0-1a3d1a739e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:28.502461 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29ecee-e6f0-4e6a-b5c0-1a3d1a739e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:28.502799 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29ecee-e6f0-4e6a-b5c0-1a3d1a739e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:28.503012 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29ecee-e6f0-4e6a-b5c0-1a3d1a739e59 admin admin] PATH_INFO: `/v3/projects/1478682ac7d14626af7191f30ae1f08b` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:28.504151 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a29ecee-e6f0-4e6a-b5c0-1a3d1a739e59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1478682ac7d14626af7191f30ae1f08b)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:28.506115 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a29ecee-e6f0-4e6a-b5c0-1a3d1a739e59 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:28.516204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072ddef-e028-4d03-a70c-fe20776ee42a admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:28.522326 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc133098-2f33-4022-8493-01c074238018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:28.522974 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc133098-2f33-4022-8493-01c074238018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:28.523259 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc133098-2f33-4022-8493-01c074238018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:28.523540 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc133098-2f33-4022-8493-01c074238018 admin admin] PATH_INFO: `/v3/projects/a41b98c783454c759677e62dafded396` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:28.524701 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc133098-2f33-4022-8493-01c074238018 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a41b98c783454c759677e62dafded396)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:28.526645 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc133098-2f33-4022-8493-01c074238018 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:28.554628 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-1a29ecee-e6f0-4e6a-b5c0-1a3d1a739e59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1478682ac7d14626af7191f30ae1f08b', 'request_id': 'req-1a29ecee-e6f0-4e6a-b5c0-1a3d1a739e59'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:28.556589 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:28.562718 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-1a29ecee-e6f0-4e6a-b5c0-1a3d1a739e59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1478682ac7d14626af7191f30ae1f08b', 'request_id': 'req-1a29ecee-e6f0-4e6a-b5c0-1a3d1a739e59'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:28.570481 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-1a29ecee-e6f0-4e6a-b5c0-1a3d1a739e59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1478682ac7d14626af7191f30ae1f08b', 'request_id': 'req-1a29ecee-e6f0-4e6a-b5c0-1a3d1a739e59'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:28.577856 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-cc133098-2f33-4022-8493-01c074238018 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a41b98c783454c759677e62dafded396', 'request_id': 'req-cc133098-2f33-4022-8493-01c074238018'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:28.583890 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-1a29ecee-e6f0-4e6a-b5c0-1a3d1a739e59 admin admin] The token cache is being invalidate because project 1478682ac7d14626af7191f30ae1f08b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:31:28.584179 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-1a29ecee-e6f0-4e6a-b5c0-1a3d1a739e59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:28.584831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-1a29ecee-e6f0-4e6a-b5c0-1a3d1a739e59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:28.586285 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-cc133098-2f33-4022-8493-01c074238018 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a41b98c783454c759677e62dafded396', 'request_id': 'req-cc133098-2f33-4022-8493-01c074238018'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:28.586398 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 867/1734] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:31:28 2022] DELETE /identity/v3/projects/1478682ac7d14626af7191f30ae1f08b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:31:28.587593 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0053ce-7127-4eae-b129-a9d0d7ab1626 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:28.587880 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0053ce-7127-4eae-b129-a9d0d7ab1626 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:28.588172 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0053ce-7127-4eae-b129-a9d0d7ab1626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:28.596246 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-cc133098-2f33-4022-8493-01c074238018 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a41b98c783454c759677e62dafded396', 'request_id': 'req-cc133098-2f33-4022-8493-01c074238018'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:28.607026 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-cc133098-2f33-4022-8493-01c074238018 admin admin] The token cache is being invalidate because project a41b98c783454c759677e62dafded396 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:31:28.607320 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-cc133098-2f33-4022-8493-01c074238018 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:28.608062 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-cc133098-2f33-4022-8493-01c074238018 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:28.608358 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-aa0053ce-7127-4eae-b129-a9d0d7ab1626 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:28.609753 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-aa0053ce-7127-4eae-b129-a9d0d7ab1626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:28.615333 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 868/1735] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:31:28 2022] DELETE /identity/v3/projects/a41b98c783454c759677e62dafded396 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:28.615333 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b59696-e6d5-433b-a546-aea66c7a19e8 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:28.615333 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b59696-e6d5-433b-a546-aea66c7a19e8 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:28.615333 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b59696-e6d5-433b-a546-aea66c7a19e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:28.632832 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-74b59696-e6d5-433b-a546-aea66c7a19e8 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:28.634062 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-74b59696-e6d5-433b-a546-aea66c7a19e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:28.647749 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:28.669459 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 868/1736] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:28.670769 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244343d8-b0e9-43e7-984c-3d669e6cae9b None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:28.671062 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244343d8-b0e9-43e7-984c-3d669e6cae9b None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:28.671336 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244343d8-b0e9-43e7-984c-3d669e6cae9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:28.692969 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-244343d8-b0e9-43e7-984c-3d669e6cae9b None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:28.694180 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-244343d8-b0e9-43e7-984c-3d669e6cae9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:28.698622 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 869/1737] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:28.699846 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbc040-c62e-444b-9f4b-51fc187dfe63 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:28.700138 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbc040-c62e-444b-9f4b-51fc187dfe63 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:28.700413 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbc040-c62e-444b-9f4b-51fc187dfe63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:28.708404 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 869/1738] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:28.709742 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7af072-47bf-42f1-b1fe-0ddd8a6f874e None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:28.710027 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7af072-47bf-42f1-b1fe-0ddd8a6f874e None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:28.710300 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7af072-47bf-42f1-b1fe-0ddd8a6f874e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:28.720470 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-6fcbc040-c62e-444b-9f4b-51fc187dfe63 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:28.721686 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-6fcbc040-c62e-444b-9f4b-51fc187dfe63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:28.729980 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 870/1739] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:28.730354 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-4a7af072-47bf-42f1-b1fe-0ddd8a6f874e None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:28.731371 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07000c13-8577-4c5c-b1cf-94046de929cc None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:28.731521 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-4a7af072-47bf-42f1-b1fe-0ddd8a6f874e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:28.731845 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07000c13-8577-4c5c-b1cf-94046de929cc None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:28.732211 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07000c13-8577-4c5c-b1cf-94046de929cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:28.739539 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 870/1740] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:28.740318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7af072-47bf-42f1-b1fe-0ddd8a6f874e None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:28.749876 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7af072-47bf-42f1-b1fe-0ddd8a6f874e None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:28.753236 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-07000c13-8577-4c5c-b1cf-94046de929cc None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:28.754435 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-07000c13-8577-4c5c-b1cf-94046de929cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:28.754568 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e393d-329a-4315-99e2-ad4d7db52920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:28.755079 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e393d-329a-4315-99e2-ad4d7db52920 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:28.755358 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e393d-329a-4315-99e2-ad4d7db52920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:28.755631 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e393d-329a-4315-99e2-ad4d7db52920 admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:28.756267 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e393d-329a-4315-99e2-ad4d7db52920 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:31:28.756607 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e393d-329a-4315-99e2-ad4d7db52920 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:28.758259 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e393d-329a-4315-99e2-ad4d7db52920 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:28.762889 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 871/1741] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:28.763527 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07000c13-8577-4c5c-b1cf-94046de929cc None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:28.774790 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 871/1742] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:31:28.774790 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e393d-329a-4315-99e2-ad4d7db52920 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:28.775027 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07000c13-8577-4c5c-b1cf-94046de929cc None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:28.778923 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf07e1-5af5-4ba4-b9a7-886e00ebd61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:28.779528 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf07e1-5af5-4ba4-b9a7-886e00ebd61a admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:28.779814 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf07e1-5af5-4ba4-b9a7-886e00ebd61a admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:28.780095 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf07e1-5af5-4ba4-b9a7-886e00ebd61a admin admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:28.780796 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf07e1-5af5-4ba4-b9a7-886e00ebd61a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:31:28.781107 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf07e1-5af5-4ba4-b9a7-886e00ebd61a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:28.783265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf07e1-5af5-4ba4-b9a7-886e00ebd61a admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:28.785201 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e393d-329a-4315-99e2-ad4d7db52920 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:28.789738 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499a69d-52a2-47c8-bb9b-a8a1a61738f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:28.790315 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499a69d-52a2-47c8-bb9b-a8a1a61738f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:28.790597 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499a69d-52a2-47c8-bb9b-a8a1a61738f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:28.790873 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499a69d-52a2-47c8-bb9b-a8a1a61738f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:28.791500 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499a69d-52a2-47c8-bb9b-a8a1a61738f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:31:28.791802 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499a69d-52a2-47c8-bb9b-a8a1a61738f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:28.793391 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499a69d-52a2-47c8-bb9b-a8a1a61738f8 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:28.795578 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 872/1743] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:31:28.796233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf07e1-5af5-4ba4-b9a7-886e00ebd61a admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:28.806005 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf07e1-5af5-4ba4-b9a7-886e00ebd61a admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:28.808693 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 872/1744] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:31:28.809493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499a69d-52a2-47c8-bb9b-a8a1a61738f8 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:28.813879 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f94c47-0ff4-4bc4-a97d-73f91bd272d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:28.814482 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f94c47-0ff4-4bc4-a97d-73f91bd272d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:28.814768 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f94c47-0ff4-4bc4-a97d-73f91bd272d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:28.815049 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f94c47-0ff4-4bc4-a97d-73f91bd272d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:28.815687 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f94c47-0ff4-4bc4-a97d-73f91bd272d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:28.817636 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f94c47-0ff4-4bc4-a97d-73f91bd272d7 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:28.819036 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499a69d-52a2-47c8-bb9b-a8a1a61738f8 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:28.823640 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ce01f-7b44-484b-af87-c7a2b5fa6d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:28.824208 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ce01f-7b44-484b-af87-c7a2b5fa6d1d admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:28.824488 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ce01f-7b44-484b-af87-c7a2b5fa6d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:28.824794 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ce01f-7b44-484b-af87-c7a2b5fa6d1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:28.825409 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ce01f-7b44-484b-af87-c7a2b5fa6d1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:28.827296 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ce01f-7b44-484b-af87-c7a2b5fa6d1d admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:28.847304 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 873/1745] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:31:28 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:28.848524 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f94c47-0ff4-4bc4-a97d-73f91bd272d7 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:28.858525 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 873/1746] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:31:28 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:28.858525 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ce01f-7b44-484b-af87-c7a2b5fa6d1d admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:28.916235 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f94c47-0ff4-4bc4-a97d-73f91bd272d7 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:28.918734 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ce01f-7b44-484b-af87-c7a2b5fa6d1d admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:28.920826 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf5169-49c5-4117-9404-ff60d743dbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:28.921441 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf5169-49c5-4117-9404-ff60d743dbc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:28.921723 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf5169-49c5-4117-9404-ff60d743dbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:28.922000 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf5169-49c5-4117-9404-ff60d743dbc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:28.922667 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf5169-49c5-4117-9404-ff60d743dbc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:28.923857 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f2e19-39a8-4eac-9a55-68a572df41ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:28.924455 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f2e19-39a8-4eac-9a55-68a572df41ae admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:28.924580 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf5169-49c5-4117-9404-ff60d743dbc9 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:28.924776 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f2e19-39a8-4eac-9a55-68a572df41ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:28.925083 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f2e19-39a8-4eac-9a55-68a572df41ae admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:28.925711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f2e19-39a8-4eac-9a55-68a572df41ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:28.927619 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f2e19-39a8-4eac-9a55-68a572df41ae admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:28.949606 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 874/1747] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:31:28 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:28.950411 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f2e19-39a8-4eac-9a55-68a572df41ae admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:28.956869 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 874/1748] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:31:28 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:28.956869 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf5169-49c5-4117-9404-ff60d743dbc9 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:28.962846 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f2e19-39a8-4eac-9a55-68a572df41ae admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:28.966505 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:29.017250 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:29.021176 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf5169-49c5-4117-9404-ff60d743dbc9 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:29.027905 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbed78-cb05-4bf7-a43a-fa8b2b0237d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:29.028623 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbed78-cb05-4bf7-a43a-fa8b2b0237d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:29.028984 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbed78-cb05-4bf7-a43a-fa8b2b0237d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:29.029333 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbed78-cb05-4bf7-a43a-fa8b2b0237d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:29.029985 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fbed78-cb05-4bf7-a43a-fa8b2b0237d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:29.031578 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fbed78-cb05-4bf7-a43a-fa8b2b0237d2 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:29.036315 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67091f-859a-4055-a2f1-ee91748f563a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:29.037181 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67091f-859a-4055-a2f1-ee91748f563a admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:29.037614 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67091f-859a-4055-a2f1-ee91748f563a admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:29.037962 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67091f-859a-4055-a2f1-ee91748f563a admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:29.038999 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67091f-859a-4055-a2f1-ee91748f563a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:29.041200 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67091f-859a-4055-a2f1-ee91748f563a admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:29.044744 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 875/1749] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:29.044744 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbed78-cb05-4bf7-a43a-fa8b2b0237d2 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:29.059091 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbed78-cb05-4bf7-a43a-fa8b2b0237d2 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:29.065137 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580730b-6698-4504-b353-da342713a04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:29.065750 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580730b-6698-4504-b353-da342713a04f admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:29.066049 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580730b-6698-4504-b353-da342713a04f admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:29.066303 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580730b-6698-4504-b353-da342713a04f admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:29.067652 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580730b-6698-4504-b353-da342713a04f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:29.069236 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580730b-6698-4504-b353-da342713a04f admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:29.081962 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 875/1750] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:31:28 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:29.083266 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67091f-859a-4055-a2f1-ee91748f563a admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:29.096334 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67091f-859a-4055-a2f1-ee91748f563a admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:29.098197 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 876/1751] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:31:29 2022] POST /identity/v3/users => generated 287 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:29.099299 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580730b-6698-4504-b353-da342713a04f admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:29.105249 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d38a2f-a958-4a95-9084-956fee7741c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:29.105881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d38a2f-a958-4a95-9084-956fee7741c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:29.106169 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d38a2f-a958-4a95-9084-956fee7741c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:29.106451 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d38a2f-a958-4a95-9084-956fee7741c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:29.107106 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d38a2f-a958-4a95-9084-956fee7741c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:29.108832 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d38a2f-a958-4a95-9084-956fee7741c0 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:29.111171 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580730b-6698-4504-b353-da342713a04f admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:29.116939 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72355f8f-a56f-405d-b117-0c9424818712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:29.121267 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72355f8f-a56f-405d-b117-0c9424818712 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:29.121554 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72355f8f-a56f-405d-b117-0c9424818712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:29.121833 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72355f8f-a56f-405d-b117-0c9424818712 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:29.122497 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72355f8f-a56f-405d-b117-0c9424818712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:29.124101 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72355f8f-a56f-405d-b117-0c9424818712 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:29.124767 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 876/1752] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:29.126638 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d38a2f-a958-4a95-9084-956fee7741c0 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:29.140104 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d38a2f-a958-4a95-9084-956fee7741c0 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:29.144775 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 877/1753] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:29.145656 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72355f8f-a56f-405d-b117-0c9424818712 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:29.147662 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ac36d-27ef-4683-b49f-ec831da8c980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:29.148390 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ac36d-27ef-4683-b49f-ec831da8c980 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:29.148765 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ac36d-27ef-4683-b49f-ec831da8c980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:29.149109 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ac36d-27ef-4683-b49f-ec831da8c980 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:29.149823 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ac36d-27ef-4683-b49f-ec831da8c980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:29.156953 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72355f8f-a56f-405d-b117-0c9424818712 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:29.160032 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ac36d-27ef-4683-b49f-ec831da8c980 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:29.171953 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 877/1754] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:29.173171 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa52a2-f9cd-4304-8da3-21a1248e3ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:29.173711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ac36d-27ef-4683-b49f-ec831da8c980 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:29.175991 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa52a2-f9cd-4304-8da3-21a1248e3ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:29.176283 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa52a2-f9cd-4304-8da3-21a1248e3ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:29.176582 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa52a2-f9cd-4304-8da3-21a1248e3ba4 admin admin] PATH_INFO: `/v3/projects/c4dfbf233f81463fb01e2f86c6a2b7a1/users/1408e2baec6a46489e361683ddef0d39/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:29.187020 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ac36d-27ef-4683-b49f-ec831da8c980 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:29.194836 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902fba06-26a3-46dc-8718-4583e6819951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:29.195736 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fba06-26a3-46dc-8718-4583e6819951 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:29.196031 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fba06-26a3-46dc-8718-4583e6819951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:29.196315 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fba06-26a3-46dc-8718-4583e6819951 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:29.197569 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902fba06-26a3-46dc-8718-4583e6819951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:29.199192 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902fba06-26a3-46dc-8718-4583e6819951 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:29.200756 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa52a2-f9cd-4304-8da3-21a1248e3ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4dfbf233f81463fb01e2f86c6a2b7a1, user_id=1408e2baec6a46489e361683ddef0d39, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:29.204671 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa52a2-f9cd-4304-8da3-21a1248e3ba4 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:29.213392 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 878/1755] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:29.218509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902fba06-26a3-46dc-8718-4583e6819951 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:29.236841 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 878/1756] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:31:29 2022] PUT /identity/v3/projects/c4dfbf233f81463fb01e2f86c6a2b7a1/users/1408e2baec6a46489e361683ddef0d39/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:29.237014 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902fba06-26a3-46dc-8718-4583e6819951 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:29.237132 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa52a2-f9cd-4304-8da3-21a1248e3ba4 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:29.315730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f13c5-49e3-49db-8e84-fe24f4d1fc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:29.316365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f13c5-49e3-49db-8e84-fe24f4d1fc5c admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:29.316906 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f13c5-49e3-49db-8e84-fe24f4d1fc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:29.317211 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f13c5-49e3-49db-8e84-fe24f4d1fc5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:29.317861 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f13c5-49e3-49db-8e84-fe24f4d1fc5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:29.319543 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f13c5-49e3-49db-8e84-fe24f4d1fc5c admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:29.320084 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa52a2-f9cd-4304-8da3-21a1248e3ba4 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:29.333926 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23b3b0-ef52-43c6-b7e7-cb91a008096b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:29.334577 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23b3b0-ef52-43c6-b7e7-cb91a008096b admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:29.334764 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23b3b0-ef52-43c6-b7e7-cb91a008096b admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:29.335071 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23b3b0-ef52-43c6-b7e7-cb91a008096b admin admin] PATH_INFO: `/v3/projects/913a0bf1570e4f328034a0aa7ae59d74/users/13d6d307bd3b436f9f18be0e762038fd/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:29.336534 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 879/1757] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:29.339432 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02482b0-944f-49bd-845f-7b9211113613 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:29.339918 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02482b0-944f-49bd-845f-7b9211113613 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:29.339918 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02482b0-944f-49bd-845f-7b9211113613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:29.356225 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23b3b0-ef52-43c6-b7e7-cb91a008096b admin admin] RBAC: Authorizing `identity:create_grant(project_id=913a0bf1570e4f328034a0aa7ae59d74, user_id=13d6d307bd3b436f9f18be0e762038fd, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:29.359424 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23b3b0-ef52-43c6-b7e7-cb91a008096b admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:29.379656 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 879/1758] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:31:29 2022] PUT /identity/v3/projects/913a0bf1570e4f328034a0aa7ae59d74/users/13d6d307bd3b436f9f18be0e762038fd/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:29.380529 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23b3b0-ef52-43c6-b7e7-cb91a008096b admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:29.386329 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-b02482b0-944f-49bd-845f-7b9211113613 None None] MFA Rules not processed for user `1408e2baec6a46489e361683ddef0d39`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:29.387600 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-b02482b0-944f-49bd-845f-7b9211113613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:29.442881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:29.448417 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23b3b0-ef52-43c6-b7e7-cb91a008096b admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:29.454450 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac34ac-ecd6-42e8-8530-2480ff4f02c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:29.455110 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac34ac-ecd6-42e8-8530-2480ff4f02c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:29.455435 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac34ac-ecd6-42e8-8530-2480ff4f02c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:29.455754 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac34ac-ecd6-42e8-8530-2480ff4f02c2 admin admin] PATH_INFO: `/v3/projects/2e123e65c471426ab1e698f5c083997b/users/2c01be3c24de41e8bfd99ab04f96caf1/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:29.464096 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 880/1759] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:29.465490 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d5300-b1fd-4be7-8517-42ba753e0e8b None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:29.465851 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d5300-b1fd-4be7-8517-42ba753e0e8b None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:29.466090 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d5300-b1fd-4be7-8517-42ba753e0e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:29.472083 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac34ac-ecd6-42e8-8530-2480ff4f02c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e123e65c471426ab1e698f5c083997b, user_id=2c01be3c24de41e8bfd99ab04f96caf1, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:29.474937 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac34ac-ecd6-42e8-8530-2480ff4f02c2 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:29.488869 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-873d5300-b1fd-4be7-8517-42ba753e0e8b None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:29.489774 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 880/1760] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:31:29 2022] PUT /identity/v3/projects/2e123e65c471426ab1e698f5c083997b/users/2c01be3c24de41e8bfd99ab04f96caf1/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:29.490083 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-873d5300-b1fd-4be7-8517-42ba753e0e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:29.490501 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac34ac-ecd6-42e8-8530-2480ff4f02c2 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:29.492115 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-30ac34ac-ecd6-42e8-8530-2480ff4f02c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:29.512277 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:29.560896 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 881/1761] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:29.562180 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a57c6-1e15-41a2-bfff-4f310a9d24e0 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:29.562469 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a57c6-1e15-41a2-bfff-4f310a9d24e0 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:29.562745 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a57c6-1e15-41a2-bfff-4f310a9d24e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:29.571571 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac34ac-ecd6-42e8-8530-2480ff4f02c2 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:29.576006 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7c2bc-d19a-4e7b-9e86-975c16d1560a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:29.576769 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7c2bc-d19a-4e7b-9e86-975c16d1560a service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:29.577526 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7c2bc-d19a-4e7b-9e86-975c16d1560a service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:29.577812 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7c2bc-d19a-4e7b-9e86-975c16d1560a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:29.592780 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-001a57c6-1e15-41a2-bfff-4f310a9d24e0 None None] MFA Rules not processed for user `2c01be3c24de41e8bfd99ab04f96caf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:29.594035 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-001a57c6-1e15-41a2-bfff-4f310a9d24e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:29.642191 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7c2bc-d19a-4e7b-9e86-975c16d1560a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:29.643708 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7c2bc-d19a-4e7b-9e86-975c16d1560a service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:29.653903 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 881/1762] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:29.654802 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7c2bc-d19a-4e7b-9e86-975c16d1560a service cinder] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:29.656332 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-ffe7c2bc-d19a-4e7b-9e86-975c16d1560a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:29.668317 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 882/1763] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:29.673269 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a57c6-1e15-41a2-bfff-4f310a9d24e0 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:29.685248 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a57c6-1e15-41a2-bfff-4f310a9d24e0 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:29.690346 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd60c6f-2ba6-4c03-a31d-baee4c6dffdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:29.690985 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd60c6f-2ba6-4c03-a31d-baee4c6dffdb admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:29.691267 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd60c6f-2ba6-4c03-a31d-baee4c6dffdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:29.691544 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd60c6f-2ba6-4c03-a31d-baee4c6dffdb admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:29.692182 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd60c6f-2ba6-4c03-a31d-baee4c6dffdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:29.694307 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd60c6f-2ba6-4c03-a31d-baee4c6dffdb admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:29.720372 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7c2bc-d19a-4e7b-9e86-975c16d1560a service cinder] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:29.722893 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 883/1764] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:31:29 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:31:29.724313 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acf12e-2646-4891-a372-fdea71a86acd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:29.725018 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acf12e-2646-4891-a372-fdea71a86acd service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:29.725367 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acf12e-2646-4891-a372-fdea71a86acd service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:29.725516 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd60c6f-2ba6-4c03-a31d-baee4c6dffdb admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:29.725999 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acf12e-2646-4891-a372-fdea71a86acd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:29.735462 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67acf12e-2646-4891-a372-fdea71a86acd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:29.736922 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67acf12e-2646-4891-a372-fdea71a86acd service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:29.746347 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 882/1765] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:29.747116 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acf12e-2646-4891-a372-fdea71a86acd service neutron] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:29.757402 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acf12e-2646-4891-a372-fdea71a86acd service neutron] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:29.786913 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:29.791600 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd60c6f-2ba6-4c03-a31d-baee4c6dffdb admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:29.798936 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44f878-1465-4e37-b498-94a339e9576c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:29.799556 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44f878-1465-4e37-b498-94a339e9576c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:29.799914 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44f878-1465-4e37-b498-94a339e9576c admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:29.800274 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44f878-1465-4e37-b498-94a339e9576c admin admin] PATH_INFO: `/v3/users/1408e2baec6a46489e361683ddef0d39` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:29.801531 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44f878-1465-4e37-b498-94a339e9576c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1408e2baec6a46489e361683ddef0d39)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:29.803601 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44f878-1465-4e37-b498-94a339e9576c admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:29.823779 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3660f-edb6-43ef-ba38-3f6b21383050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:29.824427 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3660f-edb6-43ef-ba38-3f6b21383050 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:29.824765 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3660f-edb6-43ef-ba38-3f6b21383050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:29.825044 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3660f-edb6-43ef-ba38-3f6b21383050 admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:29.825678 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3660f-edb6-43ef-ba38-3f6b21383050 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:29.827716 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3660f-edb6-43ef-ba38-3f6b21383050 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:29.838690 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:29.855172 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 883/1766] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:31:29 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:29.856312 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3660f-edb6-43ef-ba38-3f6b21383050 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:29.862537 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-3a44f878-1465-4e37-b498-94a339e9576c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1408e2baec6a46489e361683ddef0d39'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:29.863450 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-3a44f878-1465-4e37-b498-94a339e9576c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1408e2baec6a46489e361683ddef0d39'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:29.867260 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3660f-edb6-43ef-ba38-3f6b21383050 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:29.873303 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbe621-b8e5-4451-8c69-3bba4ecc41d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:29.874606 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbe621-b8e5-4451-8c69-3bba4ecc41d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:29.875203 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbe621-b8e5-4451-8c69-3bba4ecc41d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:29.876575 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbe621-b8e5-4451-8c69-3bba4ecc41d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:29.877289 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dbe621-b8e5-4451-8c69-3bba4ecc41d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:29.878902 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dbe621-b8e5-4451-8c69-3bba4ecc41d3 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:29.880080 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-3a44f878-1465-4e37-b498-94a339e9576c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1408e2baec6a46489e361683ddef0d39'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:29.881614 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-3a44f878-1465-4e37-b498-94a339e9576c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1408e2baec6a46489e361683ddef0d39'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:29.889641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-3a44f878-1465-4e37-b498-94a339e9576c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1408e2baec6a46489e361683ddef0d39'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:29.892353 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 884/1767] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:31:29.895603 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbe621-b8e5-4451-8c69-3bba4ecc41d3 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:29.897728 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-82dbe621-b8e5-4451-8c69-3bba4ecc41d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:29.905504 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 884/1768] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:31:29 2022] DELETE /identity/v3/users/1408e2baec6a46489e361683ddef0d39 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:29.910202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50c88c-52b1-4031-a3d5-89bdcdd04f17 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:29.910485 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50c88c-52b1-4031-a3d5-89bdcdd04f17 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:29.910766 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50c88c-52b1-4031-a3d5-89bdcdd04f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:29.911729 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbe621-b8e5-4451-8c69-3bba4ecc41d3 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:29.931819 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-ec50c88c-52b1-4031-a3d5-89bdcdd04f17 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:29.934043 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-ec50c88c-52b1-4031-a3d5-89bdcdd04f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:29.981464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df9a8f-9893-4677-8e5a-901734891cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:29.982166 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df9a8f-9893-4677-8e5a-901734891cd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:29.982468 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df9a8f-9893-4677-8e5a-901734891cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:29.982802 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df9a8f-9893-4677-8e5a-901734891cd1 admin admin] PATH_INFO: `/v3/projects/b3791bac230c450d8b388397b4e1c8ab/users/24bd9b19d9134068bf6a2eb121d998d6/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:30.004365 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df9a8f-9893-4677-8e5a-901734891cd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3791bac230c450d8b388397b4e1c8ab, user_id=24bd9b19d9134068bf6a2eb121d998d6, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:30.007505 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df9a8f-9893-4677-8e5a-901734891cd1 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:30.008781 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 885/1769] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:31:30.020019 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50c88c-52b1-4031-a3d5-89bdcdd04f17 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:30.021838 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-ec50c88c-52b1-4031-a3d5-89bdcdd04f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:30.022524 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 885/1770] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:31:29 2022] PUT /identity/v3/projects/b3791bac230c450d8b388397b4e1c8ab/users/24bd9b19d9134068bf6a2eb121d998d6/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:30.026377 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df9a8f-9893-4677-8e5a-901734891cd1 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:30.088201 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50c88c-52b1-4031-a3d5-89bdcdd04f17 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:30.102867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df9a8f-9893-4677-8e5a-901734891cd1 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:30.112365 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1d01b-05ad-4c1a-be14-865e6217ca39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:30.113177 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1d01b-05ad-4c1a-be14-865e6217ca39 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:30.113613 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1d01b-05ad-4c1a-be14-865e6217ca39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:30.113907 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1d01b-05ad-4c1a-be14-865e6217ca39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:30.114575 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d1d01b-05ad-4c1a-be14-865e6217ca39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:30.116200 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d1d01b-05ad-4c1a-be14-865e6217ca39 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:30.129116 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 886/1771] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:30.133041 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1d01b-05ad-4c1a-be14-865e6217ca39 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:30.135552 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:30.150945 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1d01b-05ad-4c1a-be14-865e6217ca39 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:30.157691 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ee9c4-40c7-4bd7-abdd-2acb33d825a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:30.158519 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ee9c4-40c7-4bd7-abdd-2acb33d825a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:30.158865 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ee9c4-40c7-4bd7-abdd-2acb33d825a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:30.159148 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ee9c4-40c7-4bd7-abdd-2acb33d825a2 admin admin] PATH_INFO: `/v3/projects/b3791bac230c450d8b388397b4e1c8ab/users/24bd9b19d9134068bf6a2eb121d998d6/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:30.161596 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ee9c4-40c7-4bd7-abdd-2acb33d825a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3791bac230c450d8b388397b4e1c8ab, user_id=24bd9b19d9134068bf6a2eb121d998d6, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:30.163044 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f26fc0-fbba-4e33-9efe-f5810cdb2024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:30.163671 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f26fc0-fbba-4e33-9efe-f5810cdb2024 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:30.163956 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f26fc0-fbba-4e33-9efe-f5810cdb2024 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:30.164237 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f26fc0-fbba-4e33-9efe-f5810cdb2024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:30.164781 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ee9c4-40c7-4bd7-abdd-2acb33d825a2 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:30.175496 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f26fc0-fbba-4e33-9efe-f5810cdb2024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:30.177119 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 887/1772] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:31:30 2022] PUT /identity/v3/projects/b3791bac230c450d8b388397b4e1c8ab/users/24bd9b19d9134068bf6a2eb121d998d6/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:31:30.180601 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f26fc0-fbba-4e33-9efe-f5810cdb2024 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:30.198447 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d69b3-b981-4d00-a4b2-a67dcd15705a None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:30.199747 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 886/1773] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 20:31:30.199983 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d69b3-b981-4d00-a4b2-a67dcd15705a None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:30.200269 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d69b3-b981-4d00-a4b2-a67dcd15705a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:30.241378 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-8d3d69b3-b981-4d00-a4b2-a67dcd15705a None None] MFA Rules not processed for user `24bd9b19d9134068bf6a2eb121d998d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:30.242839 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-8d3d69b3-b981-4d00-a4b2-a67dcd15705a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:30.331774 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:30.378965 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 888/1774] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:30.390677 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f26fc0-fbba-4e33-9efe-f5810cdb2024 service neutron] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:30.392214 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-b6f26fc0-fbba-4e33-9efe-f5810cdb2024 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:30.497967 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f26fc0-fbba-4e33-9efe-f5810cdb2024 service neutron] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:30.563977 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53138b02-7dfa-4552-a6c6-23c8557f6b5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:30.564864 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53138b02-7dfa-4552-a6c6-23c8557f6b5a service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:30.565241 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53138b02-7dfa-4552-a6c6-23c8557f6b5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:30.566307 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53138b02-7dfa-4552-a6c6-23c8557f6b5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:30.568492 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-53138b02-7dfa-4552-a6c6-23c8557f6b5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:30.652303 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53138b02-7dfa-4552-a6c6-23c8557f6b5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:30.654391 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53138b02-7dfa-4552-a6c6-23c8557f6b5a service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:30.668270 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 887/1775] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:30.791983 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d69b3-b981-4d00-a4b2-a67dcd15705a None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:30.793461 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-8d3d69b3-b981-4d00-a4b2-a67dcd15705a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:30.901530 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d69b3-b981-4d00-a4b2-a67dcd15705a None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:30.907681 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e42c8-8b56-412e-80ed-051dba1818e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:30.908282 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e42c8-8b56-412e-80ed-051dba1818e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:30.908592 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e42c8-8b56-412e-80ed-051dba1818e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:30.908880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e42c8-8b56-412e-80ed-051dba1818e5 admin admin] PATH_INFO: `/v3/projects/c4dfbf233f81463fb01e2f86c6a2b7a1` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:30.910947 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e42c8-8b56-412e-80ed-051dba1818e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4dfbf233f81463fb01e2f86c6a2b7a1)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:30.914048 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e42c8-8b56-412e-80ed-051dba1818e5 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:30.986003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-135e42c8-8b56-412e-80ed-051dba1818e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4dfbf233f81463fb01e2f86c6a2b7a1', 'request_id': 'req-135e42c8-8b56-412e-80ed-051dba1818e5'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:30.992694 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-135e42c8-8b56-412e-80ed-051dba1818e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4dfbf233f81463fb01e2f86c6a2b7a1', 'request_id': 'req-135e42c8-8b56-412e-80ed-051dba1818e5'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:31.002685 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-135e42c8-8b56-412e-80ed-051dba1818e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4dfbf233f81463fb01e2f86c6a2b7a1', 'request_id': 'req-135e42c8-8b56-412e-80ed-051dba1818e5'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:31.029406 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-135e42c8-8b56-412e-80ed-051dba1818e5 admin admin] The token cache is being invalidate because project c4dfbf233f81463fb01e2f86c6a2b7a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:31:31.030347 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-135e42c8-8b56-412e-80ed-051dba1818e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:31.030689 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-135e42c8-8b56-412e-80ed-051dba1818e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:31.035874 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 889/1776] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:31:30 2022] DELETE /identity/v3/projects/c4dfbf233f81463fb01e2f86c6a2b7a1 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:31.037634 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07b734-d1e7-483f-9007-698fadb1023e None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:31.038100 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07b734-d1e7-483f-9007-698fadb1023e None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:31.038179 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07b734-d1e7-483f-9007-698fadb1023e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:31.066669 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-dc07b734-d1e7-483f-9007-698fadb1023e None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:31.068017 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-dc07b734-d1e7-483f-9007-698fadb1023e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:31.126133 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:31.152829 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 888/1777] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:31:31.160421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8953ef-80af-40ba-8593-11f36101ee10 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:31.161149 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8953ef-80af-40ba-8593-11f36101ee10 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:31.161541 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8953ef-80af-40ba-8593-11f36101ee10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:31.188874 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-4f8953ef-80af-40ba-8593-11f36101ee10 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:31.190421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-4f8953ef-80af-40ba-8593-11f36101ee10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:31.199221 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 890/1778] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:31:31.205233 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07b734-d1e7-483f-9007-698fadb1023e None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:31.216644 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07b734-d1e7-483f-9007-698fadb1023e None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:31.222766 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d35f65-e82e-4386-95dc-870b5dd7dde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:31.223477 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d35f65-e82e-4386-95dc-870b5dd7dde8 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:31.223824 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d35f65-e82e-4386-95dc-870b5dd7dde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:31.224578 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d35f65-e82e-4386-95dc-870b5dd7dde8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:31.225084 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d35f65-e82e-4386-95dc-870b5dd7dde8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:31:31.225323 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d35f65-e82e-4386-95dc-870b5dd7dde8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:31.226951 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d35f65-e82e-4386-95dc-870b5dd7dde8 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:31.240125 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 889/1779] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:31:31.244417 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8953ef-80af-40ba-8593-11f36101ee10 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:31.254900 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8953ef-80af-40ba-8593-11f36101ee10 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:31.261966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bc96d-7866-4951-8ab0-f17d5839dbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:31.262592 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bc96d-7866-4951-8ab0-f17d5839dbda admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:31.262926 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bc96d-7866-4951-8ab0-f17d5839dbda admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:31.263205 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bc96d-7866-4951-8ab0-f17d5839dbda admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:31.264298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bc96d-7866-4951-8ab0-f17d5839dbda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:31.265913 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bc96d-7866-4951-8ab0-f17d5839dbda admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:31.300616 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 891/1780] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:31:31 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:31.304736 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d35f65-e82e-4386-95dc-870b5dd7dde8 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:31.317032 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d35f65-e82e-4386-95dc-870b5dd7dde8 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:31.393545 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e2502-3f33-4cc6-a75f-713d715e330b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:31.394235 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e2502-3f33-4cc6-a75f-713d715e330b admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:31.394531 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e2502-3f33-4cc6-a75f-713d715e330b admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:31.394811 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e2502-3f33-4cc6-a75f-713d715e330b admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:31.395525 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e2502-3f33-4cc6-a75f-713d715e330b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:31.397992 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e2502-3f33-4cc6-a75f-713d715e330b admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:31.431509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 890/1781] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:31:31 2022] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:31.432891 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bc96d-7866-4951-8ab0-f17d5839dbda admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:31.444701 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bc96d-7866-4951-8ab0-f17d5839dbda admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:31.451843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c52e6-c8bf-4f3e-828b-d785fd952315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:31.452669 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c52e6-c8bf-4f3e-828b-d785fd952315 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:31.452963 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c52e6-c8bf-4f3e-828b-d785fd952315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:31.453608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c52e6-c8bf-4f3e-828b-d785fd952315 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:31.454651 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c52e6-c8bf-4f3e-828b-d785fd952315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:31.456265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c52e6-c8bf-4f3e-828b-d785fd952315 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:31.468501 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 892/1782] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:31:31.473113 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e2502-3f33-4cc6-a75f-713d715e330b admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:31.485963 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e2502-3f33-4cc6-a75f-713d715e330b admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:31.491882 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1733f-391d-4feb-b488-e38dba4cba7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:31.492646 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1733f-391d-4feb-b488-e38dba4cba7d admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:31.493044 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1733f-391d-4feb-b488-e38dba4cba7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:31.493448 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1733f-391d-4feb-b488-e38dba4cba7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:31.494237 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1733f-391d-4feb-b488-e38dba4cba7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:31.495939 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1733f-391d-4feb-b488-e38dba4cba7d admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:31.508486 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 891/1783] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:31.512262 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c52e6-c8bf-4f3e-828b-d785fd952315 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:31.524153 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c52e6-c8bf-4f3e-828b-d785fd952315 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:31.534494 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c38e84-f54b-48a2-8018-8116439d9d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:31.535198 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c38e84-f54b-48a2-8018-8116439d9d6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:31.535511 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c38e84-f54b-48a2-8018-8116439d9d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:31.535790 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c38e84-f54b-48a2-8018-8116439d9d6c admin admin] PATH_INFO: `/v3/projects/e40622571042492b93c82d7b88f2e187/users/baf8e28eb7f14eeda6977e80e518666e/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:31.553237 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c38e84-f54b-48a2-8018-8116439d9d6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e40622571042492b93c82d7b88f2e187, user_id=baf8e28eb7f14eeda6977e80e518666e, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:31.555958 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c38e84-f54b-48a2-8018-8116439d9d6c admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:31.568243 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:31.576149 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 893/1784] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:31:31 2022] PUT /identity/v3/projects/e40622571042492b93c82d7b88f2e187/users/baf8e28eb7f14eeda6977e80e518666e/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:31:31.586287 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0053c6-f439-4dbc-9e81-66d6305dc75f None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:31.586856 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0053c6-f439-4dbc-9e81-66d6305dc75f None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:31.587548 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0053c6-f439-4dbc-9e81-66d6305dc75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:31.644806 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c38e84-f54b-48a2-8018-8116439d9d6c admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:31.646622 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-68c38e84-f54b-48a2-8018-8116439d9d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:31.671581 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-6a0053c6-f439-4dbc-9e81-66d6305dc75f None None] MFA Rules not processed for user `baf8e28eb7f14eeda6977e80e518666e`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:31.671581 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-6a0053c6-f439-4dbc-9e81-66d6305dc75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:31.765161 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c38e84-f54b-48a2-8018-8116439d9d6c admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:31.771366 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505eaa9-8fc7-45df-b5cf-27f0e4de09ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:31.772299 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505eaa9-8fc7-45df-b5cf-27f0e4de09ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:31.772611 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505eaa9-8fc7-45df-b5cf-27f0e4de09ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:31.772895 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505eaa9-8fc7-45df-b5cf-27f0e4de09ef admin admin] PATH_INFO: `/v3/users/d5531130e8bb4f3ba0f1de1d2639dace` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:31.774584 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505eaa9-8fc7-45df-b5cf-27f0e4de09ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5531130e8bb4f3ba0f1de1d2639dace)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:31.776995 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505eaa9-8fc7-45df-b5cf-27f0e4de09ef admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:31.803199 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 892/1785] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:31.815250 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0053c6-f439-4dbc-9e81-66d6305dc75f None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:31.816871 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-6a0053c6-f439-4dbc-9e81-66d6305dc75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:31.866294 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8505eaa9-8fc7-45df-b5cf-27f0e4de09ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5531130e8bb4f3ba0f1de1d2639dace'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:31.867022 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8505eaa9-8fc7-45df-b5cf-27f0e4de09ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5531130e8bb4f3ba0f1de1d2639dace'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:31.877100 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8505eaa9-8fc7-45df-b5cf-27f0e4de09ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5531130e8bb4f3ba0f1de1d2639dace'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:31.877811 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8505eaa9-8fc7-45df-b5cf-27f0e4de09ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5531130e8bb4f3ba0f1de1d2639dace'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:31.904661 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:31.909772 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8505eaa9-8fc7-45df-b5cf-27f0e4de09ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5531130e8bb4f3ba0f1de1d2639dace'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:31.930160 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0053c6-f439-4dbc-9e81-66d6305dc75f None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:31.944252 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 894/1786] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:31:31 2022] DELETE /identity/v3/users/d5531130e8bb4f3ba0f1de1d2639dace => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:31.949203 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3ae2a-1175-4e7b-828d-5832fd50d7ac None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:31.949510 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3ae2a-1175-4e7b-828d-5832fd50d7ac None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:31.949856 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3ae2a-1175-4e7b-828d-5832fd50d7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:31.957770 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466061f5-c74a-42c7-b7ed-2ec1ea8bbf5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:31.958417 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466061f5-c74a-42c7-b7ed-2ec1ea8bbf5b service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:31.958697 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466061f5-c74a-42c7-b7ed-2ec1ea8bbf5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:31.958998 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466061f5-c74a-42c7-b7ed-2ec1ea8bbf5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:31.966530 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-466061f5-c74a-42c7-b7ed-2ec1ea8bbf5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:31.998752 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-78f3ae2a-1175-4e7b-828d-5832fd50d7ac None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:32.000064 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-78f3ae2a-1175-4e7b-828d-5832fd50d7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:32.003720 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466061f5-c74a-42c7-b7ed-2ec1ea8bbf5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:32.006646 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466061f5-c74a-42c7-b7ed-2ec1ea8bbf5b service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:32.030352 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 893/1787] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:32.100311 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 895/1788] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:32.115178 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466061f5-c74a-42c7-b7ed-2ec1ea8bbf5b service cinder] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:32.117002 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-466061f5-c74a-42c7-b7ed-2ec1ea8bbf5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:32.238914 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466061f5-c74a-42c7-b7ed-2ec1ea8bbf5b service cinder] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:32.300120 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffc9a4-02ff-4da4-a277-a11299c45f5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:32.300983 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffc9a4-02ff-4da4-a277-a11299c45f5c service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:32.301403 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffc9a4-02ff-4da4-a277-a11299c45f5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:32.301773 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffc9a4-02ff-4da4-a277-a11299c45f5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:32.315655 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ffc9a4-02ff-4da4-a277-a11299c45f5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:32.317159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ffc9a4-02ff-4da4-a277-a11299c45f5c service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:32.340738 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 894/1789] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:32.824448 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3ae2a-1175-4e7b-828d-5832fd50d7ac None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:32.827009 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-78f3ae2a-1175-4e7b-828d-5832fd50d7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:32.848272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3ae2a-1175-4e7b-828d-5832fd50d7ac None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:32.859172 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c766fe-e034-43a8-89f8-ae02926ccdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:32.860505 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c766fe-e034-43a8-89f8-ae02926ccdf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:32.860904 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c766fe-e034-43a8-89f8-ae02926ccdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:32.862488 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c766fe-e034-43a8-89f8-ae02926ccdf3 admin admin] PATH_INFO: `/v3/projects/319de54e2d6b43a4a517a8f5b3032c63` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:32.863934 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c766fe-e034-43a8-89f8-ae02926ccdf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=319de54e2d6b43a4a517a8f5b3032c63)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:32.866119 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c766fe-e034-43a8-89f8-ae02926ccdf3 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:32.896053 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:32.942883 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-f9c766fe-e034-43a8-89f8-ae02926ccdf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '319de54e2d6b43a4a517a8f5b3032c63', 'request_id': 'req-f9c766fe-e034-43a8-89f8-ae02926ccdf3'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:32.952144 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-f9c766fe-e034-43a8-89f8-ae02926ccdf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '319de54e2d6b43a4a517a8f5b3032c63', 'request_id': 'req-f9c766fe-e034-43a8-89f8-ae02926ccdf3'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:32.963362 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-f9c766fe-e034-43a8-89f8-ae02926ccdf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '319de54e2d6b43a4a517a8f5b3032c63', 'request_id': 'req-f9c766fe-e034-43a8-89f8-ae02926ccdf3'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:32.992990 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-f9c766fe-e034-43a8-89f8-ae02926ccdf3 admin admin] The token cache is being invalidate because project 319de54e2d6b43a4a517a8f5b3032c63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:31:32.993293 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-f9c766fe-e034-43a8-89f8-ae02926ccdf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:32.994159 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-f9c766fe-e034-43a8-89f8-ae02926ccdf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:32.997595 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 896/1790] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:31:32 2022] DELETE /identity/v3/projects/319de54e2d6b43a4a517a8f5b3032c63 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:33.002473 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffc9a4-02ff-4da4-a277-a11299c45f5c service neutron] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:33.012601 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffc9a4-02ff-4da4-a277-a11299c45f5c service neutron] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:33.090808 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58d150-363a-41be-82eb-1f87e72136fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:33.091451 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58d150-363a-41be-82eb-1f87e72136fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:33.091734 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58d150-363a-41be-82eb-1f87e72136fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:33.092013 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58d150-363a-41be-82eb-1f87e72136fa admin admin] PATH_INFO: `/v3/users/c8f02c04623449a788ca929256554a0b` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:33.093328 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f58d150-363a-41be-82eb-1f87e72136fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8f02c04623449a788ca929256554a0b)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:33.095674 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f58d150-363a-41be-82eb-1f87e72136fa admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:33.171564 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:33.174983 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-9f58d150-363a-41be-82eb-1f87e72136fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8f02c04623449a788ca929256554a0b'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:33.175698 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-9f58d150-363a-41be-82eb-1f87e72136fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8f02c04623449a788ca929256554a0b'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:33.194360 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-9f58d150-363a-41be-82eb-1f87e72136fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8f02c04623449a788ca929256554a0b'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:33.195411 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-9f58d150-363a-41be-82eb-1f87e72136fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8f02c04623449a788ca929256554a0b'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:33.205791 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-9f58d150-363a-41be-82eb-1f87e72136fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8f02c04623449a788ca929256554a0b'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:33.228085 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 895/1791] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:31:33 2022] DELETE /identity/v3/users/c8f02c04623449a788ca929256554a0b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:33.708786 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1488dd-6ccc-4566-8107-ea5e12af4610 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:33.709118 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1488dd-6ccc-4566-8107-ea5e12af4610 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:33.709352 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1488dd-6ccc-4566-8107-ea5e12af4610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:33.783695 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58d150-363a-41be-82eb-1f87e72136fa admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:33.786851 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-9f58d150-363a-41be-82eb-1f87e72136fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:33.790214 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-1e1488dd-6ccc-4566-8107-ea5e12af4610 None None] MFA Rules not processed for user `baf8e28eb7f14eeda6977e80e518666e`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:33.794714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-1e1488dd-6ccc-4566-8107-ea5e12af4610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:33.889183 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 897/1792] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:33.948822 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58d150-363a-41be-82eb-1f87e72136fa admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:33.964327 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d97c0-35d2-4194-9177-a6da15206487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:33.965021 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d97c0-35d2-4194-9177-a6da15206487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:33.965308 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d97c0-35d2-4194-9177-a6da15206487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:33.965591 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d97c0-35d2-4194-9177-a6da15206487 admin admin] PATH_INFO: `/v3/users/2c01be3c24de41e8bfd99ab04f96caf1` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:33.973137 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d97c0-35d2-4194-9177-a6da15206487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c01be3c24de41e8bfd99ab04f96caf1)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:33.975093 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d97c0-35d2-4194-9177-a6da15206487 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:34.034713 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1488dd-6ccc-4566-8107-ea5e12af4610 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:34.037396 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-1e1488dd-6ccc-4566-8107-ea5e12af4610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:34.067634 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-fb3d97c0-35d2-4194-9177-a6da15206487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c01be3c24de41e8bfd99ab04f96caf1'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:34.068429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-fb3d97c0-35d2-4194-9177-a6da15206487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c01be3c24de41e8bfd99ab04f96caf1'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:34.080635 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1488dd-6ccc-4566-8107-ea5e12af4610 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:34.086464 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-fb3d97c0-35d2-4194-9177-a6da15206487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c01be3c24de41e8bfd99ab04f96caf1'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:34.093780 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c380b-87cf-49a8-b5c5-095b7c32ada8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:34.097017 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c380b-87cf-49a8-b5c5-095b7c32ada8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:34.097456 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c380b-87cf-49a8-b5c5-095b7c32ada8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:34.098116 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c380b-87cf-49a8-b5c5-095b7c32ada8 admin admin] PATH_INFO: `/v3/projects/bda47a853ea043aca0cfe319b5e91918` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:34.099847 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-fb3d97c0-35d2-4194-9177-a6da15206487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c01be3c24de41e8bfd99ab04f96caf1'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:34.100588 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c380b-87cf-49a8-b5c5-095b7c32ada8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bda47a853ea043aca0cfe319b5e91918)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:34.103105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c380b-87cf-49a8-b5c5-095b7c32ada8 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:34.122800 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-fb3d97c0-35d2-4194-9177-a6da15206487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c01be3c24de41e8bfd99ab04f96caf1'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:34.152027 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 896/1793] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:31:33 2022] DELETE /identity/v3/users/2c01be3c24de41e8bfd99ab04f96caf1 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:34.160537 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d97c0-35d2-4194-9177-a6da15206487 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:34.165652 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-fb3d97c0-35d2-4194-9177-a6da15206487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:34.194648 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-cd8c380b-87cf-49a8-b5c5-095b7c32ada8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bda47a853ea043aca0cfe319b5e91918', 'request_id': 'req-cd8c380b-87cf-49a8-b5c5-095b7c32ada8'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:34.206108 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-cd8c380b-87cf-49a8-b5c5-095b7c32ada8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bda47a853ea043aca0cfe319b5e91918', 'request_id': 'req-cd8c380b-87cf-49a8-b5c5-095b7c32ada8'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:34.218555 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-cd8c380b-87cf-49a8-b5c5-095b7c32ada8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bda47a853ea043aca0cfe319b5e91918', 'request_id': 'req-cd8c380b-87cf-49a8-b5c5-095b7c32ada8'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:34.246945 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-cd8c380b-87cf-49a8-b5c5-095b7c32ada8 admin admin] The token cache is being invalidate because project bda47a853ea043aca0cfe319b5e91918 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:31:34.247532 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-cd8c380b-87cf-49a8-b5c5-095b7c32ada8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:34.248136 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:34.250695 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-cd8c380b-87cf-49a8-b5c5-095b7c32ada8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:34.254398 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 898/1794] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:31:34 2022] DELETE /identity/v3/projects/bda47a853ea043aca0cfe319b5e91918 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:31:34.261216 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7574fc1-c571-496a-883a-031459d7de82 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:34.263109 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7574fc1-c571-496a-883a-031459d7de82 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:34.263430 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7574fc1-c571-496a-883a-031459d7de82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:34.268869 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d97c0-35d2-4194-9177-a6da15206487 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:34.322209 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-f7574fc1-c571-496a-883a-031459d7de82 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:34.328118 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-f7574fc1-c571-496a-883a-031459d7de82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:34.349217 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a5891-1303-408e-8bf5-3b851199395d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:34.349855 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a5891-1303-408e-8bf5-3b851199395d service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:34.350146 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a5891-1303-408e-8bf5-3b851199395d service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:34.352531 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a5891-1303-408e-8bf5-3b851199395d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:34.371315 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-4f6a5891-1303-408e-8bf5-3b851199395d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:34.383532 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:34.440115 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 899/1795] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:34.450717 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a5891-1303-408e-8bf5-3b851199395d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:34.451379 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac79fb-60ec-48d8-bcd7-ef11266386c4 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:34.451740 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac79fb-60ec-48d8-bcd7-ef11266386c4 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:34.452090 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac79fb-60ec-48d8-bcd7-ef11266386c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:34.452388 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a5891-1303-408e-8bf5-3b851199395d service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:34.477115 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-84ac79fb-60ec-48d8-bcd7-ef11266386c4 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:34.479035 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-84ac79fb-60ec-48d8-bcd7-ef11266386c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:34.490297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 897/1796] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:34.492776 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 900/1797] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:34.493662 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a5891-1303-408e-8bf5-3b851199395d service cinder] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:34.498949 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-4f6a5891-1303-408e-8bf5-3b851199395d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:34.522342 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567046b-a335-4bd2-ba5b-4f33ef817ba1 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:34.522654 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567046b-a335-4bd2-ba5b-4f33ef817ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:34.522940 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567046b-a335-4bd2-ba5b-4f33ef817ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:34.601968 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-5567046b-a335-4bd2-ba5b-4f33ef817ba1 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:34.603426 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-5567046b-a335-4bd2-ba5b-4f33ef817ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:34.639207 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 901/1798] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:34.643039 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a5891-1303-408e-8bf5-3b851199395d service cinder] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:34.644016 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567046b-a335-4bd2-ba5b-4f33ef817ba1 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:34.651974 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2e239-7315-4585-8ebd-5773f4f099f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:34.653922 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2e239-7315-4585-8ebd-5773f4f099f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:34.654217 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2e239-7315-4585-8ebd-5773f4f099f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:34.654498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2e239-7315-4585-8ebd-5773f4f099f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:34.679286 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567046b-a335-4bd2-ba5b-4f33ef817ba1 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:34.681120 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2e239-7315-4585-8ebd-5773f4f099f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:34.684866 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2e239-7315-4585-8ebd-5773f4f099f6 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:34.687307 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a49f7-9846-45b9-9c39-b4d0f9c2fdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:34.689157 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a49f7-9846-45b9-9c39-b4d0f9c2fdae admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:34.689990 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a49f7-9846-45b9-9c39-b4d0f9c2fdae admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:34.690731 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a49f7-9846-45b9-9c39-b4d0f9c2fdae admin admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:34.692910 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a49f7-9846-45b9-9c39-b4d0f9c2fdae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:31:34.693493 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a49f7-9846-45b9-9c39-b4d0f9c2fdae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:34.696267 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a49f7-9846-45b9-9c39-b4d0f9c2fdae admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:34.710714 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 898/1799] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:34.722675 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 902/1800] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:31:34.727159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2e239-7315-4585-8ebd-5773f4f099f6 service neutron] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:34.741304 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2e239-7315-4585-8ebd-5773f4f099f6 service neutron] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:34.747182 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cf3e7-9293-4145-b476-25dbb8d3abc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:34.747895 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cf3e7-9293-4145-b476-25dbb8d3abc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:34.748253 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cf3e7-9293-4145-b476-25dbb8d3abc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:34.748646 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cf3e7-9293-4145-b476-25dbb8d3abc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:34.749379 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39cf3e7-9293-4145-b476-25dbb8d3abc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:34.752519 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39cf3e7-9293-4145-b476-25dbb8d3abc6 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:34.805526 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 899/1801] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:31:34 2022] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:31:34.810349 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a49f7-9846-45b9-9c39-b4d0f9c2fdae admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:34.824486 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a49f7-9846-45b9-9c39-b4d0f9c2fdae admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:35.045410 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84adc62-ab59-4e90-b99d-af9b5392659b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:35.045949 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84adc62-ab59-4e90-b99d-af9b5392659b admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:35.046201 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84adc62-ab59-4e90-b99d-af9b5392659b admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:35.046484 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84adc62-ab59-4e90-b99d-af9b5392659b admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:35.048066 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84adc62-ab59-4e90-b99d-af9b5392659b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:35.050579 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84adc62-ab59-4e90-b99d-af9b5392659b admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:35.082738 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 903/1802] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:31:34 2022] POST /identity/v3/users => generated 292 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:35.086547 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cf3e7-9293-4145-b476-25dbb8d3abc6 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:35.104737 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cf3e7-9293-4145-b476-25dbb8d3abc6 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:35.113424 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5e540-74f4-45f2-9429-ec94573c07c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:35.114191 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5e540-74f4-45f2-9429-ec94573c07c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:35.114538 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5e540-74f4-45f2-9429-ec94573c07c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:35.114930 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5e540-74f4-45f2-9429-ec94573c07c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:35.116056 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5e540-74f4-45f2-9429-ec94573c07c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:35.118615 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5e540-74f4-45f2-9429-ec94573c07c1 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:35.148085 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 900/1803] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:35.149670 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84adc62-ab59-4e90-b99d-af9b5392659b admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:35.165189 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84adc62-ab59-4e90-b99d-af9b5392659b admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:35.182477 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8099ac-e3b5-4e69-a333-75d172b2be76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:35.183205 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8099ac-e3b5-4e69-a333-75d172b2be76 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:35.183764 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8099ac-e3b5-4e69-a333-75d172b2be76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:35.183764 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8099ac-e3b5-4e69-a333-75d172b2be76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:35.184957 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8099ac-e3b5-4e69-a333-75d172b2be76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:35.186778 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8099ac-e3b5-4e69-a333-75d172b2be76 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:35.230068 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 904/1804] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:35.230766 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5e540-74f4-45f2-9429-ec94573c07c1 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:35.248904 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5e540-74f4-45f2-9429-ec94573c07c1 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:35.255941 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b438f8-abe0-4ad5-b112-5da8a4facf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:35.256664 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b438f8-abe0-4ad5-b112-5da8a4facf09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:35.257509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b438f8-abe0-4ad5-b112-5da8a4facf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:35.257811 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b438f8-abe0-4ad5-b112-5da8a4facf09 admin admin] PATH_INFO: `/v3/projects/9b5dbad884374e8f9214624ea0bfb720/users/c1739b306f7e4ff98c77b41faea7b1fc/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:35.291998 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b438f8-abe0-4ad5-b112-5da8a4facf09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b5dbad884374e8f9214624ea0bfb720, user_id=c1739b306f7e4ff98c77b41faea7b1fc, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:35.306027 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b438f8-abe0-4ad5-b112-5da8a4facf09 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:35.313697 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:35.340892 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 901/1805] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:31:35 2022] PUT /identity/v3/projects/9b5dbad884374e8f9214624ea0bfb720/users/c1739b306f7e4ff98c77b41faea7b1fc/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:35.352829 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab1cb9-104a-43c5-b867-76dd85d84147 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:35.353408 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab1cb9-104a-43c5-b867-76dd85d84147 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:35.353868 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab1cb9-104a-43c5-b867-76dd85d84147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:35.457257 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-b8ab1cb9-104a-43c5-b867-76dd85d84147 None None] MFA Rules not processed for user `c1739b306f7e4ff98c77b41faea7b1fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:35.462498 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-b8ab1cb9-104a-43c5-b867-76dd85d84147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:35.602166 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b438f8-abe0-4ad5-b112-5da8a4facf09 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:35.604309 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-e6b438f8-abe0-4ad5-b112-5da8a4facf09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:35.677028 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 905/1806] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:35.697040 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab1cb9-104a-43c5-b867-76dd85d84147 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:35.698879 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-b8ab1cb9-104a-43c5-b867-76dd85d84147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:35.753734 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b438f8-abe0-4ad5-b112-5da8a4facf09 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:35.769012 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec476e7-9a3f-4217-a7f5-d6717094c4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:35.769012 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec476e7-9a3f-4217-a7f5-d6717094c4d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:35.769231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec476e7-9a3f-4217-a7f5-d6717094c4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:35.769591 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec476e7-9a3f-4217-a7f5-d6717094c4d7 admin admin] PATH_INFO: `/v3/projects/2e123e65c471426ab1e698f5c083997b` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:35.775068 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:35.776395 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec476e7-9a3f-4217-a7f5-d6717094c4d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e123e65c471426ab1e698f5c083997b)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:35.783508 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec476e7-9a3f-4217-a7f5-d6717094c4d7 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:35.884150 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab1cb9-104a-43c5-b867-76dd85d84147 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:35.905902 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4ec476e7-9a3f-4217-a7f5-d6717094c4d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e123e65c471426ab1e698f5c083997b', 'request_id': 'req-4ec476e7-9a3f-4217-a7f5-d6717094c4d7'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:35.916105 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4ec476e7-9a3f-4217-a7f5-d6717094c4d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e123e65c471426ab1e698f5c083997b', 'request_id': 'req-4ec476e7-9a3f-4217-a7f5-d6717094c4d7'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:35.930338 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4ec476e7-9a3f-4217-a7f5-d6717094c4d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e123e65c471426ab1e698f5c083997b', 'request_id': 'req-4ec476e7-9a3f-4217-a7f5-d6717094c4d7'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:35.951195 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4ec476e7-9a3f-4217-a7f5-d6717094c4d7 admin admin] The token cache is being invalidate because project 2e123e65c471426ab1e698f5c083997b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:31:35.951648 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4ec476e7-9a3f-4217-a7f5-d6717094c4d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:35.952739 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4ec476e7-9a3f-4217-a7f5-d6717094c4d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:35.956599 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 902/1807] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:31:35 2022] DELETE /identity/v3/projects/2e123e65c471426ab1e698f5c083997b => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:31:35.961191 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec476e7-9a3f-4217-a7f5-d6717094c4d7 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:35.963470 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-4ec476e7-9a3f-4217-a7f5-d6717094c4d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:35.971341 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b098ecc-74c2-4d43-8836-499f57f72644 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:35.971970 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b098ecc-74c2-4d43-8836-499f57f72644 service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:35.972252 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b098ecc-74c2-4d43-8836-499f57f72644 service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:35.973213 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b098ecc-74c2-4d43-8836-499f57f72644 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:35.975424 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-6b098ecc-74c2-4d43-8836-499f57f72644 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:36.070873 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b098ecc-74c2-4d43-8836-499f57f72644 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:36.072392 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b098ecc-74c2-4d43-8836-499f57f72644 service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:36.090448 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 906/1808] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:36.103489 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec476e7-9a3f-4217-a7f5-d6717094c4d7 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:36.118230 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424fa729-6f98-4773-b134-015667b2de44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:36.120395 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424fa729-6f98-4773-b134-015667b2de44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:36.120941 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424fa729-6f98-4773-b134-015667b2de44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:36.121477 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424fa729-6f98-4773-b134-015667b2de44 admin admin] PATH_INFO: `/v3/users/24bd9b19d9134068bf6a2eb121d998d6` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:36.124835 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424fa729-6f98-4773-b134-015667b2de44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24bd9b19d9134068bf6a2eb121d998d6)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:36.125395 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b098ecc-74c2-4d43-8836-499f57f72644 service cinder] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:36.126892 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-6b098ecc-74c2-4d43-8836-499f57f72644 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:36.128013 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424fa729-6f98-4773-b134-015667b2de44 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:36.172080 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b098ecc-74c2-4d43-8836-499f57f72644 service cinder] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:36.174515 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:INSERT=2,keystone:SELECT=87,keystone:DELETE=11 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:36.184333 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09f2ba-f93b-4dd3-ae7f-1bc04f3facdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:36.185316 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09f2ba-f93b-4dd3-ae7f-1bc04f3facdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:36.185316 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09f2ba-f93b-4dd3-ae7f-1bc04f3facdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:36.185572 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09f2ba-f93b-4dd3-ae7f-1bc04f3facdb admin admin] PATH_INFO: `/v3/users/c1739b306f7e4ff98c77b41faea7b1fc` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:36.186898 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09f2ba-f93b-4dd3-ae7f-1bc04f3facdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1739b306f7e4ff98c77b41faea7b1fc)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:36.195394 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09f2ba-f93b-4dd3-ae7f-1bc04f3facdb admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:36.205629 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-424fa729-6f98-4773-b134-015667b2de44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24bd9b19d9134068bf6a2eb121d998d6'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:36.206653 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-424fa729-6f98-4773-b134-015667b2de44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24bd9b19d9134068bf6a2eb121d998d6'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:36.223645 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-424fa729-6f98-4773-b134-015667b2de44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24bd9b19d9134068bf6a2eb121d998d6'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:36.224419 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-424fa729-6f98-4773-b134-015667b2de44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24bd9b19d9134068bf6a2eb121d998d6'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:36.237029 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-424fa729-6f98-4773-b134-015667b2de44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24bd9b19d9134068bf6a2eb121d998d6'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:36.258532 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 903/1809] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:31:35 2022] DELETE /identity/v3/users/24bd9b19d9134068bf6a2eb121d998d6 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:31:36.272095 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-7b09f2ba-f93b-4dd3-ae7f-1bc04f3facdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1739b306f7e4ff98c77b41faea7b1fc'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:36.272918 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-7b09f2ba-f93b-4dd3-ae7f-1bc04f3facdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1739b306f7e4ff98c77b41faea7b1fc'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:36.283428 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-7b09f2ba-f93b-4dd3-ae7f-1bc04f3facdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1739b306f7e4ff98c77b41faea7b1fc'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:36.284222 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-7b09f2ba-f93b-4dd3-ae7f-1bc04f3facdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1739b306f7e4ff98c77b41faea7b1fc'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:36.302478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-7b09f2ba-f93b-4dd3-ae7f-1bc04f3facdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1739b306f7e4ff98c77b41faea7b1fc'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:36.313501 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:36.334362 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 907/1810] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:31:36 2022] DELETE /identity/v3/users/c1739b306f7e4ff98c77b41faea7b1fc => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:36.339459 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e2570-3873-490f-ba73-3e5e9471f7d7 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:36.340207 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e2570-3873-490f-ba73-3e5e9471f7d7 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:36.340540 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e2570-3873-490f-ba73-3e5e9471f7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:36.369092 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-188e2570-3873-490f-ba73-3e5e9471f7d7 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:36.370721 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-188e2570-3873-490f-ba73-3e5e9471f7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:36.542491 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 904/1811] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:36.551757 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09f2ba-f93b-4dd3-ae7f-1bc04f3facdb admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:36.553402 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-7b09f2ba-f93b-4dd3-ae7f-1bc04f3facdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:36.635397 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09f2ba-f93b-4dd3-ae7f-1bc04f3facdb admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:36.640301 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbcf24a-d9bf-4a8b-b966-abade7bf79c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:36.641123 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcf24a-d9bf-4a8b-b966-abade7bf79c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:36.641475 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcf24a-d9bf-4a8b-b966-abade7bf79c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:36.641870 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcf24a-d9bf-4a8b-b966-abade7bf79c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:36.652454 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbcf24a-d9bf-4a8b-b966-abade7bf79c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:36.654356 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbcf24a-d9bf-4a8b-b966-abade7bf79c8 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:36.667098 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 908/1812] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:36.837370 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e2570-3873-490f-ba73-3e5e9471f7d7 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:36.839018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-188e2570-3873-490f-ba73-3e5e9471f7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:36.859046 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e2570-3873-490f-ba73-3e5e9471f7d7 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:36.871070 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84323150-7de0-473d-9cae-699c89e268a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:36.871679 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84323150-7de0-473d-9cae-699c89e268a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:36.871954 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84323150-7de0-473d-9cae-699c89e268a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:36.872674 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84323150-7de0-473d-9cae-699c89e268a0 admin admin] PATH_INFO: `/v3/projects/b3791bac230c450d8b388397b4e1c8ab` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:36.873439 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84323150-7de0-473d-9cae-699c89e268a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3791bac230c450d8b388397b4e1c8ab)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:36.875513 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84323150-7de0-473d-9cae-699c89e268a0 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:36.944078 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c02aa-df0a-4237-ac0d-7b29cbf62cf9 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:36.944688 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c02aa-df0a-4237-ac0d-7b29cbf62cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:36.945112 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c02aa-df0a-4237-ac0d-7b29cbf62cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:36.972844 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-84323150-7de0-473d-9cae-699c89e268a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3791bac230c450d8b388397b4e1c8ab', 'request_id': 'req-84323150-7de0-473d-9cae-699c89e268a0'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:36.980924 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-84323150-7de0-473d-9cae-699c89e268a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3791bac230c450d8b388397b4e1c8ab', 'request_id': 'req-84323150-7de0-473d-9cae-699c89e268a0'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:36.985554 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-cf7c02aa-df0a-4237-ac0d-7b29cbf62cf9 None None] MFA Rules not processed for user `13d6d307bd3b436f9f18be0e762038fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:36.987229 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-cf7c02aa-df0a-4237-ac0d-7b29cbf62cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:36.989591 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-84323150-7de0-473d-9cae-699c89e268a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3791bac230c450d8b388397b4e1c8ab', 'request_id': 'req-84323150-7de0-473d-9cae-699c89e268a0'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:37.007444 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-84323150-7de0-473d-9cae-699c89e268a0 admin admin] The token cache is being invalidate because project b3791bac230c450d8b388397b4e1c8ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:31:37.007544 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-84323150-7de0-473d-9cae-699c89e268a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:37.008276 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-84323150-7de0-473d-9cae-699c89e268a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:37.010090 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 905/1813] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:31:36 2022] DELETE /identity/v3/projects/b3791bac230c450d8b388397b4e1c8ab => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:37.014965 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48936b85-3d24-4bf6-b097-18ee3ce9819c None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:37.015874 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48936b85-3d24-4bf6-b097-18ee3ce9819c None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:37.016858 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48936b85-3d24-4bf6-b097-18ee3ce9819c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:37.041059 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-48936b85-3d24-4bf6-b097-18ee3ce9819c None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:37.042293 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-48936b85-3d24-4bf6-b097-18ee3ce9819c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:37.067369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:37.104450 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 909/1814] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:37.104450 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c02aa-df0a-4237-ac0d-7b29cbf62cf9 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:37.104450 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-cf7c02aa-df0a-4237-ac0d-7b29cbf62cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:37.131354 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 906/1815] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:37.131985 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48936b85-3d24-4bf6-b097-18ee3ce9819c None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:37.133311 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-48936b85-3d24-4bf6-b097-18ee3ce9819c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:37.190631 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c02aa-df0a-4237-ac0d-7b29cbf62cf9 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:37.199964 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f2e57-e331-4257-9b4c-fac903b46ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:37.202081 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f2e57-e331-4257-9b4c-fac903b46ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:37.202367 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f2e57-e331-4257-9b4c-fac903b46ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:37.202642 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f2e57-e331-4257-9b4c-fac903b46ba4 admin admin] PATH_INFO: `/v3/projects/9b5dbad884374e8f9214624ea0bfb720` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:37.207691 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f2e57-e331-4257-9b4c-fac903b46ba4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b5dbad884374e8f9214624ea0bfb720)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:37.213888 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f2e57-e331-4257-9b4c-fac903b46ba4 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:37.245813 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48936b85-3d24-4bf6-b097-18ee3ce9819c None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:37.255712 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb43390-48a0-4ba8-87d0-8cc4f0904a1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:37.256442 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb43390-48a0-4ba8-87d0-8cc4f0904a1d service nova] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:37.263010 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb43390-48a0-4ba8-87d0-8cc4f0904a1d service nova] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:37.263495 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb43390-48a0-4ba8-87d0-8cc4f0904a1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:37.268723 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:37.275005 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb43390-48a0-4ba8-87d0-8cc4f0904a1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:37.277378 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb43390-48a0-4ba8-87d0-8cc4f0904a1d service nova] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:37.301820 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 907/1816] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:37.306636 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98895ca-9df9-445d-9f90-721b14926641 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:37.306935 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98895ca-9df9-445d-9f90-721b14926641 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:37.307220 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98895ca-9df9-445d-9f90-721b14926641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:37.325109 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-eb1f2e57-e331-4257-9b4c-fac903b46ba4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b5dbad884374e8f9214624ea0bfb720', 'request_id': 'req-eb1f2e57-e331-4257-9b4c-fac903b46ba4'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:37.340315 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-eb1f2e57-e331-4257-9b4c-fac903b46ba4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b5dbad884374e8f9214624ea0bfb720', 'request_id': 'req-eb1f2e57-e331-4257-9b4c-fac903b46ba4'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:37.353207 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-f98895ca-9df9-445d-9f90-721b14926641 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:37.354388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-eb1f2e57-e331-4257-9b4c-fac903b46ba4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b5dbad884374e8f9214624ea0bfb720', 'request_id': 'req-eb1f2e57-e331-4257-9b4c-fac903b46ba4'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:37.354509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-f98895ca-9df9-445d-9f90-721b14926641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:37.374857 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-eb1f2e57-e331-4257-9b4c-fac903b46ba4 admin admin] The token cache is being invalidate because project 9b5dbad884374e8f9214624ea0bfb720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:31:37.375508 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-eb1f2e57-e331-4257-9b4c-fac903b46ba4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:37.377349 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-eb1f2e57-e331-4257-9b4c-fac903b46ba4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:37.379694 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 910/1817] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:31:37 2022] DELETE /identity/v3/projects/9b5dbad884374e8f9214624ea0bfb720 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:37.387206 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6a9e1-a429-4802-a455-20475d68f256 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:37.387576 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6a9e1-a429-4802-a455-20475d68f256 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:37.387923 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6a9e1-a429-4802-a455-20475d68f256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:37.431381 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-74b6a9e1-a429-4802-a455-20475d68f256 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:37.433285 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-74b6a9e1-a429-4802-a455-20475d68f256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:37.467384 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 908/1818] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:37.477436 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98895ca-9df9-445d-9f90-721b14926641 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:37.501288 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98895ca-9df9-445d-9f90-721b14926641 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:37.515660 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830038b-ae2a-478e-9a38-167b7d99e83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:37.516337 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830038b-ae2a-478e-9a38-167b7d99e83d admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:37.516649 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830038b-ae2a-478e-9a38-167b7d99e83d admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:37.516925 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830038b-ae2a-478e-9a38-167b7d99e83d admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:37.521575 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830038b-ae2a-478e-9a38-167b7d99e83d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:31:37.521575 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830038b-ae2a-478e-9a38-167b7d99e83d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:37.523001 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830038b-ae2a-478e-9a38-167b7d99e83d admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:37.559268 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 909/1819] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:31:37.561132 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830038b-ae2a-478e-9a38-167b7d99e83d admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:37.574688 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 911/1820] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:31:37.576091 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d520a-7717-487c-b460-4e2c7c4c7937 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:37.576450 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d520a-7717-487c-b460-4e2c7c4c7937 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:37.583889 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830038b-ae2a-478e-9a38-167b7d99e83d admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:37.584967 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d520a-7717-487c-b460-4e2c7c4c7937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:37.589466 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec51d3b-ef87-4d49-b54a-4ac8d97f75a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:37.590520 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec51d3b-ef87-4d49-b54a-4ac8d97f75a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:37.590813 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec51d3b-ef87-4d49-b54a-4ac8d97f75a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:37.591096 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec51d3b-ef87-4d49-b54a-4ac8d97f75a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:37.592711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec51d3b-ef87-4d49-b54a-4ac8d97f75a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:37.595845 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec51d3b-ef87-4d49-b54a-4ac8d97f75a8 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:37.624811 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-6b9d520a-7717-487c-b460-4e2c7c4c7937 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:37.631804 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-6b9d520a-7717-487c-b460-4e2c7c4c7937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:37.662151 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 910/1821] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:31:37 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:37.667600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 912/1822] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:37.669303 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec51d3b-ef87-4d49-b54a-4ac8d97f75a8 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:37.673433 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d520a-7717-487c-b460-4e2c7c4c7937 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:37.688300 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d520a-7717-487c-b460-4e2c7c4c7937 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:37.724017 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:37.821656 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec51d3b-ef87-4d49-b54a-4ac8d97f75a8 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:37.828099 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e8076-431a-4ab0-bada-4a93c75d27cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:37.829794 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e8076-431a-4ab0-bada-4a93c75d27cc admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:37.830080 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e8076-431a-4ab0-bada-4a93c75d27cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:37.830355 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e8076-431a-4ab0-bada-4a93c75d27cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:37.831008 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e8076-431a-4ab0-bada-4a93c75d27cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:31:37.831313 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e8076-431a-4ab0-bada-4a93c75d27cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:37.833124 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e8076-431a-4ab0-bada-4a93c75d27cc admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:37.839917 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62657b2f-49d2-4f5a-94fd-e3e626352320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:37.849747 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62657b2f-49d2-4f5a-94fd-e3e626352320 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:37.850024 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62657b2f-49d2-4f5a-94fd-e3e626352320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:37.850315 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62657b2f-49d2-4f5a-94fd-e3e626352320 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:37.851052 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62657b2f-49d2-4f5a-94fd-e3e626352320 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:37.851709 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 913/1823] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:31:37.853673 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62657b2f-49d2-4f5a-94fd-e3e626352320 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:37.855583 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e8076-431a-4ab0-bada-4a93c75d27cc admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:37.867719 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e8076-431a-4ab0-bada-4a93c75d27cc admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:37.878069 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800039a6-839d-4e71-868f-a67314732cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:37.878739 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800039a6-839d-4e71-868f-a67314732cdc admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:37.879031 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800039a6-839d-4e71-868f-a67314732cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:37.879349 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800039a6-839d-4e71-868f-a67314732cdc admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:37.880061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800039a6-839d-4e71-868f-a67314732cdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:37.883360 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800039a6-839d-4e71-868f-a67314732cdc admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:37.886347 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 911/1824] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:31:37 2022] POST /identity/v3/users => generated 283 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:37.891953 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62657b2f-49d2-4f5a-94fd-e3e626352320 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:37.910137 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62657b2f-49d2-4f5a-94fd-e3e626352320 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:37.915715 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c799e8-cf94-4a01-8c46-96d918fa3e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:37.916411 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c799e8-cf94-4a01-8c46-96d918fa3e88 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:37.916795 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c799e8-cf94-4a01-8c46-96d918fa3e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:37.917283 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c799e8-cf94-4a01-8c46-96d918fa3e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:37.918013 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c799e8-cf94-4a01-8c46-96d918fa3e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:37.919773 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c799e8-cf94-4a01-8c46-96d918fa3e88 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:37.932729 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 914/1825] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:31:37 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:31:37.933993 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800039a6-839d-4e71-868f-a67314732cdc admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:37.936644 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 912/1826] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:31:37.940204 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c799e8-cf94-4a01-8c46-96d918fa3e88 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:37.951546 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c799e8-cf94-4a01-8c46-96d918fa3e88 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:37.970951 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:38.020669 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800039a6-839d-4e71-868f-a67314732cdc admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:38.026595 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903af475-476c-407d-8cc5-07bc90db64ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:38.027227 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903af475-476c-407d-8cc5-07bc90db64ac admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:38.027755 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903af475-476c-407d-8cc5-07bc90db64ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:38.028040 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903af475-476c-407d-8cc5-07bc90db64ac admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:38.028910 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903af475-476c-407d-8cc5-07bc90db64ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:38.031536 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903af475-476c-407d-8cc5-07bc90db64ac admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:38.036037 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec26c8-5ebc-49dc-8269-89af19fd6822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:38.037128 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec26c8-5ebc-49dc-8269-89af19fd6822 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:38.037128 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec26c8-5ebc-49dc-8269-89af19fd6822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:38.037340 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec26c8-5ebc-49dc-8269-89af19fd6822 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:38.037852 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec26c8-5ebc-49dc-8269-89af19fd6822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:38.039763 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec26c8-5ebc-49dc-8269-89af19fd6822 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:38.056767 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 913/1827] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:31:38.060818 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec26c8-5ebc-49dc-8269-89af19fd6822 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:38.064510 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 915/1828] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:31:37 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:38.065795 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903af475-476c-407d-8cc5-07bc90db64ac admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:38.074674 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec26c8-5ebc-49dc-8269-89af19fd6822 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:38.080851 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903af475-476c-407d-8cc5-07bc90db64ac admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:38.081961 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a9876-ce74-40da-808a-81d40bdbbbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:38.082835 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a9876-ce74-40da-808a-81d40bdbbbad admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:38.083135 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a9876-ce74-40da-808a-81d40bdbbbad admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:38.083467 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a9876-ce74-40da-808a-81d40bdbbbad admin admin] PATH_INFO: `/v3/projects/7929d3662b6b48e59a13264eaba95006/users/b3b36da361c84e03b765d92d4fbd68a7/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:38.087861 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b30a0-90e8-4496-9bc0-eb9461b54edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:38.088752 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b30a0-90e8-4496-9bc0-eb9461b54edb admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:38.089038 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b30a0-90e8-4496-9bc0-eb9461b54edb admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:38.089321 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b30a0-90e8-4496-9bc0-eb9461b54edb admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:38.090354 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b30a0-90e8-4496-9bc0-eb9461b54edb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:38.092219 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b30a0-90e8-4496-9bc0-eb9461b54edb admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:38.112528 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 916/1829] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:31:38.116759 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b30a0-90e8-4496-9bc0-eb9461b54edb admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:38.121287 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a9876-ce74-40da-808a-81d40bdbbbad admin admin] RBAC: Authorizing `identity:create_grant(project_id=7929d3662b6b48e59a13264eaba95006, user_id=b3b36da361c84e03b765d92d4fbd68a7, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:38.124209 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a9876-ce74-40da-808a-81d40bdbbbad admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:38.138383 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b30a0-90e8-4496-9bc0-eb9461b54edb admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:38.151637 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aea013-e4f7-412c-958c-87e347387960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:38.152473 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 914/1830] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:31:38 2022] PUT /identity/v3/projects/7929d3662b6b48e59a13264eaba95006/users/b3b36da361c84e03b765d92d4fbd68a7/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:38.163652 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aea013-e4f7-412c-958c-87e347387960 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:38.163950 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aea013-e4f7-412c-958c-87e347387960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:38.164254 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aea013-e4f7-412c-958c-87e347387960 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:38.165601 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aea013-e4f7-412c-958c-87e347387960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:38.166367 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb1f9e-a549-46ad-825b-c06fa0a82d0a None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:38.166839 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb1f9e-a549-46ad-825b-c06fa0a82d0a None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:38.167322 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb1f9e-a549-46ad-825b-c06fa0a82d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:38.167724 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aea013-e4f7-412c-958c-87e347387960 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:38.184602 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 917/1831] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:38.188598 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aea013-e4f7-412c-958c-87e347387960 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:38.212791 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aea013-e4f7-412c-958c-87e347387960 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:38.238291 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-beeb1f9e-a549-46ad-825b-c06fa0a82d0a None None] MFA Rules not processed for user `b3b36da361c84e03b765d92d4fbd68a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:38.239531 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-beeb1f9e-a549-46ad-825b-c06fa0a82d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:38.355271 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f861e-d87b-402c-b49e-3972db682c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:38.357227 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:38.358727 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f861e-d87b-402c-b49e-3972db682c4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:38.359493 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f861e-d87b-402c-b49e-3972db682c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:38.360038 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f861e-d87b-402c-b49e-3972db682c4d admin admin] PATH_INFO: `/v3/projects/79afc7a7db13499ab1843127e9de1afd/users/daed8502a4cb4f069136c0a1df33bac6/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:38.389816 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f861e-d87b-402c-b49e-3972db682c4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=79afc7a7db13499ab1843127e9de1afd, user_id=daed8502a4cb4f069136c0a1df33bac6, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:38.396998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f861e-d87b-402c-b49e-3972db682c4d admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:38.424734 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 915/1832] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:38.436586 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb1f9e-a549-46ad-825b-c06fa0a82d0a None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:38.440609 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-beeb1f9e-a549-46ad-825b-c06fa0a82d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:38.461101 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 918/1833] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:31:38 2022] PUT /identity/v3/projects/79afc7a7db13499ab1843127e9de1afd/users/daed8502a4cb4f069136c0a1df33bac6/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:31:38.472390 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26844e74-ae84-4af1-91ff-f60a43aecf89 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:38.472867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26844e74-ae84-4af1-91ff-f60a43aecf89 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:38.473227 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26844e74-ae84-4af1-91ff-f60a43aecf89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:38.587307 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-26844e74-ae84-4af1-91ff-f60a43aecf89 None None] MFA Rules not processed for user `daed8502a4cb4f069136c0a1df33bac6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:38.592319 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-26844e74-ae84-4af1-91ff-f60a43aecf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:38.634258 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb1f9e-a549-46ad-825b-c06fa0a82d0a None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:38.702657 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 919/1834] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:31:38.704341 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26844e74-ae84-4af1-91ff-f60a43aecf89 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:38.710336 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:38.799140 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26844e74-ae84-4af1-91ff-f60a43aecf89 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:38.805024 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a8092-13e3-4ef9-9a16-a64002797ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:38.806245 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a8092-13e3-4ef9-9a16-a64002797ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:38.806629 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a8092-13e3-4ef9-9a16-a64002797ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:38.807029 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a8092-13e3-4ef9-9a16-a64002797ae4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:38.808585 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a8092-13e3-4ef9-9a16-a64002797ae4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:38.812932 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a8092-13e3-4ef9-9a16-a64002797ae4 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:38.814982 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d5f8c-b020-4e11-b5e9-62032bf17fc2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62ca656e59ff46b08661385d8ec79846', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:38.815608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d5f8c-b020-4e11-b5e9-62032bf17fc2 service glance] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:38.815892 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d5f8c-b020-4e11-b5e9-62032bf17fc2 service glance] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:38.816168 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d5f8c-b020-4e11-b5e9-62032bf17fc2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:38.855823 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 920/1835] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:31:38 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:38.860330 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a8092-13e3-4ef9-9a16-a64002797ae4 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:38.902868 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d5f8c-b020-4e11-b5e9-62032bf17fc2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:38.905387 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d5f8c-b020-4e11-b5e9-62032bf17fc2 service glance] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:38.921404 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 916/1836] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:38.963324 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a8092-13e3-4ef9-9a16-a64002797ae4 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:38.969031 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13305fd-9416-43a0-8e68-3131dd1f4b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:38.969709 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13305fd-9416-43a0-8e68-3131dd1f4b37 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:38.969997 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13305fd-9416-43a0-8e68-3131dd1f4b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:38.970276 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13305fd-9416-43a0-8e68-3131dd1f4b37 admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:38.970921 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13305fd-9416-43a0-8e68-3131dd1f4b37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:38.973429 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13305fd-9416-43a0-8e68-3131dd1f4b37 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:39.005215 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 921/1837] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:31:38 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:31:39.008486 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d5f8c-b020-4e11-b5e9-62032bf17fc2 service glance] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:39.022000 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d5f8c-b020-4e11-b5e9-62032bf17fc2 service glance] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:39.028603 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b44f55-1032-4334-82db-104cc510047c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:39.029240 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b44f55-1032-4334-82db-104cc510047c admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:39.029529 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b44f55-1032-4334-82db-104cc510047c admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:39.029812 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b44f55-1032-4334-82db-104cc510047c admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:39.030614 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b44f55-1032-4334-82db-104cc510047c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:39.032423 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b44f55-1032-4334-82db-104cc510047c admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:39.050474 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 917/1838] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:39.058617 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13305fd-9416-43a0-8e68-3131dd1f4b37 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:39.078445 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13305fd-9416-43a0-8e68-3131dd1f4b37 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:39.086078 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fad9c-200b-409c-bc5e-88b5cf52f1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:39.086988 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fad9c-200b-409c-bc5e-88b5cf52f1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:39.087458 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fad9c-200b-409c-bc5e-88b5cf52f1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:39.088070 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fad9c-200b-409c-bc5e-88b5cf52f1b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:39.088541 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fad9c-200b-409c-bc5e-88b5cf52f1b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:39.091129 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fad9c-200b-409c-bc5e-88b5cf52f1b9 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:39.113229 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 922/1839] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:39.117109 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b44f55-1032-4334-82db-104cc510047c admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:39.133519 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b44f55-1032-4334-82db-104cc510047c admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:39.140591 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89678b0-f8b5-4fd6-b737-0b96b635e4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:39.142062 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89678b0-f8b5-4fd6-b737-0b96b635e4bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:39.142437 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89678b0-f8b5-4fd6-b737-0b96b635e4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:39.143794 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89678b0-f8b5-4fd6-b737-0b96b635e4bc admin admin] PATH_INFO: `/v3/projects/e61ba75e9d6344bf9b5cc67bf7058c78/users/e99a777364494385a409f0e4b5b6e1be/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:39.171413 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89678b0-f8b5-4fd6-b737-0b96b635e4bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e61ba75e9d6344bf9b5cc67bf7058c78, user_id=e99a777364494385a409f0e4b5b6e1be, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:39.185617 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89678b0-f8b5-4fd6-b737-0b96b635e4bc admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:39.226429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 918/1840] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:31:39 2022] PUT /identity/v3/projects/e61ba75e9d6344bf9b5cc67bf7058c78/users/e99a777364494385a409f0e4b5b6e1be/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:39.236927 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89f21e-0d47-4c2c-a822-753e0bd70028 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:39.237882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89f21e-0d47-4c2c-a822-753e0bd70028 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:39.238580 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89f21e-0d47-4c2c-a822-753e0bd70028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:39.326971 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-be89f21e-0d47-4c2c-a822-753e0bd70028 None None] MFA Rules not processed for user `e99a777364494385a409f0e4b5b6e1be`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:39.330145 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-be89f21e-0d47-4c2c-a822-753e0bd70028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:39.513358 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:39.545189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89678b0-f8b5-4fd6-b737-0b96b635e4bc admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:39.546694 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 923/1841] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:39.575664 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:39.719793 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89678b0-f8b5-4fd6-b737-0b96b635e4bc admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:39.730405 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e3beb-597a-401f-a5ed-aeff9ea8647e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:39.731130 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e3beb-597a-401f-a5ed-aeff9ea8647e admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:39.731422 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e3beb-597a-401f-a5ed-aeff9ea8647e admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:39.731752 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e3beb-597a-401f-a5ed-aeff9ea8647e admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:39.732420 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e3beb-597a-401f-a5ed-aeff9ea8647e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:39.735732 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e3beb-597a-401f-a5ed-aeff9ea8647e admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:39.783880 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 919/1842] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:31:39 2022] POST /identity/v3/projects => generated 385 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:39.787959 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89f21e-0d47-4c2c-a822-753e0bd70028 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:39.808936 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89f21e-0d47-4c2c-a822-753e0bd70028 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:39.929923 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c000c-b7e3-4b4d-a13b-ceff3972f594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:39.930572 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c000c-b7e3-4b4d-a13b-ceff3972f594 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:39.930929 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c000c-b7e3-4b4d-a13b-ceff3972f594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:39.931286 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c000c-b7e3-4b4d-a13b-ceff3972f594 admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:39.932503 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c000c-b7e3-4b4d-a13b-ceff3972f594 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:39.935108 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c000c-b7e3-4b4d-a13b-ceff3972f594 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:39.962660 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 924/1843] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:31:39 2022] POST /identity/v3/users => generated 299 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:39.966370 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e3beb-597a-401f-a5ed-aeff9ea8647e admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:39.980794 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e3beb-597a-401f-a5ed-aeff9ea8647e admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:39.987149 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbb7c6-639e-480c-b5ba-36f5f1acfc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:39.988281 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbb7c6-639e-480c-b5ba-36f5f1acfc15 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:39.988603 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbb7c6-639e-480c-b5ba-36f5f1acfc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:39.988890 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbb7c6-639e-480c-b5ba-36f5f1acfc15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:39.989591 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbb7c6-639e-480c-b5ba-36f5f1acfc15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:39.991506 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbb7c6-639e-480c-b5ba-36f5f1acfc15 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:40.010289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 920/1844] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:40.014291 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c000c-b7e3-4b4d-a13b-ceff3972f594 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:40.033218 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c000c-b7e3-4b4d-a13b-ceff3972f594 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:40.039924 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87c24b-e05b-4b12-be81-9457f814ac80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:40.040692 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87c24b-e05b-4b12-be81-9457f814ac80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:40.040985 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87c24b-e05b-4b12-be81-9457f814ac80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:40.041272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87c24b-e05b-4b12-be81-9457f814ac80 admin admin] PATH_INFO: `/v3/projects/6c27c6db08e64088b56b76f0971b225f/users/5a35284ea789414eb94252ca6c4c8709/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:40.065793 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b87c24b-e05b-4b12-be81-9457f814ac80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c27c6db08e64088b56b76f0971b225f, user_id=5a35284ea789414eb94252ca6c4c8709, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:40.070693 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b87c24b-e05b-4b12-be81-9457f814ac80 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:40.124036 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 925/1845] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:31:40 2022] PUT /identity/v3/projects/6c27c6db08e64088b56b76f0971b225f/users/5a35284ea789414eb94252ca6c4c8709/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:31:40.128976 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbb7c6-639e-480c-b5ba-36f5f1acfc15 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:40.140756 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbb7c6-639e-480c-b5ba-36f5f1acfc15 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:40.239584 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e945384-5183-4a4d-aedf-a55592c5a04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:40.241226 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e945384-5183-4a4d-aedf-a55592c5a04c admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:40.241666 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e945384-5183-4a4d-aedf-a55592c5a04c admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:40.242032 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e945384-5183-4a4d-aedf-a55592c5a04c admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:40.243078 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e945384-5183-4a4d-aedf-a55592c5a04c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:40.245246 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e945384-5183-4a4d-aedf-a55592c5a04c admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:40.271199 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 921/1846] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:40.275180 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87c24b-e05b-4b12-be81-9457f814ac80 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:40.291039 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87c24b-e05b-4b12-be81-9457f814ac80 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:40.297908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc6d26-b638-4e20-8688-476245964d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:40.298619 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc6d26-b638-4e20-8688-476245964d1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:40.299135 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc6d26-b638-4e20-8688-476245964d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:40.299423 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc6d26-b638-4e20-8688-476245964d1f admin admin] PATH_INFO: `/v3/projects/6c27c6db08e64088b56b76f0971b225f/users/5a35284ea789414eb94252ca6c4c8709/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:40.303929 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc6d26-b638-4e20-8688-476245964d1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c27c6db08e64088b56b76f0971b225f, user_id=5a35284ea789414eb94252ca6c4c8709, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:40.309168 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc6d26-b638-4e20-8688-476245964d1f admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:40.340641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 926/1847] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:31:40 2022] PUT /identity/v3/projects/6c27c6db08e64088b56b76f0971b225f/users/5a35284ea789414eb94252ca6c4c8709/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:40.350730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e6aba-c048-483c-9a59-48afb1739f1b None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:40.350952 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e6aba-c048-483c-9a59-48afb1739f1b None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:40.351173 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e6aba-c048-483c-9a59-48afb1739f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:40.406499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-7f6e6aba-c048-483c-9a59-48afb1739f1b None None] MFA Rules not processed for user `5a35284ea789414eb94252ca6c4c8709`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:40.408282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-7f6e6aba-c048-483c-9a59-48afb1739f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:40.513999 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbbbfe-b4a8-4ffa-b376-62821b6e327e None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:40.520702 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbbbfe-b4a8-4ffa-b376-62821b6e327e None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:40.520702 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbbbfe-b4a8-4ffa-b376-62821b6e327e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:40.524051 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 922/1848] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:40 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:40.549374 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e6aba-c048-483c-9a59-48afb1739f1b None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:40.553711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-7f6e6aba-c048-483c-9a59-48afb1739f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:40.555387 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-d4bbbbfe-b4a8-4ffa-b376-62821b6e327e None None] MFA Rules not processed for user `13d6d307bd3b436f9f18be0e762038fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:40.560235 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-d4bbbbfe-b4a8-4ffa-b376-62821b6e327e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:40.582224 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:40.646199 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e6aba-c048-483c-9a59-48afb1739f1b None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:40.651224 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc33701-e81e-4906-84c9-7acfa6976fe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:40.651810 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc33701-e81e-4906-84c9-7acfa6976fe2 service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:40.652241 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc33701-e81e-4906-84c9-7acfa6976fe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:40.652811 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc33701-e81e-4906-84c9-7acfa6976fe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:40.687136 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 927/1849] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:40.776989 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc33701-e81e-4906-84c9-7acfa6976fe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:40.778605 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc33701-e81e-4906-84c9-7acfa6976fe2 service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:40.811654 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 923/1850] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:42.735453 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbbbfe-b4a8-4ffa-b376-62821b6e327e None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:42.736890 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-d4bbbbfe-b4a8-4ffa-b376-62821b6e327e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:42.749145 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbbbfe-b4a8-4ffa-b376-62821b6e327e None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:42.752786 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c9480-f467-4197-b54a-3d3e83e1e133 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:42.753384 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c9480-f467-4197-b54a-3d3e83e1e133 service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:42.753669 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c9480-f467-4197-b54a-3d3e83e1e133 service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:42.753950 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c9480-f467-4197-b54a-3d3e83e1e133 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:42.808040 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:42.813147 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c9480-f467-4197-b54a-3d3e83e1e133 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:42.814683 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c9480-f467-4197-b54a-3d3e83e1e133 service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:42.824887 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 928/1851] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:43.427190 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc33701-e81e-4906-84c9-7acfa6976fe2 service cinder] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:43.438762 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc33701-e81e-4906-84c9-7acfa6976fe2 service cinder] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:43.443306 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80724e9-7987-408e-a06b-b0e1f933eecc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:43.444127 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80724e9-7987-408e-a06b-b0e1f933eecc service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:43.444630 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80724e9-7987-408e-a06b-b0e1f933eecc service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:43.445211 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80724e9-7987-408e-a06b-b0e1f933eecc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:43.459994 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80724e9-7987-408e-a06b-b0e1f933eecc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:43.459994 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80724e9-7987-408e-a06b-b0e1f933eecc service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:43.472598 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 924/1852] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:43 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:47.779459 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c9480-f467-4197-b54a-3d3e83e1e133 service cinder] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:47.917718 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c9480-f467-4197-b54a-3d3e83e1e133 service cinder] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:47.924435 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a556720-f5cd-4571-a703-5ef94746bc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:47.925119 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a556720-f5cd-4571-a703-5ef94746bc1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:47.927152 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a556720-f5cd-4571-a703-5ef94746bc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:47.927533 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a556720-f5cd-4571-a703-5ef94746bc1e admin admin] PATH_INFO: `/v3/users/daed8502a4cb4f069136c0a1df33bac6` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:47.928967 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a556720-f5cd-4571-a703-5ef94746bc1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=daed8502a4cb4f069136c0a1df33bac6)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:47.930963 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a556720-f5cd-4571-a703-5ef94746bc1e admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:48.013465 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-7a556720-f5cd-4571-a703-5ef94746bc1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daed8502a4cb4f069136c0a1df33bac6'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:48.014127 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-7a556720-f5cd-4571-a703-5ef94746bc1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daed8502a4cb4f069136c0a1df33bac6'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:48.021272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-7a556720-f5cd-4571-a703-5ef94746bc1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daed8502a4cb4f069136c0a1df33bac6'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:48.022205 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-7a556720-f5cd-4571-a703-5ef94746bc1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daed8502a4cb4f069136c0a1df33bac6'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:48.039240 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-7a556720-f5cd-4571-a703-5ef94746bc1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daed8502a4cb4f069136c0a1df33bac6'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:48.055362 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 929/1853] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:31:47 2022] DELETE /identity/v3/users/daed8502a4cb4f069136c0a1df33bac6 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:48.060037 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37ff3a-d126-42e0-91e7-61224afce917 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:48.060503 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37ff3a-d126-42e0-91e7-61224afce917 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:48.060651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37ff3a-d126-42e0-91e7-61224afce917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:48.080340 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-0b37ff3a-d126-42e0-91e7-61224afce917 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:48.082459 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-0b37ff3a-d126-42e0-91e7-61224afce917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:48.155878 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 925/1854] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:48.166173 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a556720-f5cd-4571-a703-5ef94746bc1e admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:48.167879 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-7a556720-f5cd-4571-a703-5ef94746bc1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:48.239546 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a556720-f5cd-4571-a703-5ef94746bc1e admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:48.243397 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc3041-f7d8-4a42-a9b2-ea9ae3dad5d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:48.244013 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc3041-f7d8-4a42-a9b2-ea9ae3dad5d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:48.244355 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc3041-f7d8-4a42-a9b2-ea9ae3dad5d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:48.244659 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc3041-f7d8-4a42-a9b2-ea9ae3dad5d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:48.256703 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc3041-f7d8-4a42-a9b2-ea9ae3dad5d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:48.258017 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc3041-f7d8-4a42-a9b2-ea9ae3dad5d5 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:48.269188 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 930/1855] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:48.646188 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37ff3a-d126-42e0-91e7-61224afce917 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:48.647671 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-0b37ff3a-d126-42e0-91e7-61224afce917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:48.660588 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37ff3a-d126-42e0-91e7-61224afce917 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:48.666049 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5355a54-698d-4e9e-a2ca-1032bad3974f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:48.666703 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5355a54-698d-4e9e-a2ca-1032bad3974f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:48.666987 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5355a54-698d-4e9e-a2ca-1032bad3974f admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:48.667266 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5355a54-698d-4e9e-a2ca-1032bad3974f admin admin] PATH_INFO: `/v3/projects/79afc7a7db13499ab1843127e9de1afd` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:48.668468 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5355a54-698d-4e9e-a2ca-1032bad3974f admin admin] RBAC: Authorizing `identity:delete_project(project_id=79afc7a7db13499ab1843127e9de1afd)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:48.670467 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5355a54-698d-4e9e-a2ca-1032bad3974f admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:48.722110 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:48.725874 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-f5355a54-698d-4e9e-a2ca-1032bad3974f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79afc7a7db13499ab1843127e9de1afd', 'request_id': 'req-f5355a54-698d-4e9e-a2ca-1032bad3974f'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:48.732294 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-f5355a54-698d-4e9e-a2ca-1032bad3974f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79afc7a7db13499ab1843127e9de1afd', 'request_id': 'req-f5355a54-698d-4e9e-a2ca-1032bad3974f'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:48.738773 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-f5355a54-698d-4e9e-a2ca-1032bad3974f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79afc7a7db13499ab1843127e9de1afd', 'request_id': 'req-f5355a54-698d-4e9e-a2ca-1032bad3974f'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:48.756146 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-f5355a54-698d-4e9e-a2ca-1032bad3974f admin admin] The token cache is being invalidate because project 79afc7a7db13499ab1843127e9de1afd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:31:48.756471 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-f5355a54-698d-4e9e-a2ca-1032bad3974f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:48.757144 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-f5355a54-698d-4e9e-a2ca-1032bad3974f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:48.758649 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 926/1856] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:31:48 2022] DELETE /identity/v3/projects/79afc7a7db13499ab1843127e9de1afd => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:48.762694 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc3041-f7d8-4a42-a9b2-ea9ae3dad5d5 service neutron] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:48.772778 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc3041-f7d8-4a42-a9b2-ea9ae3dad5d5 service neutron] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:48.785144 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:48.834610 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd237ac-47b0-40d6-ace1-197c8f5c89b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:48.835243 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd237ac-47b0-40d6-ace1-197c8f5c89b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:48.835521 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd237ac-47b0-40d6-ace1-197c8f5c89b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:48.835794 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd237ac-47b0-40d6-ace1-197c8f5c89b2 admin admin] PATH_INFO: `/v3/users/e99a777364494385a409f0e4b5b6e1be` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:48.836934 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd237ac-47b0-40d6-ace1-197c8f5c89b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e99a777364494385a409f0e4b5b6e1be)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:48.838842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd237ac-47b0-40d6-ace1-197c8f5c89b2 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:48.886977 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-9cd237ac-47b0-40d6-ace1-197c8f5c89b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e99a777364494385a409f0e4b5b6e1be'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:48.887546 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-9cd237ac-47b0-40d6-ace1-197c8f5c89b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e99a777364494385a409f0e4b5b6e1be'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:48.896088 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-9cd237ac-47b0-40d6-ace1-197c8f5c89b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e99a777364494385a409f0e4b5b6e1be'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:48.896779 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-9cd237ac-47b0-40d6-ace1-197c8f5c89b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e99a777364494385a409f0e4b5b6e1be'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:48.913403 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-9cd237ac-47b0-40d6-ace1-197c8f5c89b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e99a777364494385a409f0e4b5b6e1be'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:48.928496 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 931/1857] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:31:48 2022] DELETE /identity/v3/users/e99a777364494385a409f0e4b5b6e1be => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:49.393054 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5355a54-698d-4e9e-a2ca-1032bad3974f admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:49.394601 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-f5355a54-698d-4e9e-a2ca-1032bad3974f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:49.426720 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5355a54-698d-4e9e-a2ca-1032bad3974f admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:49.500089 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f48670-a262-4fec-9c1f-fda7f585a27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:49.500801 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f48670-a262-4fec-9c1f-fda7f585a27d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:49.501419 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f48670-a262-4fec-9c1f-fda7f585a27d admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:49.501883 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f48670-a262-4fec-9c1f-fda7f585a27d admin admin] PATH_INFO: `/v3/projects/e61ba75e9d6344bf9b5cc67bf7058c78` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:49.503702 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f48670-a262-4fec-9c1f-fda7f585a27d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e61ba75e9d6344bf9b5cc67bf7058c78)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:49.506413 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f48670-a262-4fec-9c1f-fda7f585a27d admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:49.578071 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-76f48670-a262-4fec-9c1f-fda7f585a27d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e61ba75e9d6344bf9b5cc67bf7058c78', 'request_id': 'req-76f48670-a262-4fec-9c1f-fda7f585a27d'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:49.588655 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-76f48670-a262-4fec-9c1f-fda7f585a27d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e61ba75e9d6344bf9b5cc67bf7058c78', 'request_id': 'req-76f48670-a262-4fec-9c1f-fda7f585a27d'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:49.595564 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-76f48670-a262-4fec-9c1f-fda7f585a27d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e61ba75e9d6344bf9b5cc67bf7058c78', 'request_id': 'req-76f48670-a262-4fec-9c1f-fda7f585a27d'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:49.617470 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-76f48670-a262-4fec-9c1f-fda7f585a27d admin admin] The token cache is being invalidate because project e61ba75e9d6344bf9b5cc67bf7058c78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:31:49.617758 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-76f48670-a262-4fec-9c1f-fda7f585a27d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:49.618713 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-76f48670-a262-4fec-9c1f-fda7f585a27d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:49.620425 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 927/1858] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:31:49 2022] DELETE /identity/v3/projects/e61ba75e9d6344bf9b5cc67bf7058c78 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:49.624513 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd237ac-47b0-40d6-ace1-197c8f5c89b2 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:49.626663 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-9cd237ac-47b0-40d6-ace1-197c8f5c89b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:49.640233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd237ac-47b0-40d6-ace1-197c8f5c89b2 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:49.710769 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925581dc-5d40-4dc5-bd09-7ad1db79251a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:49.711842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925581dc-5d40-4dc5-bd09-7ad1db79251a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:49.712163 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925581dc-5d40-4dc5-bd09-7ad1db79251a admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:49.712500 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925581dc-5d40-4dc5-bd09-7ad1db79251a admin admin] PATH_INFO: `/v3/users/5a35284ea789414eb94252ca6c4c8709` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:49.713718 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925581dc-5d40-4dc5-bd09-7ad1db79251a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a35284ea789414eb94252ca6c4c8709)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:49.715934 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925581dc-5d40-4dc5-bd09-7ad1db79251a admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:49.763935 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:49.777516 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-925581dc-5d40-4dc5-bd09-7ad1db79251a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a35284ea789414eb94252ca6c4c8709'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:49.778249 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-925581dc-5d40-4dc5-bd09-7ad1db79251a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a35284ea789414eb94252ca6c4c8709'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:49.786731 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-925581dc-5d40-4dc5-bd09-7ad1db79251a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a35284ea789414eb94252ca6c4c8709'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:49.787620 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-925581dc-5d40-4dc5-bd09-7ad1db79251a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a35284ea789414eb94252ca6c4c8709'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:49.810190 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-925581dc-5d40-4dc5-bd09-7ad1db79251a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a35284ea789414eb94252ca6c4c8709'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:49.827742 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 932/1859] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:31:49 2022] DELETE /identity/v3/users/5a35284ea789414eb94252ca6c4c8709 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:50.109463 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f48670-a262-4fec-9c1f-fda7f585a27d admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:50.111851 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-76f48670-a262-4fec-9c1f-fda7f585a27d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:50.127993 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f48670-a262-4fec-9c1f-fda7f585a27d admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:50.202318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884125a5-f2a8-4619-a3c9-95e56f08d470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:50.203102 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884125a5-f2a8-4619-a3c9-95e56f08d470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:50.203385 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884125a5-f2a8-4619-a3c9-95e56f08d470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:50.203701 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884125a5-f2a8-4619-a3c9-95e56f08d470 admin admin] PATH_INFO: `/v3/projects/6c27c6db08e64088b56b76f0971b225f` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:50.205913 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884125a5-f2a8-4619-a3c9-95e56f08d470 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c27c6db08e64088b56b76f0971b225f)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:50.210907 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884125a5-f2a8-4619-a3c9-95e56f08d470 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:50.220833 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:50.283486 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-884125a5-f2a8-4619-a3c9-95e56f08d470 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c27c6db08e64088b56b76f0971b225f', 'request_id': 'req-884125a5-f2a8-4619-a3c9-95e56f08d470'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:50.293052 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-884125a5-f2a8-4619-a3c9-95e56f08d470 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c27c6db08e64088b56b76f0971b225f', 'request_id': 'req-884125a5-f2a8-4619-a3c9-95e56f08d470'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:50.301395 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-884125a5-f2a8-4619-a3c9-95e56f08d470 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c27c6db08e64088b56b76f0971b225f', 'request_id': 'req-884125a5-f2a8-4619-a3c9-95e56f08d470'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:50.321120 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-884125a5-f2a8-4619-a3c9-95e56f08d470 admin admin] The token cache is being invalidate because project 6c27c6db08e64088b56b76f0971b225f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:31:50.321434 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-884125a5-f2a8-4619-a3c9-95e56f08d470 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:50.322245 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-884125a5-f2a8-4619-a3c9-95e56f08d470 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:50.330314 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f23ecd-f706-43c6-a90b-076522e6a3e3 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:50.330622 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f23ecd-f706-43c6-a90b-076522e6a3e3 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:50.330900 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f23ecd-f706-43c6-a90b-076522e6a3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:50.336679 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 928/1860] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:31:50 2022] DELETE /identity/v3/projects/6c27c6db08e64088b56b76f0971b225f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:31:50.357656 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-17f23ecd-f706-43c6-a90b-076522e6a3e3 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:50.366071 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-17f23ecd-f706-43c6-a90b-076522e6a3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:50.433718 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 933/1861] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:50.441833 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92941c-8b57-4e53-a1d4-cd80195ae0cf None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:50.442334 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92941c-8b57-4e53-a1d4-cd80195ae0cf None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:50.442414 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92941c-8b57-4e53-a1d4-cd80195ae0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:50.462002 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-3f92941c-8b57-4e53-a1d4-cd80195ae0cf None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:50.463145 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-3f92941c-8b57-4e53-a1d4-cd80195ae0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:50.472589 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 929/1862] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:50.477420 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f23ecd-f706-43c6-a90b-076522e6a3e3 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:50.487511 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f23ecd-f706-43c6-a90b-076522e6a3e3 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:50.492159 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bf1f8-5114-4390-97a8-ad5f560cba99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:50.492941 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bf1f8-5114-4390-97a8-ad5f560cba99 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:50.493229 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bf1f8-5114-4390-97a8-ad5f560cba99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:50.493502 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bf1f8-5114-4390-97a8-ad5f560cba99 admin admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:50.494149 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45bf1f8-5114-4390-97a8-ad5f560cba99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:31:50.494851 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45bf1f8-5114-4390-97a8-ad5f560cba99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:50.496103 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45bf1f8-5114-4390-97a8-ad5f560cba99 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:50.507763 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 934/1863] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:31:50.512117 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92941c-8b57-4e53-a1d4-cd80195ae0cf None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:50.524897 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92941c-8b57-4e53-a1d4-cd80195ae0cf None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:50.530048 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e989f2-9b17-4377-8467-d1dc2b291d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:50.530790 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e989f2-9b17-4377-8467-d1dc2b291d50 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:50.531264 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e989f2-9b17-4377-8467-d1dc2b291d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:50.531638 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e989f2-9b17-4377-8467-d1dc2b291d50 admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:50.532438 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e989f2-9b17-4377-8467-d1dc2b291d50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:50.534461 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e989f2-9b17-4377-8467-d1dc2b291d50 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:50.569260 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 930/1864] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:31:50 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:50.571146 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bf1f8-5114-4390-97a8-ad5f560cba99 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:50.583310 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bf1f8-5114-4390-97a8-ad5f560cba99 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:50.703278 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f105f1-5088-4a6a-a975-50be7ab2836c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:50.704215 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f105f1-5088-4a6a-a975-50be7ab2836c admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:50.704503 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f105f1-5088-4a6a-a975-50be7ab2836c admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:50.704816 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f105f1-5088-4a6a-a975-50be7ab2836c admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:50.705602 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f105f1-5088-4a6a-a975-50be7ab2836c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:50.708693 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f105f1-5088-4a6a-a975-50be7ab2836c admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:50.764211 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 935/1865] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:31:50 2022] POST /identity/v3/users => generated 284 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:31:50.770760 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e989f2-9b17-4377-8467-d1dc2b291d50 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:50.781144 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e989f2-9b17-4377-8467-d1dc2b291d50 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:50.785734 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda371de-a036-48d1-9f5e-09f3e700089e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:50.786338 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda371de-a036-48d1-9f5e-09f3e700089e admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:50.786625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda371de-a036-48d1-9f5e-09f3e700089e admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:50.786892 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda371de-a036-48d1-9f5e-09f3e700089e admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:50.787532 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda371de-a036-48d1-9f5e-09f3e700089e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:50.789261 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda371de-a036-48d1-9f5e-09f3e700089e admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:50.803704 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 931/1866] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:50.807774 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f105f1-5088-4a6a-a975-50be7ab2836c admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:50.818972 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f105f1-5088-4a6a-a975-50be7ab2836c admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:50.823661 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b3b68-278a-4f34-90a0-751eed4af870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:50.824266 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b3b68-278a-4f34-90a0-751eed4af870 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:50.824576 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b3b68-278a-4f34-90a0-751eed4af870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:50.824860 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b3b68-278a-4f34-90a0-751eed4af870 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:50.825498 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b3b68-278a-4f34-90a0-751eed4af870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:50.827089 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b3b68-278a-4f34-90a0-751eed4af870 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:50.841776 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 936/1867] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:31:50.842958 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda371de-a036-48d1-9f5e-09f3e700089e admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:50.854832 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda371de-a036-48d1-9f5e-09f3e700089e admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:50.857696 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f8c89-eaa4-4af7-86a1-9ad9972b7612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:50.858352 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f8c89-eaa4-4af7-86a1-9ad9972b7612 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:50.858642 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f8c89-eaa4-4af7-86a1-9ad9972b7612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:50.858947 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f8c89-eaa4-4af7-86a1-9ad9972b7612 admin admin] PATH_INFO: `/v3/projects/8bd4387be3bb4b209854caf7e8853b58/users/620d2ab84128488bba052ebc1259ce34/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:50.874153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f8c89-eaa4-4af7-86a1-9ad9972b7612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bd4387be3bb4b209854caf7e8853b58, user_id=620d2ab84128488bba052ebc1259ce34, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:50.877476 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f8c89-eaa4-4af7-86a1-9ad9972b7612 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:50.890256 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 932/1868] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:31:50 2022] PUT /identity/v3/projects/8bd4387be3bb4b209854caf7e8853b58/users/620d2ab84128488bba052ebc1259ce34/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:31:50.900637 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4747c-47a6-4f9b-9d1b-2aa198696de6 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:50.900933 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4747c-47a6-4f9b-9d1b-2aa198696de6 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:50.901235 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4747c-47a6-4f9b-9d1b-2aa198696de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:50.929538 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-62f4747c-47a6-4f9b-9d1b-2aa198696de6 None None] MFA Rules not processed for user `620d2ab84128488bba052ebc1259ce34`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:50.930757 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-62f4747c-47a6-4f9b-9d1b-2aa198696de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:50.938867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:50.999386 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 937/1869] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:31:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:51.012316 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f8c89-eaa4-4af7-86a1-9ad9972b7612 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:51.014049 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-1c0f8c89-eaa4-4af7-86a1-9ad9972b7612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:51.070424 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f8c89-eaa4-4af7-86a1-9ad9972b7612 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:51.074633 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8bffa-1e99-4f6b-98f6-6d1d4579c1c0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62ca656e59ff46b08661385d8ec79846', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:51.075394 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8bffa-1e99-4f6b-98f6-6d1d4579c1c0 service glance] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:51.075783 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8bffa-1e99-4f6b-98f6-6d1d4579c1c0 service glance] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:51.076134 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8bffa-1e99-4f6b-98f6-6d1d4579c1c0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:51.085619 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8bffa-1e99-4f6b-98f6-6d1d4579c1c0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:51.087050 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8bffa-1e99-4f6b-98f6-6d1d4579c1c0 service glance] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:51.098156 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 933/1870] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:31:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:31:57.990152 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61c726-344c-4a19-ae60-e6ba6799191a None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:57.990695 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61c726-344c-4a19-ae60-e6ba6799191a None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:57.990908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61c726-344c-4a19-ae60-e6ba6799191a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:58.016956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-dd61c726-344c-4a19-ae60-e6ba6799191a None None] MFA Rules not processed for user `66937804f65147f392f4ddfc3e961d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:58.018342 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-dd61c726-344c-4a19-ae60-e6ba6799191a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:58.079651 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 938/1871] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Nov 2 20:31:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:31:58.125249 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8bffa-1e99-4f6b-98f6-6d1d4579c1c0 service glance] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:58.126721 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-29e8bffa-1e99-4f6b-98f6-6d1d4579c1c0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:58.172809 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:31:58.220461 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8bffa-1e99-4f6b-98f6-6d1d4579c1c0 service glance] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:58.225863 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e07fd8-6fe0-40fa-a46a-7663a787fd22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f22f80ac694e9888c132af1e58e292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:58.226471 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e07fd8-6fe0-40fa-a46a-7663a787fd22 service swift] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:58.226767 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e07fd8-6fe0-40fa-a46a-7663a787fd22 service swift] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:58.227034 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e07fd8-6fe0-40fa-a46a-7663a787fd22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:58.235978 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e07fd8-6fe0-40fa-a46a-7663a787fd22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:58.237687 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e07fd8-6fe0-40fa-a46a-7663a787fd22 service swift] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:58.247304 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 934/1872] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Nov 2 20:31:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 20:31:58.987350 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54f669-b2be-4191-b94d-9537ea0a388b None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:58.988809 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54f669-b2be-4191-b94d-9537ea0a388b None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:58.990080 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54f669-b2be-4191-b94d-9537ea0a388b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:59.016886 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-db54f669-b2be-4191-b94d-9537ea0a388b None None] MFA Rules not processed for user `66937804f65147f392f4ddfc3e961d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:59.018183 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-db54f669-b2be-4191-b94d-9537ea0a388b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:59.027001 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 939/1873] 10.222.0.23 () {58 vars in 967 bytes} [Wed Nov 2 20:31:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:59.050102 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e07fd8-6fe0-40fa-a46a-7663a787fd22 service swift] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:59.075397 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e07fd8-6fe0-40fa-a46a-7663a787fd22 service swift] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:59.099346 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93ba75-f262-4272-b252-c4a34f8612ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f22f80ac694e9888c132af1e58e292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:59.100160 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93ba75-f262-4272-b252-c4a34f8612ed service swift] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:59.100862 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93ba75-f262-4272-b252-c4a34f8612ed service swift] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:59.101160 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93ba75-f262-4272-b252-c4a34f8612ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:59.110514 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93ba75-f262-4272-b252-c4a34f8612ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:59.112115 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93ba75-f262-4272-b252-c4a34f8612ed service swift] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:59.122698 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 935/1874] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Nov 2 20:31:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 20:31:59.473502 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e805b8-739e-41c2-8774-da6d23607c9f None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:59.473910 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e805b8-739e-41c2-8774-da6d23607c9f None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:59.474291 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e805b8-739e-41c2-8774-da6d23607c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:59.498432 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93ba75-f262-4272-b252-c4a34f8612ed service swift] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:59.499960 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-5e93ba75-f262-4272-b252-c4a34f8612ed service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:59.554291 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-f4e805b8-739e-41c2-8774-da6d23607c9f None None] MFA Rules not processed for user `66937804f65147f392f4ddfc3e961d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:31:59.556761 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-f4e805b8-739e-41c2-8774-da6d23607c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:31:59.568761 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 940/1875] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Nov 2 20:31:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:31:59.583935 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e805b8-739e-41c2-8774-da6d23607c9f None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:31:59.621793 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e805b8-739e-41c2-8774-da6d23607c9f None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:59.630961 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b43cb0-feb5-4f93-b930-999d6640b48a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f22f80ac694e9888c132af1e58e292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:59.631635 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b43cb0-feb5-4f93-b930-999d6640b48a service swift] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:59.631923 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b43cb0-feb5-4f93-b930-999d6640b48a service swift] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:59.632204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b43cb0-feb5-4f93-b930-999d6640b48a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:59.639135 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93ba75-f262-4272-b252-c4a34f8612ed service swift] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:31:59.646482 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cb694-5590-4b2c-88f2-e4f9985f7bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:31:59.646679 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b43cb0-feb5-4f93-b930-999d6640b48a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:59.647702 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cb694-5590-4b2c-88f2-e4f9985f7bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:31:59.648167 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cb694-5590-4b2c-88f2-e4f9985f7bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:31:59.648756 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cb694-5590-4b2c-88f2-e4f9985f7bc6 admin admin] PATH_INFO: `/v3/users/2aa96af0e5cd47248b91910171bb66b5` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:31:59.649253 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b43cb0-feb5-4f93-b930-999d6640b48a service swift] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:59.650999 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0cb694-5590-4b2c-88f2-e4f9985f7bc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aa96af0e5cd47248b91910171bb66b5)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:31:59.654883 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0cb694-5590-4b2c-88f2-e4f9985f7bc6 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:31:59.664074 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 941/1876] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Nov 2 20:31:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 20:31:59.727657 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4f0cb694-5590-4b2c-88f2-e4f9985f7bc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aa96af0e5cd47248b91910171bb66b5'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:59.728514 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4f0cb694-5590-4b2c-88f2-e4f9985f7bc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aa96af0e5cd47248b91910171bb66b5'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:59.744417 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4f0cb694-5590-4b2c-88f2-e4f9985f7bc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aa96af0e5cd47248b91910171bb66b5'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:59.745354 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4f0cb694-5590-4b2c-88f2-e4f9985f7bc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aa96af0e5cd47248b91910171bb66b5'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:59.753555 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4f0cb694-5590-4b2c-88f2-e4f9985f7bc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aa96af0e5cd47248b91910171bb66b5'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:31:59.782380 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 936/1877] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:31:59 2022] DELETE /identity/v3/users/2aa96af0e5cd47248b91910171bb66b5 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:32:00.069108 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b43cb0-feb5-4f93-b930-999d6640b48a service swift] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:00.087994 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b43cb0-feb5-4f93-b930-999d6640b48a service swift] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:00.188366 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bc2e0-3619-472e-beff-19c027a435fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:00.189055 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bc2e0-3619-472e-beff-19c027a435fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:00.189339 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bc2e0-3619-472e-beff-19c027a435fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:00.189619 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bc2e0-3619-472e-beff-19c027a435fd admin admin] PATH_INFO: `/v3/projects/fba56766600d430da6ccd3c3e79997ee` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:00.190766 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4bc2e0-3619-472e-beff-19c027a435fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fba56766600d430da6ccd3c3e79997ee)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:00.192790 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4bc2e0-3619-472e-beff-19c027a435fd admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:00.228778 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:00.244320 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-9f4bc2e0-3619-472e-beff-19c027a435fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fba56766600d430da6ccd3c3e79997ee', 'request_id': 'req-9f4bc2e0-3619-472e-beff-19c027a435fd'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:00.246254 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c58de-f141-4c83-85fc-d7b3283e5718 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:00.246564 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c58de-f141-4c83-85fc-d7b3283e5718 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:00.246845 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c58de-f141-4c83-85fc-d7b3283e5718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:00.255695 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-9f4bc2e0-3619-472e-beff-19c027a435fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fba56766600d430da6ccd3c3e79997ee', 'request_id': 'req-9f4bc2e0-3619-472e-beff-19c027a435fd'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:00.264325 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-9f4bc2e0-3619-472e-beff-19c027a435fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fba56766600d430da6ccd3c3e79997ee', 'request_id': 'req-9f4bc2e0-3619-472e-beff-19c027a435fd'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:00.267786 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-382c58de-f141-4c83-85fc-d7b3283e5718 None None] MFA Rules not processed for user `66937804f65147f392f4ddfc3e961d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:00.269091 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-382c58de-f141-4c83-85fc-d7b3283e5718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:00.276238 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-9f4bc2e0-3619-472e-beff-19c027a435fd admin admin] The token cache is being invalidate because project fba56766600d430da6ccd3c3e79997ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:32:00.276533 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-9f4bc2e0-3619-472e-beff-19c027a435fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:00.277232 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-9f4bc2e0-3619-472e-beff-19c027a435fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:00.278994 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 942/1878] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:32:00 2022] DELETE /identity/v3/projects/fba56766600d430da6ccd3c3e79997ee => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:32:00.282814 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bc2e0-3619-472e-beff-19c027a435fd admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:00.284288 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-9f4bc2e0-3619-472e-beff-19c027a435fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:00.297055 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:00.331254 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 937/1879] 10.222.0.23 () {58 vars in 967 bytes} [Wed Nov 2 20:32:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:32:00.343768 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c58de-f141-4c83-85fc-d7b3283e5718 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:00.345187 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-382c58de-f141-4c83-85fc-d7b3283e5718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:00.354516 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bc2e0-3619-472e-beff-19c027a435fd admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:00.360807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8053027-4df2-4e28-ae01-6cb17a5a64cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:00.361555 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8053027-4df2-4e28-ae01-6cb17a5a64cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:00.361847 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8053027-4df2-4e28-ae01-6cb17a5a64cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:00.362130 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8053027-4df2-4e28-ae01-6cb17a5a64cc admin admin] PATH_INFO: `/v3/users/42faf3691c8745fa89eb7f49aec3a8ca` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:00.363336 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8053027-4df2-4e28-ae01-6cb17a5a64cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=42faf3691c8745fa89eb7f49aec3a8ca)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:00.365382 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8053027-4df2-4e28-ae01-6cb17a5a64cc admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:00.416447 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-a8053027-4df2-4e28-ae01-6cb17a5a64cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42faf3691c8745fa89eb7f49aec3a8ca'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:00.417449 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-a8053027-4df2-4e28-ae01-6cb17a5a64cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42faf3691c8745fa89eb7f49aec3a8ca'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:00.426304 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-a8053027-4df2-4e28-ae01-6cb17a5a64cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42faf3691c8745fa89eb7f49aec3a8ca'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:00.426976 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-a8053027-4df2-4e28-ae01-6cb17a5a64cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42faf3691c8745fa89eb7f49aec3a8ca'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:00.431038 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c58de-f141-4c83-85fc-d7b3283e5718 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:00.436239 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7b8e0-4d3f-4067-a504-41d8d17dd68e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f22f80ac694e9888c132af1e58e292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:00.436891 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7b8e0-4d3f-4067-a504-41d8d17dd68e service swift] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:00.437172 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7b8e0-4d3f-4067-a504-41d8d17dd68e service swift] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:00.437447 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7b8e0-4d3f-4067-a504-41d8d17dd68e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:00.439893 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-f5d7b8e0-4d3f-4067-a504-41d8d17dd68e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:00.440132 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-a8053027-4df2-4e28-ae01-6cb17a5a64cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42faf3691c8745fa89eb7f49aec3a8ca'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:00.451487 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7b8e0-4d3f-4067-a504-41d8d17dd68e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:00.453193 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7b8e0-4d3f-4067-a504-41d8d17dd68e service swift] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:00.453556 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 943/1880] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:32:00 2022] DELETE /identity/v3/users/42faf3691c8745fa89eb7f49aec3a8ca => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:32:00.462139 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 938/1881] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Nov 2 20:32:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 20:32:00.644760 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8053027-4df2-4e28-ae01-6cb17a5a64cc admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:00.646340 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-a8053027-4df2-4e28-ae01-6cb17a5a64cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:00.698384 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:00.733829 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8053027-4df2-4e28-ae01-6cb17a5a64cc admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:00.738695 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589f81e-db7e-45ee-ac5c-f1e602e160e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:00.739416 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589f81e-db7e-45ee-ac5c-f1e602e160e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:00.739769 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589f81e-db7e-45ee-ac5c-f1e602e160e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:00.740116 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589f81e-db7e-45ee-ac5c-f1e602e160e6 admin admin] PATH_INFO: `/v3/projects/9c38219a711348d291c745b61712b00f` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:00.741282 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589f81e-db7e-45ee-ac5c-f1e602e160e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c38219a711348d291c745b61712b00f)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:00.743184 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589f81e-db7e-45ee-ac5c-f1e602e160e6 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:00.793925 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-d589f81e-db7e-45ee-ac5c-f1e602e160e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c38219a711348d291c745b61712b00f', 'request_id': 'req-d589f81e-db7e-45ee-ac5c-f1e602e160e6'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:00.801380 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-d589f81e-db7e-45ee-ac5c-f1e602e160e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c38219a711348d291c745b61712b00f', 'request_id': 'req-d589f81e-db7e-45ee-ac5c-f1e602e160e6'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:00.809564 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-d589f81e-db7e-45ee-ac5c-f1e602e160e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c38219a711348d291c745b61712b00f', 'request_id': 'req-d589f81e-db7e-45ee-ac5c-f1e602e160e6'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:00.823766 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-d589f81e-db7e-45ee-ac5c-f1e602e160e6 admin admin] The token cache is being invalidate because project 9c38219a711348d291c745b61712b00f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:32:00.824114 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-d589f81e-db7e-45ee-ac5c-f1e602e160e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:00.824874 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-d589f81e-db7e-45ee-ac5c-f1e602e160e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:00.827329 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 944/1882] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:32:00 2022] DELETE /identity/v3/projects/9c38219a711348d291c745b61712b00f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:32:00.833012 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5477a39-0a7f-4762-b24a-612d4099ef38 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:00.833907 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5477a39-0a7f-4762-b24a-612d4099ef38 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:00.834184 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5477a39-0a7f-4762-b24a-612d4099ef38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:00.853673 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-e5477a39-0a7f-4762-b24a-612d4099ef38 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:00.854885 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-e5477a39-0a7f-4762-b24a-612d4099ef38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:00.937221 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 939/1883] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:32:00.945861 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4a409-3417-480e-8986-07dec124c7fe None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:00.946156 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4a409-3417-480e-8986-07dec124c7fe None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:00.946943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4a409-3417-480e-8986-07dec124c7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:00.968335 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-5aa4a409-3417-480e-8986-07dec124c7fe None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:00.969632 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-5aa4a409-3417-480e-8986-07dec124c7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:00.980072 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 945/1884] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:32:00.984611 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5477a39-0a7f-4762-b24a-612d4099ef38 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:00.998696 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5477a39-0a7f-4762-b24a-612d4099ef38 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:01.009810 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2b5f0-4ea1-4ffd-81ba-71a0a0003a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:01.009810 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2b5f0-4ea1-4ffd-81ba-71a0a0003a13 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:01.009810 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2b5f0-4ea1-4ffd-81ba-71a0a0003a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:01.009810 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2b5f0-4ea1-4ffd-81ba-71a0a0003a13 admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:01.010342 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2b5f0-4ea1-4ffd-81ba-71a0a0003a13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:32:01.010342 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2b5f0-4ea1-4ffd-81ba-71a0a0003a13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:01.010342 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2b5f0-4ea1-4ffd-81ba-71a0a0003a13 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:01.028400 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4a409-3417-480e-8986-07dec124c7fe None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:01.032703 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 940/1885] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:32:01.039254 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4a409-3417-480e-8986-07dec124c7fe None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:01.044490 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42febb1-f9b3-48b5-828d-3eacd9d2ad9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:01.045332 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42febb1-f9b3-48b5-828d-3eacd9d2ad9a admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:01.045768 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42febb1-f9b3-48b5-828d-3eacd9d2ad9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:01.046192 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42febb1-f9b3-48b5-828d-3eacd9d2ad9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:01.046972 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42febb1-f9b3-48b5-828d-3eacd9d2ad9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:01.049680 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42febb1-f9b3-48b5-828d-3eacd9d2ad9a admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:01.084499 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 946/1886] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:32:01 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:32:01.085483 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2b5f0-4ea1-4ffd-81ba-71a0a0003a13 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:01.095996 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2b5f0-4ea1-4ffd-81ba-71a0a0003a13 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:01.153925 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:01.185383 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525f013-ec38-4390-a9f0-ab65ec4b0016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:01.189588 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525f013-ec38-4390-a9f0-ab65ec4b0016 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:01.190084 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525f013-ec38-4390-a9f0-ab65ec4b0016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:01.191607 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525f013-ec38-4390-a9f0-ab65ec4b0016 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:01.193315 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9525f013-ec38-4390-a9f0-ab65ec4b0016 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:01.196093 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9525f013-ec38-4390-a9f0-ab65ec4b0016 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:01.229235 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 941/1887] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:32:01 2022] POST /identity/v3/users => generated 288 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:32:01.231517 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42febb1-f9b3-48b5-828d-3eacd9d2ad9a admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:01.244663 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42febb1-f9b3-48b5-828d-3eacd9d2ad9a admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:01.252087 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d2b7c-66fe-416d-bb37-a2f4974459bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:01.252754 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d2b7c-66fe-416d-bb37-a2f4974459bb admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:01.253035 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d2b7c-66fe-416d-bb37-a2f4974459bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:01.253310 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d2b7c-66fe-416d-bb37-a2f4974459bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:01.253959 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d2b7c-66fe-416d-bb37-a2f4974459bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:01.255556 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d2b7c-66fe-416d-bb37-a2f4974459bb admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:01.268112 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 947/1888] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:32:01.272667 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525f013-ec38-4390-a9f0-ab65ec4b0016 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:01.285187 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525f013-ec38-4390-a9f0-ab65ec4b0016 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:01.290779 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b32396-6f4c-4f2e-a500-1147661f08b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:01.291349 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b32396-6f4c-4f2e-a500-1147661f08b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:01.291632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b32396-6f4c-4f2e-a500-1147661f08b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:01.291906 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b32396-6f4c-4f2e-a500-1147661f08b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:01.292616 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b32396-6f4c-4f2e-a500-1147661f08b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:01.294247 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b32396-6f4c-4f2e-a500-1147661f08b6 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:01.308272 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 942/1889] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:32:01.313812 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d2b7c-66fe-416d-bb37-a2f4974459bb admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:01.341395 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d2b7c-66fe-416d-bb37-a2f4974459bb admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:01.348275 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fa807-a0dd-4f6c-852c-bfe2275f5186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:01.349301 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fa807-a0dd-4f6c-852c-bfe2275f5186 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:01.349760 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fa807-a0dd-4f6c-852c-bfe2275f5186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:01.350505 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fa807-a0dd-4f6c-852c-bfe2275f5186 admin admin] PATH_INFO: `/v3/projects/ccd959cfcbf9478c83adf27adf24ee2f/users/2719c6355eda4e01af3f32b83c98e8da/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:01.374328 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19fa807-a0dd-4f6c-852c-bfe2275f5186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd959cfcbf9478c83adf27adf24ee2f, user_id=2719c6355eda4e01af3f32b83c98e8da, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:01.377175 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19fa807-a0dd-4f6c-852c-bfe2275f5186 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:01.393753 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 948/1890] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:32:01 2022] PUT /identity/v3/projects/ccd959cfcbf9478c83adf27adf24ee2f/users/2719c6355eda4e01af3f32b83c98e8da/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:32:01.404347 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95e8db-525a-4cc8-9bd3-87a3f2b9d316 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:01.404983 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95e8db-525a-4cc8-9bd3-87a3f2b9d316 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:01.405385 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95e8db-525a-4cc8-9bd3-87a3f2b9d316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:01.438088 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-7d95e8db-525a-4cc8-9bd3-87a3f2b9d316 None None] MFA Rules not processed for user `2719c6355eda4e01af3f32b83c98e8da`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:01.439329 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-7d95e8db-525a-4cc8-9bd3-87a3f2b9d316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:01.533864 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 943/1891] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:32:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:32:01.550264 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fa807-a0dd-4f6c-852c-bfe2275f5186 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:01.552287 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-d19fa807-a0dd-4f6c-852c-bfe2275f5186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:01.633508 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fa807-a0dd-4f6c-852c-bfe2275f5186 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:01.643838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ba943-2151-482a-9504-e1d52eb2585a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62ca656e59ff46b08661385d8ec79846', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:01.644707 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ba943-2151-482a-9504-e1d52eb2585a service glance] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:01.645126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ba943-2151-482a-9504-e1d52eb2585a service glance] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:01.645412 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ba943-2151-482a-9504-e1d52eb2585a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:01.656114 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ba943-2151-482a-9504-e1d52eb2585a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:01.658307 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ba943-2151-482a-9504-e1d52eb2585a service glance] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:01.670168 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 949/1892] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:32:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 20:32:02.779465 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95e8db-525a-4cc8-9bd3-87a3f2b9d316 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:02.781134 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-7d95e8db-525a-4cc8-9bd3-87a3f2b9d316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:02.854198 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95e8db-525a-4cc8-9bd3-87a3f2b9d316 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:02.858829 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e49dc-9e6e-4974-98fe-a9a2a1c2fdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:02.859453 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e49dc-9e6e-4974-98fe-a9a2a1c2fdea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:02.859735 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e49dc-9e6e-4974-98fe-a9a2a1c2fdea admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:02.860517 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e49dc-9e6e-4974-98fe-a9a2a1c2fdea admin admin] PATH_INFO: `/v3/users/baf8e28eb7f14eeda6977e80e518666e` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:02.861766 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e49dc-9e6e-4974-98fe-a9a2a1c2fdea admin admin] RBAC: Authorizing `identity:delete_user(user_id=baf8e28eb7f14eeda6977e80e518666e)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:02.863793 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e49dc-9e6e-4974-98fe-a9a2a1c2fdea admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:02.916471 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-188e49dc-9e6e-4974-98fe-a9a2a1c2fdea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baf8e28eb7f14eeda6977e80e518666e'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:02.917166 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-188e49dc-9e6e-4974-98fe-a9a2a1c2fdea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baf8e28eb7f14eeda6977e80e518666e'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:02.928769 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:02.931373 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-188e49dc-9e6e-4974-98fe-a9a2a1c2fdea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baf8e28eb7f14eeda6977e80e518666e'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:02.932160 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-188e49dc-9e6e-4974-98fe-a9a2a1c2fdea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baf8e28eb7f14eeda6977e80e518666e'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:02.940689 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-188e49dc-9e6e-4974-98fe-a9a2a1c2fdea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baf8e28eb7f14eeda6977e80e518666e'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:02.956229 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 944/1893] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:32:02 2022] DELETE /identity/v3/users/baf8e28eb7f14eeda6977e80e518666e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:32:02.960773 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48239e59-4adc-4f28-b842-7c0f323e2cd8 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:02.961256 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48239e59-4adc-4f28-b842-7c0f323e2cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:02.961377 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48239e59-4adc-4f28-b842-7c0f323e2cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:02.975126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:02.981682 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-48239e59-4adc-4f28-b842-7c0f323e2cd8 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:02.983496 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-48239e59-4adc-4f28-b842-7c0f323e2cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:03.043205 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 950/1894] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:32:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:32:03.053736 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e49dc-9e6e-4974-98fe-a9a2a1c2fdea admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:03.055123 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-188e49dc-9e6e-4974-98fe-a9a2a1c2fdea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:03.112923 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e49dc-9e6e-4974-98fe-a9a2a1c2fdea admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:03.116583 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59535a1-38d6-48bb-932f-6ea1244825f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:03.117200 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59535a1-38d6-48bb-932f-6ea1244825f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:03.117484 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59535a1-38d6-48bb-932f-6ea1244825f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:03.117760 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59535a1-38d6-48bb-932f-6ea1244825f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:03.127305 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59535a1-38d6-48bb-932f-6ea1244825f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:03.128838 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59535a1-38d6-48bb-932f-6ea1244825f3 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:03.139108 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 945/1895] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:32:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:32:03.337327 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48239e59-4adc-4f28-b842-7c0f323e2cd8 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:03.340080 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-48239e59-4adc-4f28-b842-7c0f323e2cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:03.392184 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48239e59-4adc-4f28-b842-7c0f323e2cd8 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:03.401778 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf9726-9990-4e6a-a781-80a47d3f5856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:03.402667 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf9726-9990-4e6a-a781-80a47d3f5856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:03.402947 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf9726-9990-4e6a-a781-80a47d3f5856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:03.406529 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf9726-9990-4e6a-a781-80a47d3f5856 admin admin] PATH_INFO: `/v3/projects/e40622571042492b93c82d7b88f2e187` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:03.408479 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf9726-9990-4e6a-a781-80a47d3f5856 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e40622571042492b93c82d7b88f2e187)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:03.412568 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf9726-9990-4e6a-a781-80a47d3f5856 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:03.492966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-a8cf9726-9990-4e6a-a781-80a47d3f5856 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e40622571042492b93c82d7b88f2e187', 'request_id': 'req-a8cf9726-9990-4e6a-a781-80a47d3f5856'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:03.500050 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-a8cf9726-9990-4e6a-a781-80a47d3f5856 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e40622571042492b93c82d7b88f2e187', 'request_id': 'req-a8cf9726-9990-4e6a-a781-80a47d3f5856'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:03.509015 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-a8cf9726-9990-4e6a-a781-80a47d3f5856 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e40622571042492b93c82d7b88f2e187', 'request_id': 'req-a8cf9726-9990-4e6a-a781-80a47d3f5856'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:03.529298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-a8cf9726-9990-4e6a-a781-80a47d3f5856 admin admin] The token cache is being invalidate because project e40622571042492b93c82d7b88f2e187 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:32:03.529589 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-a8cf9726-9990-4e6a-a781-80a47d3f5856 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:03.532303 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-a8cf9726-9990-4e6a-a781-80a47d3f5856 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:03.533992 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 951/1896] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:32:03 2022] DELETE /identity/v3/projects/e40622571042492b93c82d7b88f2e187 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:32:03.538839 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aebeae-9abb-4568-b990-941e12cc7044 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:03.539130 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aebeae-9abb-4568-b990-941e12cc7044 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:03.539405 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aebeae-9abb-4568-b990-941e12cc7044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:03.559450 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-30aebeae-9abb-4568-b990-941e12cc7044 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:03.561105 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-30aebeae-9abb-4568-b990-941e12cc7044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:03.632599 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 946/1897] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:32:03.639379 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0ed71-e212-43f5-ad68-cce5d5fc8ad0 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:03.639634 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0ed71-e212-43f5-ad68-cce5d5fc8ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:03.639919 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0ed71-e212-43f5-ad68-cce5d5fc8ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:03.663325 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-f1b0ed71-e212-43f5-ad68-cce5d5fc8ad0 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:03.665578 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-f1b0ed71-e212-43f5-ad68-cce5d5fc8ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:03.679166 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 952/1898] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:32:03.682273 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aebeae-9abb-4568-b990-941e12cc7044 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:03.699507 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aebeae-9abb-4568-b990-941e12cc7044 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:03.710412 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a22c47-4798-4d67-8198-40ae5616cc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:03.711181 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a22c47-4798-4d67-8198-40ae5616cc64 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:03.711532 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a22c47-4798-4d67-8198-40ae5616cc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:03.711876 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a22c47-4798-4d67-8198-40ae5616cc64 admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:03.712976 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a22c47-4798-4d67-8198-40ae5616cc64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:32:03.713719 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a22c47-4798-4d67-8198-40ae5616cc64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:03.715369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a22c47-4798-4d67-8198-40ae5616cc64 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:03.730607 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 947/1899] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:32:03.735882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0ed71-e212-43f5-ad68-cce5d5fc8ad0 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:03.745610 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0ed71-e212-43f5-ad68-cce5d5fc8ad0 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:03.752850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddac17d-d826-419b-86ee-223be90cbc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:03.753643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddac17d-d826-419b-86ee-223be90cbc17 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:03.754005 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddac17d-d826-419b-86ee-223be90cbc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:03.754319 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddac17d-d826-419b-86ee-223be90cbc17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:03.755039 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddac17d-d826-419b-86ee-223be90cbc17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:03.757005 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddac17d-d826-419b-86ee-223be90cbc17 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:03.793691 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 953/1900] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:32:03 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:32:03.794508 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a22c47-4798-4d67-8198-40ae5616cc64 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:03.805529 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a22c47-4798-4d67-8198-40ae5616cc64 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:03.866567 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bcbb5-fb9f-4067-8722-9ece64918eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:03.867183 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bcbb5-fb9f-4067-8722-9ece64918eac admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:03.867473 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bcbb5-fb9f-4067-8722-9ece64918eac admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:03.867751 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bcbb5-fb9f-4067-8722-9ece64918eac admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:03.868398 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0bcbb5-fb9f-4067-8722-9ece64918eac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:03.870372 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0bcbb5-fb9f-4067-8722-9ece64918eac admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:03.886339 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:03.894232 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 948/1901] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:32:03 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:32:03.898455 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddac17d-d826-419b-86ee-223be90cbc17 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:03.910111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddac17d-d826-419b-86ee-223be90cbc17 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:03.914827 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17acee02-3cfd-497f-85bd-50a6c773b4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:03.915434 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acee02-3cfd-497f-85bd-50a6c773b4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:03.915723 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acee02-3cfd-497f-85bd-50a6c773b4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:03.916005 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acee02-3cfd-497f-85bd-50a6c773b4b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:03.916690 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17acee02-3cfd-497f-85bd-50a6c773b4b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:03.918288 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17acee02-3cfd-497f-85bd-50a6c773b4b7 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:03.929471 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 954/1902] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:32:03.933266 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bcbb5-fb9f-4067-8722-9ece64918eac admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:03.943267 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bcbb5-fb9f-4067-8722-9ece64918eac admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:03.947939 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefaa9c-4e30-4ab7-8455-67bbac3c5dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:03.948538 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefaa9c-4e30-4ab7-8455-67bbac3c5dad admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:03.948856 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefaa9c-4e30-4ab7-8455-67bbac3c5dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:03.949135 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefaa9c-4e30-4ab7-8455-67bbac3c5dad admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:03.949783 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eefaa9c-4e30-4ab7-8455-67bbac3c5dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:03.951385 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eefaa9c-4e30-4ab7-8455-67bbac3c5dad admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:03.962648 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 949/1903] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:32:03.966935 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17acee02-3cfd-497f-85bd-50a6c773b4b7 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:03.977774 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17acee02-3cfd-497f-85bd-50a6c773b4b7 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:03.982810 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a2680-2d1d-4722-badb-b12cc8266f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:03.983505 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a2680-2d1d-4722-badb-b12cc8266f4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:03.983792 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a2680-2d1d-4722-badb-b12cc8266f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:03.984074 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a2680-2d1d-4722-badb-b12cc8266f4b admin admin] PATH_INFO: `/v3/projects/0e2310edb12c4410a499ddd4ea201fb5/users/7f47aaae28384df9a675fc4b950cc1f7/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:04.001263 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a2680-2d1d-4722-badb-b12cc8266f4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e2310edb12c4410a499ddd4ea201fb5, user_id=7f47aaae28384df9a675fc4b950cc1f7, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:04.004231 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a2680-2d1d-4722-badb-b12cc8266f4b admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:04.018579 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 955/1904] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:32:03 2022] PUT /identity/v3/projects/0e2310edb12c4410a499ddd4ea201fb5/users/7f47aaae28384df9a675fc4b950cc1f7/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:32:04.024503 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9914b-8a08-4305-924e-156300cdc5f0 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:04.024817 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9914b-8a08-4305-924e-156300cdc5f0 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:04.025101 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9914b-8a08-4305-924e-156300cdc5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:04.045597 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-bba9914b-8a08-4305-924e-156300cdc5f0 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:04.046806 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-bba9914b-8a08-4305-924e-156300cdc5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:04.105903 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 950/1905] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:32:04.116268 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a2680-2d1d-4722-badb-b12cc8266f4b admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:04.118054 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-d77a2680-2d1d-4722-badb-b12cc8266f4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:04.153212 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:04.183011 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a2680-2d1d-4722-badb-b12cc8266f4b admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:04.186679 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf89a0-f9af-413e-b007-1ca6a1b81672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:04.187281 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf89a0-f9af-413e-b007-1ca6a1b81672 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:04.187565 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf89a0-f9af-413e-b007-1ca6a1b81672 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:04.187839 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf89a0-f9af-413e-b007-1ca6a1b81672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:04.197297 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf89a0-f9af-413e-b007-1ca6a1b81672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:04.198723 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf89a0-f9af-413e-b007-1ca6a1b81672 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:04.208999 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 956/1906] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:32:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:32:07.178405 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9914b-8a08-4305-924e-156300cdc5f0 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:07.180058 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-bba9914b-8a08-4305-924e-156300cdc5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:07.198955 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9914b-8a08-4305-924e-156300cdc5f0 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:07.205612 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952feb08-370c-4f36-b5b2-6c26cd5bf6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:07.206264 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952feb08-370c-4f36-b5b2-6c26cd5bf6e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:07.206553 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952feb08-370c-4f36-b5b2-6c26cd5bf6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:07.206831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952feb08-370c-4f36-b5b2-6c26cd5bf6e7 admin admin] PATH_INFO: `/v3/users/b3b36da361c84e03b765d92d4fbd68a7` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:07.211131 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952feb08-370c-4f36-b5b2-6c26cd5bf6e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3b36da361c84e03b765d92d4fbd68a7)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:07.213194 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952feb08-370c-4f36-b5b2-6c26cd5bf6e7 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:07.292468 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-952feb08-370c-4f36-b5b2-6c26cd5bf6e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3b36da361c84e03b765d92d4fbd68a7'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:07.293523 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-952feb08-370c-4f36-b5b2-6c26cd5bf6e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3b36da361c84e03b765d92d4fbd68a7'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:07.312726 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-952feb08-370c-4f36-b5b2-6c26cd5bf6e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3b36da361c84e03b765d92d4fbd68a7'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:07.314527 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-952feb08-370c-4f36-b5b2-6c26cd5bf6e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3b36da361c84e03b765d92d4fbd68a7'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:07.323571 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-952feb08-370c-4f36-b5b2-6c26cd5bf6e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3b36da361c84e03b765d92d4fbd68a7'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:07.348737 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 951/1907] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:32:07 2022] DELETE /identity/v3/users/b3b36da361c84e03b765d92d4fbd68a7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:32:07.349871 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d03cfe-6f7f-4ceb-a1a4-2227bc3273e7 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:07.350495 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d03cfe-6f7f-4ceb-a1a4-2227bc3273e7 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:07.350495 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d03cfe-6f7f-4ceb-a1a4-2227bc3273e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:07.390161 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-c9d03cfe-6f7f-4ceb-a1a4-2227bc3273e7 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:07.392037 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-c9d03cfe-6f7f-4ceb-a1a4-2227bc3273e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:07.533409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 957/1908] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:32:07.538302 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952feb08-370c-4f36-b5b2-6c26cd5bf6e7 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:07.539770 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-952feb08-370c-4f36-b5b2-6c26cd5bf6e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:07.654015 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952feb08-370c-4f36-b5b2-6c26cd5bf6e7 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:07.658552 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381fb16-b213-4f3b-aacd-b2c8c5b943ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:07.659271 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381fb16-b213-4f3b-aacd-b2c8c5b943ea service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:07.659641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381fb16-b213-4f3b-aacd-b2c8c5b943ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:07.661537 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381fb16-b213-4f3b-aacd-b2c8c5b943ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:07.672174 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9381fb16-b213-4f3b-aacd-b2c8c5b943ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:07.674117 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9381fb16-b213-4f3b-aacd-b2c8c5b943ea service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:07.685503 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 952/1909] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:32:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:32:08.123759 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d03cfe-6f7f-4ceb-a1a4-2227bc3273e7 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:08.127109 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-c9d03cfe-6f7f-4ceb-a1a4-2227bc3273e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:08.145625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d03cfe-6f7f-4ceb-a1a4-2227bc3273e7 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:08.152870 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d54ce-ed0f-4822-9278-c455166b1376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:08.153708 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d54ce-ed0f-4822-9278-c455166b1376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:08.154045 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d54ce-ed0f-4822-9278-c455166b1376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:08.154584 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d54ce-ed0f-4822-9278-c455166b1376 admin admin] PATH_INFO: `/v3/projects/7929d3662b6b48e59a13264eaba95006` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:08.155572 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d54ce-ed0f-4822-9278-c455166b1376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7929d3662b6b48e59a13264eaba95006)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:08.159620 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d54ce-ed0f-4822-9278-c455166b1376 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:08.229803 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-dc7d54ce-ed0f-4822-9278-c455166b1376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7929d3662b6b48e59a13264eaba95006', 'request_id': 'req-dc7d54ce-ed0f-4822-9278-c455166b1376'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:08.242359 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-dc7d54ce-ed0f-4822-9278-c455166b1376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7929d3662b6b48e59a13264eaba95006', 'request_id': 'req-dc7d54ce-ed0f-4822-9278-c455166b1376'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:08.258174 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-dc7d54ce-ed0f-4822-9278-c455166b1376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7929d3662b6b48e59a13264eaba95006', 'request_id': 'req-dc7d54ce-ed0f-4822-9278-c455166b1376'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:08.271360 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-dc7d54ce-ed0f-4822-9278-c455166b1376 admin admin] The token cache is being invalidate because project 7929d3662b6b48e59a13264eaba95006 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:32:08.271959 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-dc7d54ce-ed0f-4822-9278-c455166b1376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:08.273028 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-dc7d54ce-ed0f-4822-9278-c455166b1376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:08.276623 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 958/1910] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:32:08 2022] DELETE /identity/v3/projects/7929d3662b6b48e59a13264eaba95006 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:32:09.144214 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694b63c-b543-4b3f-8277-f1fa6b9ccf00 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:09.144820 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694b63c-b543-4b3f-8277-f1fa6b9ccf00 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:09.144820 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694b63c-b543-4b3f-8277-f1fa6b9ccf00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:09.153446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:09.185449 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-5694b63c-b543-4b3f-8277-f1fa6b9ccf00 None None] MFA Rules not processed for user `7f47aaae28384df9a675fc4b950cc1f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:09.186719 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-5694b63c-b543-4b3f-8277-f1fa6b9ccf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:09.262390 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 953/1911] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:32:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:32:09.267017 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d54ce-ed0f-4822-9278-c455166b1376 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:09.268653 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-dc7d54ce-ed0f-4822-9278-c455166b1376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:09.348414 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:09.363868 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d54ce-ed0f-4822-9278-c455166b1376 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:09.370116 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdb402-75e1-4b92-b8e2-2a64c23191f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:09.373390 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdb402-75e1-4b92-b8e2-2a64c23191f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:09.373390 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdb402-75e1-4b92-b8e2-2a64c23191f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:09.373390 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdb402-75e1-4b92-b8e2-2a64c23191f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:09.373390 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bdb402-75e1-4b92-b8e2-2a64c23191f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:09.374048 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bdb402-75e1-4b92-b8e2-2a64c23191f1 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:09.404367 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 959/1912] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:32:09 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:32:09.409156 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694b63c-b543-4b3f-8277-f1fa6b9ccf00 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:09.424666 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694b63c-b543-4b3f-8277-f1fa6b9ccf00 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:09.501543 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae0a0a-2496-4674-8453-3f244c0a4186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:09.502170 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae0a0a-2496-4674-8453-3f244c0a4186 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:09.502456 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae0a0a-2496-4674-8453-3f244c0a4186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:09.502733 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae0a0a-2496-4674-8453-3f244c0a4186 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:09.503377 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae0a0a-2496-4674-8453-3f244c0a4186 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:09.505409 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae0a0a-2496-4674-8453-3f244c0a4186 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:09.534167 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 954/1913] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:32:09 2022] POST /identity/v3/users => generated 298 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:32:09.538413 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdb402-75e1-4b92-b8e2-2a64c23191f1 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:09.552167 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdb402-75e1-4b92-b8e2-2a64c23191f1 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:09.557370 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657abb00-e97c-4827-b976-a6a008ded92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:09.558013 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657abb00-e97c-4827-b976-a6a008ded92f admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:09.558304 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657abb00-e97c-4827-b976-a6a008ded92f admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:09.558583 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657abb00-e97c-4827-b976-a6a008ded92f admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:09.559243 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657abb00-e97c-4827-b976-a6a008ded92f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:09.560900 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657abb00-e97c-4827-b976-a6a008ded92f admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:09.573176 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 960/1914] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:32:09.577678 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae0a0a-2496-4674-8453-3f244c0a4186 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:09.589131 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae0a0a-2496-4674-8453-3f244c0a4186 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:09.594698 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea62183-65ea-476a-8b6d-0ae3542fc46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:09.595390 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea62183-65ea-476a-8b6d-0ae3542fc46f admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:09.595777 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea62183-65ea-476a-8b6d-0ae3542fc46f admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:09.596136 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea62183-65ea-476a-8b6d-0ae3542fc46f admin admin] PATH_INFO: `/v3/projects/b94cf19702fa4b96aa1f6f98c8a49a2e/users/0293ac8472674b9a9220fc88b0d67e02/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:09.614175 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea62183-65ea-476a-8b6d-0ae3542fc46f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b94cf19702fa4b96aa1f6f98c8a49a2e, user_id=0293ac8472674b9a9220fc88b0d67e02, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:09.617187 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea62183-65ea-476a-8b6d-0ae3542fc46f admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:09.633919 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 955/1915] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:32:09 2022] PUT /identity/v3/projects/b94cf19702fa4b96aa1f6f98c8a49a2e/users/0293ac8472674b9a9220fc88b0d67e02/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:32:09.637842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657abb00-e97c-4827-b976-a6a008ded92f admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:09.651530 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657abb00-e97c-4827-b976-a6a008ded92f admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:09.733564 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba31e3-14be-44f9-8cc6-1ea9b84b3030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:09.734219 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba31e3-14be-44f9-8cc6-1ea9b84b3030 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:09.734481 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba31e3-14be-44f9-8cc6-1ea9b84b3030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:09.734763 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba31e3-14be-44f9-8cc6-1ea9b84b3030 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:09.736192 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba31e3-14be-44f9-8cc6-1ea9b84b3030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:09.738082 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba31e3-14be-44f9-8cc6-1ea9b84b3030 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:09.765302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 961/1916] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:32:09.769433 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea62183-65ea-476a-8b6d-0ae3542fc46f admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:09.780690 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea62183-65ea-476a-8b6d-0ae3542fc46f admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:09.786717 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd3f97-0a5e-456d-92d0-fbe7789752d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:09.787400 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd3f97-0a5e-456d-92d0-fbe7789752d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:09.787681 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd3f97-0a5e-456d-92d0-fbe7789752d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:09.787954 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd3f97-0a5e-456d-92d0-fbe7789752d0 admin admin] PATH_INFO: `/v3/projects/b94cf19702fa4b96aa1f6f98c8a49a2e/users/0293ac8472674b9a9220fc88b0d67e02/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:09.789943 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd3f97-0a5e-456d-92d0-fbe7789752d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b94cf19702fa4b96aa1f6f98c8a49a2e, user_id=0293ac8472674b9a9220fc88b0d67e02, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:09.792649 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd3f97-0a5e-456d-92d0-fbe7789752d0 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:09.804714 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 956/1917] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:32:09 2022] PUT /identity/v3/projects/b94cf19702fa4b96aa1f6f98c8a49a2e/users/0293ac8472674b9a9220fc88b0d67e02/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:32:16.542291 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93590885-beab-448d-9903-7fd2b3e1ab82 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:16.542812 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93590885-beab-448d-9903-7fd2b3e1ab82 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:16.543119 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93590885-beab-448d-9903-7fd2b3e1ab82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:16.574671 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-93590885-beab-448d-9903-7fd2b3e1ab82 None None] MFA Rules not processed for user `0293ac8472674b9a9220fc88b0d67e02`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:16.575956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-93590885-beab-448d-9903-7fd2b3e1ab82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:16.651740 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 962/1918] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:32:16 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:32:16.664685 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd3f97-0a5e-456d-92d0-fbe7789752d0 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:16.667202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-5bdd3f97-0a5e-456d-92d0-fbe7789752d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:16.716991 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:16.729615 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd3f97-0a5e-456d-92d0-fbe7789752d0 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:16.733579 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e00351-3c62-421c-870a-d5fd16fb3d54 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62ca656e59ff46b08661385d8ec79846', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:16.734194 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e00351-3c62-421c-870a-d5fd16fb3d54 service glance] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:16.734477 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e00351-3c62-421c-870a-d5fd16fb3d54 service glance] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:16.734757 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e00351-3c62-421c-870a-d5fd16fb3d54 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:16.798613 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e00351-3c62-421c-870a-d5fd16fb3d54 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:16.800054 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e00351-3c62-421c-870a-d5fd16fb3d54 service glance] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:16.809036 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 957/1919] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:32:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:32:16.973899 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e244ee0-376f-4e07-89cb-3e17a2c6aae7 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:16.974271 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e244ee0-376f-4e07-89cb-3e17a2c6aae7 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:16.974625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e244ee0-376f-4e07-89cb-3e17a2c6aae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:17.000674 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-4e244ee0-376f-4e07-89cb-3e17a2c6aae7 None None] MFA Rules not processed for user `66937804f65147f392f4ddfc3e961d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:17.002368 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-4e244ee0-376f-4e07-89cb-3e17a2c6aae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:17.078373 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:17.099411 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 963/1920] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Nov 2 20:32:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:32:17.113473 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e00351-3c62-421c-870a-d5fd16fb3d54 service glance] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:17.114887 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-16e00351-3c62-421c-870a-d5fd16fb3d54 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:17.189984 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e00351-3c62-421c-870a-d5fd16fb3d54 service glance] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:17.195212 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca43936-57fa-42ec-86aa-2c85126d5e01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f22f80ac694e9888c132af1e58e292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:17.195824 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca43936-57fa-42ec-86aa-2c85126d5e01 service swift] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:17.196110 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca43936-57fa-42ec-86aa-2c85126d5e01 service swift] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:17.196390 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca43936-57fa-42ec-86aa-2c85126d5e01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:17.205923 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca43936-57fa-42ec-86aa-2c85126d5e01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:17.207710 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca43936-57fa-42ec-86aa-2c85126d5e01 service swift] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:17.218715 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 958/1921] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Nov 2 20:32:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 20:32:22.329732 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e244ee0-376f-4e07-89cb-3e17a2c6aae7 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:22.331454 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-4e244ee0-376f-4e07-89cb-3e17a2c6aae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:22.459260 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e244ee0-376f-4e07-89cb-3e17a2c6aae7 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:22.470524 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811eb1c5-27a9-4408-8e44-2dc69a4e6b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:22.471441 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811eb1c5-27a9-4408-8e44-2dc69a4e6b82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:22.471901 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811eb1c5-27a9-4408-8e44-2dc69a4e6b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:22.472333 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811eb1c5-27a9-4408-8e44-2dc69a4e6b82 admin admin] PATH_INFO: `/v3/users/2719c6355eda4e01af3f32b83c98e8da` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:22.473572 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811eb1c5-27a9-4408-8e44-2dc69a4e6b82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2719c6355eda4e01af3f32b83c98e8da)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:22.476608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811eb1c5-27a9-4408-8e44-2dc69a4e6b82 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:22.560852 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-811eb1c5-27a9-4408-8e44-2dc69a4e6b82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2719c6355eda4e01af3f32b83c98e8da'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:22.562536 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-811eb1c5-27a9-4408-8e44-2dc69a4e6b82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2719c6355eda4e01af3f32b83c98e8da'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:22.573255 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-811eb1c5-27a9-4408-8e44-2dc69a4e6b82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2719c6355eda4e01af3f32b83c98e8da'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:22.576404 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-811eb1c5-27a9-4408-8e44-2dc69a4e6b82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2719c6355eda4e01af3f32b83c98e8da'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:22.596091 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-811eb1c5-27a9-4408-8e44-2dc69a4e6b82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2719c6355eda4e01af3f32b83c98e8da'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:22.616652 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 964/1922] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:32:22 2022] DELETE /identity/v3/users/2719c6355eda4e01af3f32b83c98e8da => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:32:22.621095 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c17e0b-7691-4407-be9f-0b5b464f8d9f None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:22.621639 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c17e0b-7691-4407-be9f-0b5b464f8d9f None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:22.621824 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c17e0b-7691-4407-be9f-0b5b464f8d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:22.648419 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-03c17e0b-7691-4407-be9f-0b5b464f8d9f None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:22.650156 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-03c17e0b-7691-4407-be9f-0b5b464f8d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:22.757324 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 959/1923] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:32:22.763394 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811eb1c5-27a9-4408-8e44-2dc69a4e6b82 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:22.764931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-811eb1c5-27a9-4408-8e44-2dc69a4e6b82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:22.886755 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811eb1c5-27a9-4408-8e44-2dc69a4e6b82 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:22.892119 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790942f3-a720-462f-a270-03de5933e4b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:22.892960 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790942f3-a720-462f-a270-03de5933e4b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:22.893322 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790942f3-a720-462f-a270-03de5933e4b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:22.893647 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790942f3-a720-462f-a270-03de5933e4b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:22.904668 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790942f3-a720-462f-a270-03de5933e4b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:22.906162 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790942f3-a720-462f-a270-03de5933e4b0 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:22.918824 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 965/1924] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:32:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:32:23.312715 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c17e0b-7691-4407-be9f-0b5b464f8d9f None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:23.314755 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-03c17e0b-7691-4407-be9f-0b5b464f8d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:23.331905 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c17e0b-7691-4407-be9f-0b5b464f8d9f None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:23.342256 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b505af64-8c70-4a5b-a7b1-30cec1438d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:23.343793 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505af64-8c70-4a5b-a7b1-30cec1438d79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:23.344350 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505af64-8c70-4a5b-a7b1-30cec1438d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:23.344881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505af64-8c70-4a5b-a7b1-30cec1438d79 admin admin] PATH_INFO: `/v3/projects/ccd959cfcbf9478c83adf27adf24ee2f` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:23.346846 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b505af64-8c70-4a5b-a7b1-30cec1438d79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccd959cfcbf9478c83adf27adf24ee2f)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:23.353623 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b505af64-8c70-4a5b-a7b1-30cec1438d79 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:23.400882 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:23.448132 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-b505af64-8c70-4a5b-a7b1-30cec1438d79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccd959cfcbf9478c83adf27adf24ee2f', 'request_id': 'req-b505af64-8c70-4a5b-a7b1-30cec1438d79'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:23.456092 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-b505af64-8c70-4a5b-a7b1-30cec1438d79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccd959cfcbf9478c83adf27adf24ee2f', 'request_id': 'req-b505af64-8c70-4a5b-a7b1-30cec1438d79'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:23.475470 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-b505af64-8c70-4a5b-a7b1-30cec1438d79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccd959cfcbf9478c83adf27adf24ee2f', 'request_id': 'req-b505af64-8c70-4a5b-a7b1-30cec1438d79'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:23.509853 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-b505af64-8c70-4a5b-a7b1-30cec1438d79 admin admin] The token cache is being invalidate because project ccd959cfcbf9478c83adf27adf24ee2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:32:23.510212 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-b505af64-8c70-4a5b-a7b1-30cec1438d79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:23.511330 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-b505af64-8c70-4a5b-a7b1-30cec1438d79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:23.518110 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 960/1925] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:32:23 2022] DELETE /identity/v3/projects/ccd959cfcbf9478c83adf27adf24ee2f => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:32:23.519415 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d44c30-e955-47b2-a183-35be9a55cf9c None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:23.520352 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d44c30-e955-47b2-a183-35be9a55cf9c None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:23.520743 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d44c30-e955-47b2-a183-35be9a55cf9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:23.560512 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-a4d44c30-e955-47b2-a183-35be9a55cf9c None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:23.564612 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-a4d44c30-e955-47b2-a183-35be9a55cf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:23.592257 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:23.670156 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 966/1926] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:32:23.678180 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67714a0e-6f64-45af-be47-aff51f8b5a3c None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:23.678679 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67714a0e-6f64-45af-be47-aff51f8b5a3c None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:23.678925 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67714a0e-6f64-45af-be47-aff51f8b5a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:23.714746 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-67714a0e-6f64-45af-be47-aff51f8b5a3c None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:23.716293 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-67714a0e-6f64-45af-be47-aff51f8b5a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:23.730439 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 961/1927] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:32:23.731085 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d44c30-e955-47b2-a183-35be9a55cf9c None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:23.742554 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d44c30-e955-47b2-a183-35be9a55cf9c None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:23.749598 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab99b9c-980a-4756-a7ab-4e17c60f96c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:23.750229 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab99b9c-980a-4756-a7ab-4e17c60f96c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:23.750554 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab99b9c-980a-4756-a7ab-4e17c60f96c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:23.751393 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab99b9c-980a-4756-a7ab-4e17c60f96c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:23.752055 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab99b9c-980a-4756-a7ab-4e17c60f96c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:32:23.752376 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab99b9c-980a-4756-a7ab-4e17c60f96c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:23.754058 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab99b9c-980a-4756-a7ab-4e17c60f96c6 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:23.774000 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 967/1928] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:32:23.779730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67714a0e-6f64-45af-be47-aff51f8b5a3c None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:23.800975 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67714a0e-6f64-45af-be47-aff51f8b5a3c None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:23.811493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02aea3-71e7-494c-ad85-cc1d1484aa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:23.814337 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02aea3-71e7-494c-ad85-cc1d1484aa05 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:23.814666 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02aea3-71e7-494c-ad85-cc1d1484aa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:23.814914 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02aea3-71e7-494c-ad85-cc1d1484aa05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:23.815574 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02aea3-71e7-494c-ad85-cc1d1484aa05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:23.820279 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02aea3-71e7-494c-ad85-cc1d1484aa05 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:23.889754 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 962/1929] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:32:23 2022] POST /identity/v3/projects => generated 359 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:32:23.895265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab99b9c-980a-4756-a7ab-4e17c60f96c6 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:23.918766 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab99b9c-980a-4756-a7ab-4e17c60f96c6 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:23.981028 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02aea3-71e7-494c-ad85-cc1d1484aa05 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:23.983254 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-5e02aea3-71e7-494c-ad85-cc1d1484aa05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:24.066054 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28100ea-cd7b-48c3-ac8a-36b5567b931e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:24.066760 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28100ea-cd7b-48c3-ac8a-36b5567b931e admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:24.067044 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28100ea-cd7b-48c3-ac8a-36b5567b931e admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:24.067364 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28100ea-cd7b-48c3-ac8a-36b5567b931e admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:24.068032 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28100ea-cd7b-48c3-ac8a-36b5567b931e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:24.070375 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28100ea-cd7b-48c3-ac8a-36b5567b931e admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:24.096636 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02aea3-71e7-494c-ad85-cc1d1484aa05 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:24.099907 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 968/1930] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:32:23 2022] POST /identity/v3/users => generated 280 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:32:24.104091 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28100ea-cd7b-48c3-ac8a-36b5567b931e admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:24.106065 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400250c5-3b76-444e-99e1-ebf420c4009c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:24.107091 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400250c5-3b76-444e-99e1-ebf420c4009c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:24.107630 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400250c5-3b76-444e-99e1-ebf420c4009c admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:24.108078 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400250c5-3b76-444e-99e1-ebf420c4009c admin admin] PATH_INFO: `/v3/users/620d2ab84128488bba052ebc1259ce34` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:24.109668 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400250c5-3b76-444e-99e1-ebf420c4009c admin admin] RBAC: Authorizing `identity:delete_user(user_id=620d2ab84128488bba052ebc1259ce34)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:24.113587 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400250c5-3b76-444e-99e1-ebf420c4009c admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:24.117185 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28100ea-cd7b-48c3-ac8a-36b5567b931e admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:24.122886 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b5c37-067e-45c2-a660-eadc7debb30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:24.124537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b5c37-067e-45c2-a660-eadc7debb30f admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:24.124537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b5c37-067e-45c2-a660-eadc7debb30f admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:24.124537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b5c37-067e-45c2-a660-eadc7debb30f admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:24.124888 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b5c37-067e-45c2-a660-eadc7debb30f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:24.126917 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b5c37-067e-45c2-a660-eadc7debb30f admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:24.144188 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 969/1931] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:32:24.145247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b5c37-067e-45c2-a660-eadc7debb30f admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:24.165218 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b5c37-067e-45c2-a660-eadc7debb30f admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:24.181991 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a2436-8790-43a6-9da5-4a7d7cdead16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:24.181991 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a2436-8790-43a6-9da5-4a7d7cdead16 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:24.181991 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a2436-8790-43a6-9da5-4a7d7cdead16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:24.181991 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a2436-8790-43a6-9da5-4a7d7cdead16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:24.182850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a2436-8790-43a6-9da5-4a7d7cdead16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:24.186054 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a2436-8790-43a6-9da5-4a7d7cdead16 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:24.198505 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-400250c5-3b76-444e-99e1-ebf420c4009c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '620d2ab84128488bba052ebc1259ce34'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:24.202980 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 970/1932] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:32:24.203685 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-400250c5-3b76-444e-99e1-ebf420c4009c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '620d2ab84128488bba052ebc1259ce34'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:24.203827 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a2436-8790-43a6-9da5-4a7d7cdead16 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:24.220614 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a2436-8790-43a6-9da5-4a7d7cdead16 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:24.228201 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eeed68-1703-483c-9678-7b5599cdede5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:24.229060 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eeed68-1703-483c-9678-7b5599cdede5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:24.229412 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eeed68-1703-483c-9678-7b5599cdede5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:24.229847 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eeed68-1703-483c-9678-7b5599cdede5 admin admin] PATH_INFO: `/v3/projects/b305b227bfb0446bab83df4ed4d900b1/users/c81a2894de474f00bc45045c87e6d986/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:24.230468 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-400250c5-3b76-444e-99e1-ebf420c4009c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '620d2ab84128488bba052ebc1259ce34'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:24.231958 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-400250c5-3b76-444e-99e1-ebf420c4009c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '620d2ab84128488bba052ebc1259ce34'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:24.256244 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-400250c5-3b76-444e-99e1-ebf420c4009c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '620d2ab84128488bba052ebc1259ce34'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:24.270574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eeed68-1703-483c-9678-7b5599cdede5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b305b227bfb0446bab83df4ed4d900b1, user_id=c81a2894de474f00bc45045c87e6d986, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:24.275453 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eeed68-1703-483c-9678-7b5599cdede5 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:24.277597 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 963/1933] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:32:23 2022] DELETE /identity/v3/users/620d2ab84128488bba052ebc1259ce34 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:32:24.283758 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d53a2-5bdc-4d84-850c-32abd850d1aa None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:24.284272 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d53a2-5bdc-4d84-850c-32abd850d1aa None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:24.285415 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d53a2-5bdc-4d84-850c-32abd850d1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:24.298134 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:24.311029 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 971/1934] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:32:24 2022] PUT /identity/v3/projects/b305b227bfb0446bab83df4ed4d900b1/users/c81a2894de474f00bc45045c87e6d986/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:32:24.334553 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d7d09-f86f-4fe1-82f5-424829ff28da None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:24.335052 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d7d09-f86f-4fe1-82f5-424829ff28da None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:24.335551 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d7d09-f86f-4fe1-82f5-424829ff28da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:24.342309 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-2e8d53a2-5bdc-4d84-850c-32abd850d1aa None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:24.343871 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-2e8d53a2-5bdc-4d84-850c-32abd850d1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:24.413647 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-f56d7d09-f86f-4fe1-82f5-424829ff28da None None] MFA Rules not processed for user `c81a2894de474f00bc45045c87e6d986`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:24.440214 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-f56d7d09-f86f-4fe1-82f5-424829ff28da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:24.466797 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 964/1935] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:32:24.482777 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d53a2-5bdc-4d84-850c-32abd850d1aa None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:24.485924 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-2e8d53a2-5bdc-4d84-850c-32abd850d1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:24.505884 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:24.575615 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 972/1936] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:32:24 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:32:24.611647 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d53a2-5bdc-4d84-850c-32abd850d1aa None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:24.614451 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d7d09-f86f-4fe1-82f5-424829ff28da None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:24.616693 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-f56d7d09-f86f-4fe1-82f5-424829ff28da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:24.618118 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ad9b7-2995-4116-b22f-ab142671e227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:24.618979 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ad9b7-2995-4116-b22f-ab142671e227 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:24.619537 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ad9b7-2995-4116-b22f-ab142671e227 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:24.619889 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ad9b7-2995-4116-b22f-ab142671e227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:24.632073 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ad9b7-2995-4116-b22f-ab142671e227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:24.633816 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ad9b7-2995-4116-b22f-ab142671e227 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:24.647875 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 965/1937] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:32:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:32:24.741226 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d7d09-f86f-4fe1-82f5-424829ff28da None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:24.753350 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a67cb-d90c-4508-b5e0-87dae4e9e403 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:24.754396 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a67cb-d90c-4508-b5e0-87dae4e9e403 service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:24.754685 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a67cb-d90c-4508-b5e0-87dae4e9e403 service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:24.756817 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a67cb-d90c-4508-b5e0-87dae4e9e403 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:24.785457 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a67cb-d90c-4508-b5e0-87dae4e9e403 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:24.787145 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a67cb-d90c-4508-b5e0-87dae4e9e403 service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:24.806594 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 973/1938] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:32:24 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:32:24.826895 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ad9b7-2995-4116-b22f-ab142671e227 service neutron] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:24.830632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-7e9ad9b7-2995-4116-b22f-ab142671e227 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:24.855144 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ad9b7-2995-4116-b22f-ab142671e227 service neutron] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:24.868166 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262a4f5-645c-490e-9879-a9533f75e495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:24.868847 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262a4f5-645c-490e-9879-a9533f75e495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:24.869134 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262a4f5-645c-490e-9879-a9533f75e495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:24.869415 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262a4f5-645c-490e-9879-a9533f75e495 admin admin] PATH_INFO: `/v3/users/c81a2894de474f00bc45045c87e6d986` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:24.874605 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5262a4f5-645c-490e-9879-a9533f75e495 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c81a2894de474f00bc45045c87e6d986)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:24.879103 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5262a4f5-645c-490e-9879-a9533f75e495 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:24.997607 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-5262a4f5-645c-490e-9879-a9533f75e495 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c81a2894de474f00bc45045c87e6d986'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:24.998223 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-5262a4f5-645c-490e-9879-a9533f75e495 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c81a2894de474f00bc45045c87e6d986'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:25.038993 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-5262a4f5-645c-490e-9879-a9533f75e495 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c81a2894de474f00bc45045c87e6d986'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:25.040686 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-5262a4f5-645c-490e-9879-a9533f75e495 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c81a2894de474f00bc45045c87e6d986'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:25.058584 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-5262a4f5-645c-490e-9879-a9533f75e495 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c81a2894de474f00bc45045c87e6d986'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:25.101899 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 966/1939] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:32:24 2022] DELETE /identity/v3/users/c81a2894de474f00bc45045c87e6d986 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:32:25.106081 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b16cc6-ede6-41f4-98e8-661ae0ee1321 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:25.106372 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b16cc6-ede6-41f4-98e8-661ae0ee1321 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:25.106652 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b16cc6-ede6-41f4-98e8-661ae0ee1321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:25.129650 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-26b16cc6-ede6-41f4-98e8-661ae0ee1321 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:25.130938 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-26b16cc6-ede6-41f4-98e8-661ae0ee1321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:25.212528 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 974/1940] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:32:25.219509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262a4f5-645c-490e-9879-a9533f75e495 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:25.220993 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-5262a4f5-645c-490e-9879-a9533f75e495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:25.334621 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:25.435051 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262a4f5-645c-490e-9879-a9533f75e495 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:25.439957 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45898cd-5895-4a0a-aba2-ce7e64f5936e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:25.440934 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45898cd-5895-4a0a-aba2-ce7e64f5936e service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:25.441213 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45898cd-5895-4a0a-aba2-ce7e64f5936e service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:25.441592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45898cd-5895-4a0a-aba2-ce7e64f5936e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:25.457600 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45898cd-5895-4a0a-aba2-ce7e64f5936e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:25.459262 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45898cd-5895-4a0a-aba2-ce7e64f5936e service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:25.481281 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 967/1941] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:32:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:32:25.561645 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b16cc6-ede6-41f4-98e8-661ae0ee1321 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:25.563672 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-26b16cc6-ede6-41f4-98e8-661ae0ee1321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:25.579265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b16cc6-ede6-41f4-98e8-661ae0ee1321 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:25.591337 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4d4ec-03aa-46b6-a765-7b8b132170fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:25.592504 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4d4ec-03aa-46b6-a765-7b8b132170fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:25.592818 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4d4ec-03aa-46b6-a765-7b8b132170fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:25.593110 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4d4ec-03aa-46b6-a765-7b8b132170fe admin admin] PATH_INFO: `/v3/projects/8bd4387be3bb4b209854caf7e8853b58` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:25.595399 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4d4ec-03aa-46b6-a765-7b8b132170fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bd4387be3bb4b209854caf7e8853b58)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:25.598453 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4d4ec-03aa-46b6-a765-7b8b132170fe admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:25.681925 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-22a4d4ec-03aa-46b6-a765-7b8b132170fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bd4387be3bb4b209854caf7e8853b58', 'request_id': 'req-22a4d4ec-03aa-46b6-a765-7b8b132170fe'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:25.696603 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-22a4d4ec-03aa-46b6-a765-7b8b132170fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bd4387be3bb4b209854caf7e8853b58', 'request_id': 'req-22a4d4ec-03aa-46b6-a765-7b8b132170fe'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:25.707638 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-22a4d4ec-03aa-46b6-a765-7b8b132170fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bd4387be3bb4b209854caf7e8853b58', 'request_id': 'req-22a4d4ec-03aa-46b6-a765-7b8b132170fe'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:25.719780 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-22a4d4ec-03aa-46b6-a765-7b8b132170fe admin admin] The token cache is being invalidate because project 8bd4387be3bb4b209854caf7e8853b58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:32:25.720069 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-22a4d4ec-03aa-46b6-a765-7b8b132170fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:25.720934 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-22a4d4ec-03aa-46b6-a765-7b8b132170fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:25.722848 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 975/1942] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:32:25 2022] DELETE /identity/v3/projects/8bd4387be3bb4b209854caf7e8853b58 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:32:25.727612 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd63265-e450-4945-bf45-c0ad56946d9e None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:25.727816 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd63265-e450-4945-bf45-c0ad56946d9e None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:25.728088 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd63265-e450-4945-bf45-c0ad56946d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:25.799264 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-0cd63265-e450-4945-bf45-c0ad56946d9e None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:25.799264 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-0cd63265-e450-4945-bf45-c0ad56946d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:25.895011 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 968/1943] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:32:25.903640 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579da090-4422-4910-a6f8-e4695a5fc6e8 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:25.904715 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579da090-4422-4910-a6f8-e4695a5fc6e8 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:25.905266 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579da090-4422-4910-a6f8-e4695a5fc6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:25.926410 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:25.970725 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-579da090-4422-4910-a6f8-e4695a5fc6e8 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:25.971962 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-579da090-4422-4910-a6f8-e4695a5fc6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:25.980884 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd63265-e450-4945-bf45-c0ad56946d9e None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:25.982549 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-0cd63265-e450-4945-bf45-c0ad56946d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:25.993458 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 976/1944] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:32:25.998063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579da090-4422-4910-a6f8-e4695a5fc6e8 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:26.008929 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579da090-4422-4910-a6f8-e4695a5fc6e8 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:26.016988 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde9175-18f8-4717-a842-0205f2ae1a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:26.017981 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde9175-18f8-4717-a842-0205f2ae1a50 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:26.020227 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd63265-e450-4945-bf45-c0ad56946d9e None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:26.027431 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb498a6-d27b-4daf-ac46-cbe3df3e1fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:26.028106 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb498a6-d27b-4daf-ac46-cbe3df3e1fc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:26.028388 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb498a6-d27b-4daf-ac46-cbe3df3e1fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:26.028717 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb498a6-d27b-4daf-ac46-cbe3df3e1fc9 admin admin] PATH_INFO: `/v3/projects/b305b227bfb0446bab83df4ed4d900b1` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:26.030237 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb498a6-d27b-4daf-ac46-cbe3df3e1fc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b305b227bfb0446bab83df4ed4d900b1)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:26.031889 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb498a6-d27b-4daf-ac46-cbe3df3e1fc9 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:26.032712 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde9175-18f8-4717-a842-0205f2ae1a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:26.033402 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde9175-18f8-4717-a842-0205f2ae1a50 admin admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:26.035073 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde9175-18f8-4717-a842-0205f2ae1a50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:32:26.037189 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde9175-18f8-4717-a842-0205f2ae1a50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:26.042140 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde9175-18f8-4717-a842-0205f2ae1a50 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:26.078250 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 977/1945] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:32:26.081866 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde9175-18f8-4717-a842-0205f2ae1a50 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:26.095899 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde9175-18f8-4717-a842-0205f2ae1a50 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:26.119463 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-cbb498a6-d27b-4daf-ac46-cbe3df3e1fc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b305b227bfb0446bab83df4ed4d900b1', 'request_id': 'req-cbb498a6-d27b-4daf-ac46-cbe3df3e1fc9'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:26.132441 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-cbb498a6-d27b-4daf-ac46-cbe3df3e1fc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b305b227bfb0446bab83df4ed4d900b1', 'request_id': 'req-cbb498a6-d27b-4daf-ac46-cbe3df3e1fc9'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:26.141973 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-cbb498a6-d27b-4daf-ac46-cbe3df3e1fc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b305b227bfb0446bab83df4ed4d900b1', 'request_id': 'req-cbb498a6-d27b-4daf-ac46-cbe3df3e1fc9'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:26.166609 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-cbb498a6-d27b-4daf-ac46-cbe3df3e1fc9 admin admin] The token cache is being invalidate because project b305b227bfb0446bab83df4ed4d900b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:32:26.166916 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-cbb498a6-d27b-4daf-ac46-cbe3df3e1fc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:26.167681 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-cbb498a6-d27b-4daf-ac46-cbe3df3e1fc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:26.169485 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 969/1946] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:32:25 2022] DELETE /identity/v3/projects/b305b227bfb0446bab83df4ed4d900b1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:32:26.180098 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc2732-925a-4ec9-8b78-0312fffd921b None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:26.180391 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc2732-925a-4ec9-8b78-0312fffd921b None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:26.180696 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc2732-925a-4ec9-8b78-0312fffd921b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:26.212068 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088117d-d61e-4ecc-9a6e-a400d554e509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:26.212935 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088117d-d61e-4ecc-9a6e-a400d554e509 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:26.213329 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088117d-d61e-4ecc-9a6e-a400d554e509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:26.213844 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088117d-d61e-4ecc-9a6e-a400d554e509 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:26.215411 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5088117d-d61e-4ecc-9a6e-a400d554e509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:26.218647 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5088117d-d61e-4ecc-9a6e-a400d554e509 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:26.220365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-f8bc2732-925a-4ec9-8b78-0312fffd921b None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:26.221779 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-f8bc2732-925a-4ec9-8b78-0312fffd921b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:26.239275 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 970/1947] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:32:26.248098 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13342ec-0ab2-44eb-9599-60b605c0a9f1 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:26.248389 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13342ec-0ab2-44eb-9599-60b605c0a9f1 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:26.248706 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13342ec-0ab2-44eb-9599-60b605c0a9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:26.268797 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 978/1948] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:32:26 2022] POST /identity/v3/projects => generated 397 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:32:26.274223 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088117d-d61e-4ecc-9a6e-a400d554e509 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:26.277316 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-5088117d-d61e-4ecc-9a6e-a400d554e509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:26.297729 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-a13342ec-0ab2-44eb-9599-60b605c0a9f1 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:26.298967 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-a13342ec-0ab2-44eb-9599-60b605c0a9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:26.382853 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:26.417867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088117d-d61e-4ecc-9a6e-a400d554e509 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:26.429679 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a189e-5886-4e22-8e8f-a2d50788bec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:26.431702 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a189e-5886-4e22-8e8f-a2d50788bec3 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:26.432851 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a189e-5886-4e22-8e8f-a2d50788bec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:26.433764 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a189e-5886-4e22-8e8f-a2d50788bec3 admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:26.436124 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a189e-5886-4e22-8e8f-a2d50788bec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:26.441732 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a189e-5886-4e22-8e8f-a2d50788bec3 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:26.453323 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 971/1949] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:32:26.458831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13342ec-0ab2-44eb-9599-60b605c0a9f1 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:26.476604 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13342ec-0ab2-44eb-9599-60b605c0a9f1 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:26.490285 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4c144-89b9-4076-9693-5606b6706150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:26.491459 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4c144-89b9-4076-9693-5606b6706150 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:26.491915 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4c144-89b9-4076-9693-5606b6706150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:26.492350 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4c144-89b9-4076-9693-5606b6706150 admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:26.493364 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4c144-89b9-4076-9693-5606b6706150 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:32:26.494893 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4c144-89b9-4076-9693-5606b6706150 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:26.502222 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4c144-89b9-4076-9693-5606b6706150 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:26.510462 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 979/1950] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:32:26 2022] POST /identity/v3/users => generated 299 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:32:26.511689 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a189e-5886-4e22-8e8f-a2d50788bec3 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:26.527736 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 972/1951] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:32:26.531751 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4c144-89b9-4076-9693-5606b6706150 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:26.559223 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a189e-5886-4e22-8e8f-a2d50788bec3 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:26.561531 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4c144-89b9-4076-9693-5606b6706150 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:26.565109 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee419e0e-48f6-4cc0-9f2d-b591a35c32b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:26.565733 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee419e0e-48f6-4cc0-9f2d-b591a35c32b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:26.566020 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee419e0e-48f6-4cc0-9f2d-b591a35c32b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:26.566299 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee419e0e-48f6-4cc0-9f2d-b591a35c32b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:26.567057 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee419e0e-48f6-4cc0-9f2d-b591a35c32b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:26.568792 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee419e0e-48f6-4cc0-9f2d-b591a35c32b7 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:26.569453 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee2c7b-8532-4a3b-9b82-4de751c9633f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:26.570714 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee2c7b-8532-4a3b-9b82-4de751c9633f admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:26.571007 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee2c7b-8532-4a3b-9b82-4de751c9633f admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:26.571289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee2c7b-8532-4a3b-9b82-4de751c9633f admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:26.571930 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee2c7b-8532-4a3b-9b82-4de751c9633f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:26.575134 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee2c7b-8532-4a3b-9b82-4de751c9633f admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:26.618061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 980/1952] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:32:26.624690 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee419e0e-48f6-4cc0-9f2d-b591a35c32b7 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:26.639470 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 973/1953] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:32:26 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:32:26.644259 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee419e0e-48f6-4cc0-9f2d-b591a35c32b7 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:26.645661 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee2c7b-8532-4a3b-9b82-4de751c9633f admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:26.740274 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:26.753009 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee2c7b-8532-4a3b-9b82-4de751c9633f admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:26.760715 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205d541-c31f-4c3c-87f7-5f4fe33e35ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:26.761103 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205d541-c31f-4c3c-87f7-5f4fe33e35ae admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:26.761404 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205d541-c31f-4c3c-87f7-5f4fe33e35ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:26.761690 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205d541-c31f-4c3c-87f7-5f4fe33e35ae admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:26.762340 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205d541-c31f-4c3c-87f7-5f4fe33e35ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:26.762771 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2ed4a-dca7-4cc9-be4d-c3388faf820f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:26.763403 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2ed4a-dca7-4cc9-be4d-c3388faf820f admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:26.763689 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2ed4a-dca7-4cc9-be4d-c3388faf820f admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:26.764019 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2ed4a-dca7-4cc9-be4d-c3388faf820f admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:26.764278 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205d541-c31f-4c3c-87f7-5f4fe33e35ae admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:26.764720 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a2ed4a-dca7-4cc9-be4d-c3388faf820f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:26.766849 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a2ed4a-dca7-4cc9-be4d-c3388faf820f admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:26.781168 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 981/1954] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:32:26.794266 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2ed4a-dca7-4cc9-be4d-c3388faf820f admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:26.809127 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2ed4a-dca7-4cc9-be4d-c3388faf820f admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:26.815640 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 974/1955] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:32:26 2022] POST /identity/v3/users => generated 287 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:32:26.815821 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c781086-18ed-42aa-a1b0-a69a1b84b626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:26.815942 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816bd97-9e8f-4ad2-87e2-47cf2287cab5 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:26.815942 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816bd97-9e8f-4ad2-87e2-47cf2287cab5 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:26.816127 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c781086-18ed-42aa-a1b0-a69a1b84b626 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:26.816211 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816bd97-9e8f-4ad2-87e2-47cf2287cab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:26.816297 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c781086-18ed-42aa-a1b0-a69a1b84b626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:26.816297 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c781086-18ed-42aa-a1b0-a69a1b84b626 admin admin] PATH_INFO: `/v3/projects/7b8d4932a3644478a9a4ea7f2dff9dd9/users/68bb858493c84c2a8ac7e55aec2014cc/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:26.837750 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c781086-18ed-42aa-a1b0-a69a1b84b626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b8d4932a3644478a9a4ea7f2dff9dd9, user_id=68bb858493c84c2a8ac7e55aec2014cc, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:26.840538 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c781086-18ed-42aa-a1b0-a69a1b84b626 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:26.842298 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-5816bd97-9e8f-4ad2-87e2-47cf2287cab5 None None] MFA Rules not processed for user `4bd602c085ad406eab3705dc8500a003`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:26.845700 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-5816bd97-9e8f-4ad2-87e2-47cf2287cab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:26.857909 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 982/1956] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:32:26 2022] PUT /identity/v3/projects/7b8d4932a3644478a9a4ea7f2dff9dd9/users/68bb858493c84c2a8ac7e55aec2014cc/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:32:26.859239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c781086-18ed-42aa-a1b0-a69a1b84b626 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:26.949372 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c781086-18ed-42aa-a1b0-a69a1b84b626 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:26.960690 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774a146-55e1-4442-a8ef-7cb4e5e96eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:26.962862 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774a146-55e1-4442-a8ef-7cb4e5e96eaa admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:26.963338 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774a146-55e1-4442-a8ef-7cb4e5e96eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:26.964282 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774a146-55e1-4442-a8ef-7cb4e5e96eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:26.965970 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774a146-55e1-4442-a8ef-7cb4e5e96eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:26.970202 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774a146-55e1-4442-a8ef-7cb4e5e96eaa admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:26.976435 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 975/1957] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:32:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:32:26.979255 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34614a-a6af-4bfe-8c82-c52b582496aa None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:26.979901 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34614a-a6af-4bfe-8c82-c52b582496aa None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:26.980493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34614a-a6af-4bfe-8c82-c52b582496aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:26.986699 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 983/1958] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:32:26.987613 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774a146-55e1-4442-a8ef-7cb4e5e96eaa admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:26.998100 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774a146-55e1-4442-a8ef-7cb4e5e96eaa admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:27.005691 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f534e25-1922-4d99-96e3-ab86beea271c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:27.006878 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f534e25-1922-4d99-96e3-ab86beea271c admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:27.007387 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f534e25-1922-4d99-96e3-ab86beea271c admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:27.007824 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f534e25-1922-4d99-96e3-ab86beea271c admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:27.008842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f534e25-1922-4d99-96e3-ab86beea271c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:27.010815 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f534e25-1922-4d99-96e3-ab86beea271c admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:27.020489 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-aa34614a-a6af-4bfe-8c82-c52b582496aa None None] MFA Rules not processed for user `68bb858493c84c2a8ac7e55aec2014cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:27.021842 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-aa34614a-a6af-4bfe-8c82-c52b582496aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:27.035033 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 984/1959] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:32:27.039642 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f534e25-1922-4d99-96e3-ab86beea271c admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:27.055544 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f534e25-1922-4d99-96e3-ab86beea271c admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:27.061286 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b79c7-0b41-4c9f-b8c1-6b9a6a814bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:27.062017 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b79c7-0b41-4c9f-b8c1-6b9a6a814bc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:27.062306 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b79c7-0b41-4c9f-b8c1-6b9a6a814bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:27.062588 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b79c7-0b41-4c9f-b8c1-6b9a6a814bc6 admin admin] PATH_INFO: `/v3/projects/1cb4d258d1674afba70ea55326e32534/users/977e5de532bb461eb1ede18af41add0f/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:27.081433 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b79c7-0b41-4c9f-b8c1-6b9a6a814bc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cb4d258d1674afba70ea55326e32534, user_id=977e5de532bb461eb1ede18af41add0f, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:27.084303 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b79c7-0b41-4c9f-b8c1-6b9a6a814bc6 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:27.084914 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:27.108222 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 985/1960] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:32:27 2022] PUT /identity/v3/projects/1cb4d258d1674afba70ea55326e32534/users/977e5de532bb461eb1ede18af41add0f/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:32:27.118503 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb8a8a-b521-49ef-be44-2bb4e69559fd None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:27.119487 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb8a8a-b521-49ef-be44-2bb4e69559fd None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:27.119937 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb8a8a-b521-49ef-be44-2bb4e69559fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:27.135731 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 976/1961] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:32:26 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:32:27.153371 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34614a-a6af-4bfe-8c82-c52b582496aa None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:27.155213 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-aa34614a-a6af-4bfe-8c82-c52b582496aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:27.164238 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-a7eb8a8a-b521-49ef-be44-2bb4e69559fd None None] MFA Rules not processed for user `977e5de532bb461eb1ede18af41add0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:27.165534 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-a7eb8a8a-b521-49ef-be44-2bb4e69559fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:27.231632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34614a-a6af-4bfe-8c82-c52b582496aa None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:27.281324 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 986/1962] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:32:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:32:27.296249 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb8a8a-b521-49ef-be44-2bb4e69559fd None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:27.298412 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-a7eb8a8a-b521-49ef-be44-2bb4e69559fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:27.314360 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ca782-a46f-4531-95b2-a5a82495c9a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:27.314993 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ca782-a46f-4531-95b2-a5a82495c9a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:27.315281 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ca782-a46f-4531-95b2-a5a82495c9a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:27.315560 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ca782-a46f-4531-95b2-a5a82495c9a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:27.320216 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:27.390616 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb8a8a-b521-49ef-be44-2bb4e69559fd None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:27.394709 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a35e2b-3f77-4642-ab80-221ae983acf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:27.395539 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a35e2b-3f77-4642-ab80-221ae983acf0 service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:27.397282 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a35e2b-3f77-4642-ab80-221ae983acf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:27.397769 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a35e2b-3f77-4642-ab80-221ae983acf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:27.405807 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ca782-a46f-4531-95b2-a5a82495c9a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:27.406883 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ca782-a46f-4531-95b2-a5a82495c9a8 service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:27.409142 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a35e2b-3f77-4642-ab80-221ae983acf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:27.410658 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a35e2b-3f77-4642-ab80-221ae983acf0 service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:27.416365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 977/1963] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:32:27 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 20:32:27.421342 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 987/1964] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:32:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:32:28.570301 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68825e-7260-40b2-95cc-b912b2b5994a None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:28.570777 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68825e-7260-40b2-95cc-b912b2b5994a None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:28.570882 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68825e-7260-40b2-95cc-b912b2b5994a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:28.593609 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-db68825e-7260-40b2-95cc-b912b2b5994a None None] MFA Rules not processed for user `66937804f65147f392f4ddfc3e961d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:28.595588 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-db68825e-7260-40b2-95cc-b912b2b5994a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:28.646386 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:28.677635 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 978/1965] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Nov 2 20:32:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:32:28.691681 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a35e2b-3f77-4642-ab80-221ae983acf0 service cinder] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:28.693364 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-b1a35e2b-3f77-4642-ab80-221ae983acf0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:28.800792 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a35e2b-3f77-4642-ab80-221ae983acf0 service cinder] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:28.806595 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d857b-4772-4639-a676-ea3ab10cdc00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f22f80ac694e9888c132af1e58e292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:28.807273 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d857b-4772-4639-a676-ea3ab10cdc00 service swift] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:28.807614 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d857b-4772-4639-a676-ea3ab10cdc00 service swift] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:28.807905 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d857b-4772-4639-a676-ea3ab10cdc00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:28.818246 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d857b-4772-4639-a676-ea3ab10cdc00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:28.822537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d857b-4772-4639-a676-ea3ab10cdc00 service swift] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:28.833614 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 988/1966] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Nov 2 20:32:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 20:32:31.644472 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68825e-7260-40b2-95cc-b912b2b5994a None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:31.833003 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68825e-7260-40b2-95cc-b912b2b5994a None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:31.838129 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d17de-957b-456f-ad70-b3ab2698a570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:31.839063 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d17de-957b-456f-ad70-b3ab2698a570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:31.839556 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d17de-957b-456f-ad70-b3ab2698a570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:31.840050 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d17de-957b-456f-ad70-b3ab2698a570 admin admin] PATH_INFO: `/v3/users/977e5de532bb461eb1ede18af41add0f` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:31.841522 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d17de-957b-456f-ad70-b3ab2698a570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=977e5de532bb461eb1ede18af41add0f)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:31.843811 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d17de-957b-456f-ad70-b3ab2698a570 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:31.908649 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-e64d17de-957b-456f-ad70-b3ab2698a570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '977e5de532bb461eb1ede18af41add0f'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:31.909905 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-e64d17de-957b-456f-ad70-b3ab2698a570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '977e5de532bb461eb1ede18af41add0f'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:31.933555 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-e64d17de-957b-456f-ad70-b3ab2698a570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '977e5de532bb461eb1ede18af41add0f'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:31.934980 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-e64d17de-957b-456f-ad70-b3ab2698a570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '977e5de532bb461eb1ede18af41add0f'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:31.946694 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-e64d17de-957b-456f-ad70-b3ab2698a570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '977e5de532bb461eb1ede18af41add0f'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:31.968770 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 979/1967] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:32:31 2022] DELETE /identity/v3/users/977e5de532bb461eb1ede18af41add0f => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:32:31.973164 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763430e3-c87e-4620-8619-fa8c5dc1abce None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:31.973705 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763430e3-c87e-4620-8619-fa8c5dc1abce None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:31.974057 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763430e3-c87e-4620-8619-fa8c5dc1abce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:32.001292 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-763430e3-c87e-4620-8619-fa8c5dc1abce None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:32.002789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-763430e3-c87e-4620-8619-fa8c5dc1abce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:32.095529 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 989/1968] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:32:32.113503 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d17de-957b-456f-ad70-b3ab2698a570 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:32.114848 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-e64d17de-957b-456f-ad70-b3ab2698a570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:32.202549 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d17de-957b-456f-ad70-b3ab2698a570 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:32.209557 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2856df84-6721-4b77-be22-2d7180bc53f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:32.210295 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856df84-6721-4b77-be22-2d7180bc53f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:32.210684 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856df84-6721-4b77-be22-2d7180bc53f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:32.211070 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856df84-6721-4b77-be22-2d7180bc53f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:32.227152 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2856df84-6721-4b77-be22-2d7180bc53f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:32.229622 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2856df84-6721-4b77-be22-2d7180bc53f1 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:32.257992 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 980/1969] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:32:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:32:32.524004 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606713cd-2fae-4ae3-b82e-6891754befdf None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:32.524885 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606713cd-2fae-4ae3-b82e-6891754befdf None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:32.525333 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606713cd-2fae-4ae3-b82e-6891754befdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:32.561841 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-606713cd-2fae-4ae3-b82e-6891754befdf None None] MFA Rules not processed for user `7f47aaae28384df9a675fc4b950cc1f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:32.564143 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-606713cd-2fae-4ae3-b82e-6891754befdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:32.627409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:32.657641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 990/1970] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:32:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:32:32.711534 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2856df84-6721-4b77-be22-2d7180bc53f1 service neutron] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:32.713074 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-2856df84-6721-4b77-be22-2d7180bc53f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:32.730688 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:32.738453 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2856df84-6721-4b77-be22-2d7180bc53f1 service neutron] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:32.755422 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda818ab-7799-4182-a778-864bde7af8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:32.756163 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda818ab-7799-4182-a778-864bde7af8f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:32.756346 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda818ab-7799-4182-a778-864bde7af8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:32.756684 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda818ab-7799-4182-a778-864bde7af8f8 admin admin] PATH_INFO: `/v3/projects/1cb4d258d1674afba70ea55326e32534` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:32.758033 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda818ab-7799-4182-a778-864bde7af8f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cb4d258d1674afba70ea55326e32534)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:32.760321 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda818ab-7799-4182-a778-864bde7af8f8 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:32.842845 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-eda818ab-7799-4182-a778-864bde7af8f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cb4d258d1674afba70ea55326e32534', 'request_id': 'req-eda818ab-7799-4182-a778-864bde7af8f8'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:32.850761 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-eda818ab-7799-4182-a778-864bde7af8f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cb4d258d1674afba70ea55326e32534', 'request_id': 'req-eda818ab-7799-4182-a778-864bde7af8f8'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:32.862179 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-eda818ab-7799-4182-a778-864bde7af8f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cb4d258d1674afba70ea55326e32534', 'request_id': 'req-eda818ab-7799-4182-a778-864bde7af8f8'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:32.887145 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-eda818ab-7799-4182-a778-864bde7af8f8 admin admin] The token cache is being invalidate because project 1cb4d258d1674afba70ea55326e32534 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:32:32.888970 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-eda818ab-7799-4182-a778-864bde7af8f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:32.893225 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-eda818ab-7799-4182-a778-864bde7af8f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:32.896643 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 981/1971] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:32:32 2022] DELETE /identity/v3/projects/1cb4d258d1674afba70ea55326e32534 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:32:32.901397 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d18e2-913a-437d-8c71-7ab206d6b012 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:32.902034 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d18e2-913a-437d-8c71-7ab206d6b012 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:32.902773 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d18e2-913a-437d-8c71-7ab206d6b012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:32.943857 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-276d18e2-913a-437d-8c71-7ab206d6b012 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:32.945108 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-276d18e2-913a-437d-8c71-7ab206d6b012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:33.038708 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 991/1972] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:32:33.046764 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f7a18-c094-4871-b3ca-4641c990f6fa None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:33.047079 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f7a18-c094-4871-b3ca-4641c990f6fa None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:33.047402 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f7a18-c094-4871-b3ca-4641c990f6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:33.078682 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-237f7a18-c094-4871-b3ca-4641c990f6fa None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:33.079913 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-237f7a18-c094-4871-b3ca-4641c990f6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:33.092293 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 982/1973] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:32:33.097046 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d18e2-913a-437d-8c71-7ab206d6b012 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:33.111489 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d18e2-913a-437d-8c71-7ab206d6b012 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:33.121432 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac70a9-512a-4da1-9fb0-a761320bec8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:33.122358 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac70a9-512a-4da1-9fb0-a761320bec8e admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:33.122979 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac70a9-512a-4da1-9fb0-a761320bec8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:33.123470 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac70a9-512a-4da1-9fb0-a761320bec8e admin admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:33.124358 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac70a9-512a-4da1-9fb0-a761320bec8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:32:33.125078 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac70a9-512a-4da1-9fb0-a761320bec8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:33.128100 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac70a9-512a-4da1-9fb0-a761320bec8e admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:33.174847 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 992/1974] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:32:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:32:33.178504 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f7a18-c094-4871-b3ca-4641c990f6fa None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:33.189553 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f7a18-c094-4871-b3ca-4641c990f6fa None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:33.195010 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad51530-7450-4254-a651-c203a4c36d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:33.195627 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad51530-7450-4254-a651-c203a4c36d3e admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:33.195938 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad51530-7450-4254-a651-c203a4c36d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:33.196217 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad51530-7450-4254-a651-c203a4c36d3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:33.196933 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad51530-7450-4254-a651-c203a4c36d3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:33.198828 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad51530-7450-4254-a651-c203a4c36d3e admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:33.230809 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 983/1975] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:32:33 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:32:33.235719 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac70a9-512a-4da1-9fb0-a761320bec8e admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:33.249546 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac70a9-512a-4da1-9fb0-a761320bec8e admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:33.319661 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e6fd1-c93a-413d-8cd4-f2ea37102864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:33.320654 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e6fd1-c93a-413d-8cd4-f2ea37102864 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:33.321104 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e6fd1-c93a-413d-8cd4-f2ea37102864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:33.321528 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e6fd1-c93a-413d-8cd4-f2ea37102864 admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:33.322522 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e6fd1-c93a-413d-8cd4-f2ea37102864 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:33.325066 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e6fd1-c93a-413d-8cd4-f2ea37102864 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:33.386235 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad51530-7450-4254-a651-c203a4c36d3e admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:33.386466 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 993/1976] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:32:33 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:32:33.403462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad51530-7450-4254-a651-c203a4c36d3e admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:33.422801 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359bb67-f194-44fa-b9cc-d9f261175c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:33.423446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359bb67-f194-44fa-b9cc-d9f261175c8d admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:33.423736 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359bb67-f194-44fa-b9cc-d9f261175c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:33.424071 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359bb67-f194-44fa-b9cc-d9f261175c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:33.424788 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359bb67-f194-44fa-b9cc-d9f261175c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:33.426511 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359bb67-f194-44fa-b9cc-d9f261175c8d admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:33.436287 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e6fd1-c93a-413d-8cd4-f2ea37102864 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:33.456221 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-0e0e6fd1-c93a-413d-8cd4-f2ea37102864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:33.458091 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 984/1977] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:32:33.461043 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359bb67-f194-44fa-b9cc-d9f261175c8d admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:33.474693 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e6fd1-c93a-413d-8cd4-f2ea37102864 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:33.482782 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359bb67-f194-44fa-b9cc-d9f261175c8d admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:33.487297 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd8263-8734-42d2-9a23-67d04da08eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:33.487965 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd8263-8734-42d2-9a23-67d04da08eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:33.488251 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd8263-8734-42d2-9a23-67d04da08eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:33.488531 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd8263-8734-42d2-9a23-67d04da08eda admin admin] PATH_INFO: `/v3/users/68bb858493c84c2a8ac7e55aec2014cc` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:33.490963 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd8263-8734-42d2-9a23-67d04da08eda admin admin] RBAC: Authorizing `identity:delete_user(user_id=68bb858493c84c2a8ac7e55aec2014cc)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:33.492990 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd8263-8734-42d2-9a23-67d04da08eda admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:33.499852 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c800d2b-9621-4d6f-ac1b-80356977d51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:33.500715 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c800d2b-9621-4d6f-ac1b-80356977d51d admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:33.501013 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c800d2b-9621-4d6f-ac1b-80356977d51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:33.501296 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c800d2b-9621-4d6f-ac1b-80356977d51d admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:33.501956 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c800d2b-9621-4d6f-ac1b-80356977d51d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:33.503624 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c800d2b-9621-4d6f-ac1b-80356977d51d admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:33.525662 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 985/1978] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:32:33.540658 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c800d2b-9621-4d6f-ac1b-80356977d51d admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:33.561257 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c800d2b-9621-4d6f-ac1b-80356977d51d admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:33.571879 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11fb4a-458d-4b60-a9bb-a3270be2c8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:33.572812 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11fb4a-458d-4b60-a9bb-a3270be2c8c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:33.573110 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11fb4a-458d-4b60-a9bb-a3270be2c8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:33.573399 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11fb4a-458d-4b60-a9bb-a3270be2c8c0 admin admin] PATH_INFO: `/v3/projects/302bef42d2cd4a5aa7475ae268bed59f/users/e41e58f45ee04cea967f0e5364c8b33a/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:33.596278 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11fb4a-458d-4b60-a9bb-a3270be2c8c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=302bef42d2cd4a5aa7475ae268bed59f, user_id=e41e58f45ee04cea967f0e5364c8b33a, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:33.600501 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11fb4a-458d-4b60-a9bb-a3270be2c8c0 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:33.629971 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-cadd8263-8734-42d2-9a23-67d04da08eda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68bb858493c84c2a8ac7e55aec2014cc'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:33.630701 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-cadd8263-8734-42d2-9a23-67d04da08eda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68bb858493c84c2a8ac7e55aec2014cc'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:33.648507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-cadd8263-8734-42d2-9a23-67d04da08eda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68bb858493c84c2a8ac7e55aec2014cc'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:33.649349 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-cadd8263-8734-42d2-9a23-67d04da08eda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68bb858493c84c2a8ac7e55aec2014cc'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:33.651644 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:33.666017 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 986/1979] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:32:33 2022] PUT /identity/v3/projects/302bef42d2cd4a5aa7475ae268bed59f/users/e41e58f45ee04cea967f0e5364c8b33a/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:32:33.677176 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-cadd8263-8734-42d2-9a23-67d04da08eda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68bb858493c84c2a8ac7e55aec2014cc'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:33.678124 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b84143-391d-46e3-9e10-c153edca9f7e None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:33.678490 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b84143-391d-46e3-9e10-c153edca9f7e None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:33.678844 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b84143-391d-46e3-9e10-c153edca9f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:33.720283 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 994/1980] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:32:33 2022] DELETE /identity/v3/users/68bb858493c84c2a8ac7e55aec2014cc => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:32:33.727047 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477ccee-40b3-42d3-b838-9aadb6853717 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:33.727355 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477ccee-40b3-42d3-b838-9aadb6853717 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:33.727623 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477ccee-40b3-42d3-b838-9aadb6853717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:33.753261 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-04b84143-391d-46e3-9e10-c153edca9f7e None None] MFA Rules not processed for user `e41e58f45ee04cea967f0e5364c8b33a`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:33.754500 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-04b84143-391d-46e3-9e10-c153edca9f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:33.759010 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-0477ccee-40b3-42d3-b838-9aadb6853717 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:33.761488 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-0477ccee-40b3-42d3-b838-9aadb6853717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:33.906416 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 987/1981] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:32:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:32:33.909221 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b84143-391d-46e3-9e10-c153edca9f7e None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:33.910243 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-04b84143-391d-46e3-9e10-c153edca9f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:33.923507 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:33.940008 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b84143-391d-46e3-9e10-c153edca9f7e None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:33.942799 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 995/1982] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:32:33.945252 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44814b67-8f5c-499a-b5c6-1186d0febfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:33.945901 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44814b67-8f5c-499a-b5c6-1186d0febfd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:33.946180 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44814b67-8f5c-499a-b5c6-1186d0febfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:33.946441 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44814b67-8f5c-499a-b5c6-1186d0febfd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:33.947408 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44814b67-8f5c-499a-b5c6-1186d0febfd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:33.949378 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44814b67-8f5c-499a-b5c6-1186d0febfd7 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:33.958777 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477ccee-40b3-42d3-b838-9aadb6853717 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:33.966835 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-0477ccee-40b3-42d3-b838-9aadb6853717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:33.996519 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 988/1983] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:32:33 2022] POST /identity/v3/projects => generated 377 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:32:34.000351 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44814b67-8f5c-499a-b5c6-1186d0febfd7 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:34.072718 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477ccee-40b3-42d3-b838-9aadb6853717 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:34.091193 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44814b67-8f5c-499a-b5c6-1186d0febfd7 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:34.097721 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ce595-1c4d-4efb-882c-673248b93e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:34.098347 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ce595-1c4d-4efb-882c-673248b93e56 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:34.098634 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ce595-1c4d-4efb-882c-673248b93e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:34.098909 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ce595-1c4d-4efb-882c-673248b93e56 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:34.099693 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ce595-1c4d-4efb-882c-673248b93e56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:34.102369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ce595-1c4d-4efb-882c-673248b93e56 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:34.145218 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 989/1984] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:32:33 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:32:34.147721 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ce595-1c4d-4efb-882c-673248b93e56 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:34.168714 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ce595-1c4d-4efb-882c-673248b93e56 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:34.172175 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6743d-726a-4084-a405-6885294ce0f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:34.173701 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6743d-726a-4084-a405-6885294ce0f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:34.174141 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6743d-726a-4084-a405-6885294ce0f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:34.174590 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6743d-726a-4084-a405-6885294ce0f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:34.176030 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c8d76-8471-4cca-b94f-a61d6bb5fbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:34.176818 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c8d76-8471-4cca-b94f-a61d6bb5fbfc admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:34.177149 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c8d76-8471-4cca-b94f-a61d6bb5fbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:34.177466 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c8d76-8471-4cca-b94f-a61d6bb5fbfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:34.178207 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c8d76-8471-4cca-b94f-a61d6bb5fbfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:34.179876 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c8d76-8471-4cca-b94f-a61d6bb5fbfc admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:34.195322 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 990/1985] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:32:34.196205 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf6743d-726a-4084-a405-6885294ce0f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:34.200098 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c8d76-8471-4cca-b94f-a61d6bb5fbfc admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:34.205395 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf6743d-726a-4084-a405-6885294ce0f0 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:34.216707 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c8d76-8471-4cca-b94f-a61d6bb5fbfc admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:34.224289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861a652-6df8-4941-a7fb-b31c7c329b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:34.225139 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861a652-6df8-4941-a7fb-b31c7c329b62 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:34.225454 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861a652-6df8-4941-a7fb-b31c7c329b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:34.225737 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861a652-6df8-4941-a7fb-b31c7c329b62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:34.226466 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861a652-6df8-4941-a7fb-b31c7c329b62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:34.228160 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861a652-6df8-4941-a7fb-b31c7c329b62 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:34.231012 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 996/1986] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:32:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:32:34.241382 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 991/1987] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:32:34.246157 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6743d-726a-4084-a405-6885294ce0f0 service neutron] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:34.258616 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6743d-726a-4084-a405-6885294ce0f0 service neutron] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:34.268174 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4291c7e-288c-430d-aa35-c5108484c4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:34.269374 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4291c7e-288c-430d-aa35-c5108484c4fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:34.269936 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4291c7e-288c-430d-aa35-c5108484c4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:34.270477 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4291c7e-288c-430d-aa35-c5108484c4fa admin admin] PATH_INFO: `/v3/projects/9d5d4b7766db4e93b9ba42879f7c2889/users/5751a9832891464eb794ac1cbf656f14/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:34.301934 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4291c7e-288c-430d-aa35-c5108484c4fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d5d4b7766db4e93b9ba42879f7c2889, user_id=5751a9832891464eb794ac1cbf656f14, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:34.305870 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4291c7e-288c-430d-aa35-c5108484c4fa admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:34.336997 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 997/1988] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:32:34 2022] PUT /identity/v3/projects/9d5d4b7766db4e93b9ba42879f7c2889/users/5751a9832891464eb794ac1cbf656f14/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:32:34.348101 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e050b67-4b0e-4d8e-a995-a12fd35ca4ef None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:34.348757 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e050b67-4b0e-4d8e-a995-a12fd35ca4ef None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:34.349552 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e050b67-4b0e-4d8e-a995-a12fd35ca4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:34.409741 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-2e050b67-4b0e-4d8e-a995-a12fd35ca4ef None None] MFA Rules not processed for user `5751a9832891464eb794ac1cbf656f14`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:34.412128 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-2e050b67-4b0e-4d8e-a995-a12fd35ca4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:34.543179 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 992/1989] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:32:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:32:34.545850 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4291c7e-288c-430d-aa35-c5108484c4fa admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:34.573984 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:34.661077 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4291c7e-288c-430d-aa35-c5108484c4fa admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:34.667511 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6f188-c03e-464c-adf3-75c65893809b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:34.668153 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6f188-c03e-464c-adf3-75c65893809b admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:34.668442 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6f188-c03e-464c-adf3-75c65893809b admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:34.668751 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6f188-c03e-464c-adf3-75c65893809b admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:34.669401 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6f188-c03e-464c-adf3-75c65893809b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:34.671383 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6f188-c03e-464c-adf3-75c65893809b admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:34.707944 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 998/1990] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:32:34 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:32:34.712171 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e050b67-4b0e-4d8e-a995-a12fd35ca4ef None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:34.731193 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e050b67-4b0e-4d8e-a995-a12fd35ca4ef None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:34.775287 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6f188-c03e-464c-adf3-75c65893809b admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:34.778077 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-82a6f188-c03e-464c-adf3-75c65893809b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:34.808574 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:34.862203 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205070fb-a1ae-46d5-8128-3036da78108d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:34.862937 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205070fb-a1ae-46d5-8128-3036da78108d admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:34.863279 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205070fb-a1ae-46d5-8128-3036da78108d admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:34.863727 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205070fb-a1ae-46d5-8128-3036da78108d admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:34.864456 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205070fb-a1ae-46d5-8128-3036da78108d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:34.866518 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205070fb-a1ae-46d5-8128-3036da78108d admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:34.896998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6f188-c03e-464c-adf3-75c65893809b admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:34.903234 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98124c29-edb6-45de-97a6-ab4a25d78e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:34.903918 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98124c29-edb6-45de-97a6-ab4a25d78e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:34.904206 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98124c29-edb6-45de-97a6-ab4a25d78e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:34.904486 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98124c29-edb6-45de-97a6-ab4a25d78e5d admin admin] PATH_INFO: `/v3/projects/7b8d4932a3644478a9a4ea7f2dff9dd9` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:34.905667 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98124c29-edb6-45de-97a6-ab4a25d78e5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b8d4932a3644478a9a4ea7f2dff9dd9)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:34.907637 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98124c29-edb6-45de-97a6-ab4a25d78e5d admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:34.908993 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 993/1991] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:32:34 2022] POST /identity/v3/users => generated 295 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:32:34.912869 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205070fb-a1ae-46d5-8128-3036da78108d admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:34.927186 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205070fb-a1ae-46d5-8128-3036da78108d admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:34.933468 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a1868-a95d-4a57-82ae-57f0a1eeabde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:34.934439 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a1868-a95d-4a57-82ae-57f0a1eeabde admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:34.934928 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a1868-a95d-4a57-82ae-57f0a1eeabde admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:34.935453 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a1868-a95d-4a57-82ae-57f0a1eeabde admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:34.936369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a1868-a95d-4a57-82ae-57f0a1eeabde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:34.938942 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a1868-a95d-4a57-82ae-57f0a1eeabde admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:34.952183 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 994/1992] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:32:34.956362 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a1868-a95d-4a57-82ae-57f0a1eeabde admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:34.973937 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a1868-a95d-4a57-82ae-57f0a1eeabde admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:34.982727 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-98124c29-edb6-45de-97a6-ab4a25d78e5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b8d4932a3644478a9a4ea7f2dff9dd9', 'request_id': 'req-98124c29-edb6-45de-97a6-ab4a25d78e5d'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:34.998175 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-98124c29-edb6-45de-97a6-ab4a25d78e5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b8d4932a3644478a9a4ea7f2dff9dd9', 'request_id': 'req-98124c29-edb6-45de-97a6-ab4a25d78e5d'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:35.027337 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-98124c29-edb6-45de-97a6-ab4a25d78e5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b8d4932a3644478a9a4ea7f2dff9dd9', 'request_id': 'req-98124c29-edb6-45de-97a6-ab4a25d78e5d'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:35.047205 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-98124c29-edb6-45de-97a6-ab4a25d78e5d admin admin] The token cache is being invalidate because project 7b8d4932a3644478a9a4ea7f2dff9dd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:32:35.048047 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-98124c29-edb6-45de-97a6-ab4a25d78e5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:35.053334 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-98124c29-edb6-45de-97a6-ab4a25d78e5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:35.055959 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 999/1993] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:32:34 2022] DELETE /identity/v3/projects/7b8d4932a3644478a9a4ea7f2dff9dd9 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:32:35.183498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e1f0c-93fa-44fe-bbbc-5ee1205eed4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:35.184475 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e1f0c-93fa-44fe-bbbc-5ee1205eed4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:35.186656 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e1f0c-93fa-44fe-bbbc-5ee1205eed4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:35.186656 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e1f0c-93fa-44fe-bbbc-5ee1205eed4d admin admin] PATH_INFO: `/v3/projects/36472e8e066f44bd8101bee9deb041ce/users/ad4387b042ce49caa9324a3e5e230434/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:35.213684 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e1f0c-93fa-44fe-bbbc-5ee1205eed4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=36472e8e066f44bd8101bee9deb041ce, user_id=ad4387b042ce49caa9324a3e5e230434, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:35.217994 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e1f0c-93fa-44fe-bbbc-5ee1205eed4d admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:35.271731 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 995/1994] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:32:34 2022] PUT /identity/v3/projects/36472e8e066f44bd8101bee9deb041ce/users/ad4387b042ce49caa9324a3e5e230434/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:32:35.273241 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98124c29-edb6-45de-97a6-ab4a25d78e5d admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:35.278324 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-98124c29-edb6-45de-97a6-ab4a25d78e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:35.296383 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98124c29-edb6-45de-97a6-ab4a25d78e5d admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:35.331608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:35.402631 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a14bf-ff74-4244-97b2-b38f605dd9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:35.403303 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a14bf-ff74-4244-97b2-b38f605dd9de admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:35.403612 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a14bf-ff74-4244-97b2-b38f605dd9de admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:35.403897 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a14bf-ff74-4244-97b2-b38f605dd9de admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:35.404736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a14bf-ff74-4244-97b2-b38f605dd9de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:35.406444 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a14bf-ff74-4244-97b2-b38f605dd9de admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:35.418848 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1000/1995] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:32:35.424101 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e1f0c-93fa-44fe-bbbc-5ee1205eed4d admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:35.444052 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e1f0c-93fa-44fe-bbbc-5ee1205eed4d admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:35.449850 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65452ce1-84d6-47aa-9797-cf46f69711cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:35.451473 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65452ce1-84d6-47aa-9797-cf46f69711cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:35.451763 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65452ce1-84d6-47aa-9797-cf46f69711cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:35.452038 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65452ce1-84d6-47aa-9797-cf46f69711cf admin admin] PATH_INFO: `/v3/projects/36472e8e066f44bd8101bee9deb041ce/users/ad4387b042ce49caa9324a3e5e230434/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:35.454667 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65452ce1-84d6-47aa-9797-cf46f69711cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=36472e8e066f44bd8101bee9deb041ce, user_id=ad4387b042ce49caa9324a3e5e230434, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:35.457997 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65452ce1-84d6-47aa-9797-cf46f69711cf admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:35.476429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 996/1996] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:32:35 2022] PUT /identity/v3/projects/36472e8e066f44bd8101bee9deb041ce/users/ad4387b042ce49caa9324a3e5e230434/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:32:35.488269 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee0443-0c8b-4c59-98eb-09f9fa18f71a None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:35.488269 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee0443-0c8b-4c59-98eb-09f9fa18f71a None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:35.488847 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee0443-0c8b-4c59-98eb-09f9fa18f71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:35.576242 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-3bee0443-0c8b-4c59-98eb-09f9fa18f71a None None] MFA Rules not processed for user `ad4387b042ce49caa9324a3e5e230434`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:35.577578 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-3bee0443-0c8b-4c59-98eb-09f9fa18f71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:35.708985 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1001/1997] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:32:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:32:35.710006 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65452ce1-84d6-47aa-9797-cf46f69711cf admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:35.711779 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-65452ce1-84d6-47aa-9797-cf46f69711cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:35.809355 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65452ce1-84d6-47aa-9797-cf46f69711cf admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:35.813429 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ad929-0ffe-46a1-875c-6a38fdf1c745 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:35.814410 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ad929-0ffe-46a1-875c-6a38fdf1c745 service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:35.814702 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ad929-0ffe-46a1-875c-6a38fdf1c745 service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:35.815099 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ad929-0ffe-46a1-875c-6a38fdf1c745 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:35.818589 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-406ad929-0ffe-46a1-875c-6a38fdf1c745 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:35.871243 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:35.908921 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ad929-0ffe-46a1-875c-6a38fdf1c745 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:35.910609 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ad929-0ffe-46a1-875c-6a38fdf1c745 service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:35.927016 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 997/1998] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:32:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:32:36.684473 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dc958-2256-40ca-98cb-d82e300c3ae5 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:36.685049 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dc958-2256-40ca-98cb-d82e300c3ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:36.685049 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dc958-2256-40ca-98cb-d82e300c3ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:36.719180 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-951dc958-2256-40ca-98cb-d82e300c3ae5 None None] MFA Rules not processed for user `66937804f65147f392f4ddfc3e961d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:36.720762 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-951dc958-2256-40ca-98cb-d82e300c3ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:36.807077 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1002/1999] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Nov 2 20:32:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:32:36.826224 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ad929-0ffe-46a1-875c-6a38fdf1c745 service cinder] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:36.829027 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-406ad929-0ffe-46a1-875c-6a38fdf1c745 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:36.950466 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ad929-0ffe-46a1-875c-6a38fdf1c745 service cinder] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:36.958290 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929f086-0607-4b0f-aed5-ca52089af36b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f22f80ac694e9888c132af1e58e292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:36.960189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929f086-0607-4b0f-aed5-ca52089af36b service swift] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:36.960189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929f086-0607-4b0f-aed5-ca52089af36b service swift] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:36.960425 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929f086-0607-4b0f-aed5-ca52089af36b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:36.973248 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929f086-0607-4b0f-aed5-ca52089af36b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:36.975570 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929f086-0607-4b0f-aed5-ca52089af36b service swift] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:37.003487 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 998/2000] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Nov 2 20:32:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 20:32:37.908258 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951dc958-2256-40ca-98cb-d82e300c3ae5 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:37.909787 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-951dc958-2256-40ca-98cb-d82e300c3ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:37.944266 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951dc958-2256-40ca-98cb-d82e300c3ae5 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:37.948254 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7005c9f-1586-41b5-8ad9-8d1d82dfd915 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:37.949118 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7005c9f-1586-41b5-8ad9-8d1d82dfd915 service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:37.949588 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7005c9f-1586-41b5-8ad9-8d1d82dfd915 service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:37.949933 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7005c9f-1586-41b5-8ad9-8d1d82dfd915 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:37.960209 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-d7005c9f-1586-41b5-8ad9-8d1d82dfd915 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:38.085996 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:38.105445 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7005c9f-1586-41b5-8ad9-8d1d82dfd915 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:38.106885 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7005c9f-1586-41b5-8ad9-8d1d82dfd915 service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:38.129104 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1003/2001] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:32:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:32:39.604585 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929f086-0607-4b0f-aed5-ca52089af36b service swift] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:39.619685 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929f086-0607-4b0f-aed5-ca52089af36b service swift] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:39.631415 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d76b4-7233-473e-aea4-45a0db81c026 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:39.632326 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d76b4-7233-473e-aea4-45a0db81c026 service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:39.632884 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d76b4-7233-473e-aea4-45a0db81c026 service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:39.633387 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d76b4-7233-473e-aea4-45a0db81c026 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:39.657487 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d76b4-7233-473e-aea4-45a0db81c026 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:39.659310 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d76b4-7233-473e-aea4-45a0db81c026 service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:39.682789 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 999/2002] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:32:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:32:44.154049 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7005c9f-1586-41b5-8ad9-8d1d82dfd915 service cinder] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:44.222100 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7005c9f-1586-41b5-8ad9-8d1d82dfd915 service cinder] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:44.226621 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752e67f-db90-4431-a7d0-e39f21e32a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:44.227262 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752e67f-db90-4431-a7d0-e39f21e32a9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:44.227545 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752e67f-db90-4431-a7d0-e39f21e32a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:44.227823 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752e67f-db90-4431-a7d0-e39f21e32a9b admin admin] PATH_INFO: `/v3/users/e41e58f45ee04cea967f0e5364c8b33a` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:44.229016 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752e67f-db90-4431-a7d0-e39f21e32a9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e41e58f45ee04cea967f0e5364c8b33a)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:44.230973 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752e67f-db90-4431-a7d0-e39f21e32a9b admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:44.289484 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-3752e67f-db90-4431-a7d0-e39f21e32a9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e41e58f45ee04cea967f0e5364c8b33a'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:44.290601 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-3752e67f-db90-4431-a7d0-e39f21e32a9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e41e58f45ee04cea967f0e5364c8b33a'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:44.300668 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-3752e67f-db90-4431-a7d0-e39f21e32a9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e41e58f45ee04cea967f0e5364c8b33a'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:44.301424 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-3752e67f-db90-4431-a7d0-e39f21e32a9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e41e58f45ee04cea967f0e5364c8b33a'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:44.315276 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-3752e67f-db90-4431-a7d0-e39f21e32a9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e41e58f45ee04cea967f0e5364c8b33a'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:44.332234 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1004/2003] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:32:44 2022] DELETE /identity/v3/users/e41e58f45ee04cea967f0e5364c8b33a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:32:44.337028 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf919a-ba46-43c8-9b9b-d19ef8e22976 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:44.337616 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf919a-ba46-43c8-9b9b-d19ef8e22976 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:44.337616 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf919a-ba46-43c8-9b9b-d19ef8e22976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:44.360171 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-43bf919a-ba46-43c8-9b9b-d19ef8e22976 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:44.364174 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-43bf919a-ba46-43c8-9b9b-d19ef8e22976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:44.436713 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1000/2004] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:32:44.452700 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752e67f-db90-4431-a7d0-e39f21e32a9b admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:44.455110 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-3752e67f-db90-4431-a7d0-e39f21e32a9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:44.535537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752e67f-db90-4431-a7d0-e39f21e32a9b admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:44.540023 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdb279-64fe-4298-ad5d-4724f9ae3aa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:44.540715 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdb279-64fe-4298-ad5d-4724f9ae3aa5 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:44.541213 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdb279-64fe-4298-ad5d-4724f9ae3aa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:44.541548 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdb279-64fe-4298-ad5d-4724f9ae3aa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:44.563119 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fdb279-64fe-4298-ad5d-4724f9ae3aa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:44.564834 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fdb279-64fe-4298-ad5d-4724f9ae3aa5 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:44.577147 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1005/2005] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:32:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:32:44.952598 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf919a-ba46-43c8-9b9b-d19ef8e22976 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:44.955298 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-43bf919a-ba46-43c8-9b9b-d19ef8e22976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:44.983415 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf919a-ba46-43c8-9b9b-d19ef8e22976 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:44.989167 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e799e-4251-4ed2-bfad-77fc924b847a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:44.999629 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e799e-4251-4ed2-bfad-77fc924b847a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:44.999931 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e799e-4251-4ed2-bfad-77fc924b847a admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:45.000215 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e799e-4251-4ed2-bfad-77fc924b847a admin admin] PATH_INFO: `/v3/projects/302bef42d2cd4a5aa7475ae268bed59f` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:45.001619 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e799e-4251-4ed2-bfad-77fc924b847a admin admin] RBAC: Authorizing `identity:delete_project(project_id=302bef42d2cd4a5aa7475ae268bed59f)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:45.004086 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e799e-4251-4ed2-bfad-77fc924b847a admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:45.060270 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-6e1e799e-4251-4ed2-bfad-77fc924b847a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '302bef42d2cd4a5aa7475ae268bed59f', 'request_id': 'req-6e1e799e-4251-4ed2-bfad-77fc924b847a'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:45.062458 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:45.067997 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-6e1e799e-4251-4ed2-bfad-77fc924b847a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '302bef42d2cd4a5aa7475ae268bed59f', 'request_id': 'req-6e1e799e-4251-4ed2-bfad-77fc924b847a'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:45.074933 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-6e1e799e-4251-4ed2-bfad-77fc924b847a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '302bef42d2cd4a5aa7475ae268bed59f', 'request_id': 'req-6e1e799e-4251-4ed2-bfad-77fc924b847a'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:45.094877 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-6e1e799e-4251-4ed2-bfad-77fc924b847a admin admin] The token cache is being invalidate because project 302bef42d2cd4a5aa7475ae268bed59f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:32:45.095192 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-6e1e799e-4251-4ed2-bfad-77fc924b847a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:45.095911 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-6e1e799e-4251-4ed2-bfad-77fc924b847a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:45.097506 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1001/2006] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:32:44 2022] DELETE /identity/v3/projects/302bef42d2cd4a5aa7475ae268bed59f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:32:45.101572 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdb279-64fe-4298-ad5d-4724f9ae3aa5 service neutron] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:45.113435 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdb279-64fe-4298-ad5d-4724f9ae3aa5 service neutron] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:45.123407 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:45.175772 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b7643-aec5-4dc1-b06f-44fa161ef121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:45.176473 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b7643-aec5-4dc1-b06f-44fa161ef121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:45.176650 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b7643-aec5-4dc1-b06f-44fa161ef121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:45.176934 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b7643-aec5-4dc1-b06f-44fa161ef121 admin admin] PATH_INFO: `/v3/users/5751a9832891464eb794ac1cbf656f14` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:45.178362 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b7643-aec5-4dc1-b06f-44fa161ef121 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5751a9832891464eb794ac1cbf656f14)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:45.180299 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b7643-aec5-4dc1-b06f-44fa161ef121 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:45.232791 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-711b7643-aec5-4dc1-b06f-44fa161ef121 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5751a9832891464eb794ac1cbf656f14'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:45.233496 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-711b7643-aec5-4dc1-b06f-44fa161ef121 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5751a9832891464eb794ac1cbf656f14'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:45.241658 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-711b7643-aec5-4dc1-b06f-44fa161ef121 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5751a9832891464eb794ac1cbf656f14'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:45.242359 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-711b7643-aec5-4dc1-b06f-44fa161ef121 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5751a9832891464eb794ac1cbf656f14'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:45.256197 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-711b7643-aec5-4dc1-b06f-44fa161ef121 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5751a9832891464eb794ac1cbf656f14'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:45.269429 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1006/2007] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:32:45 2022] DELETE /identity/v3/users/5751a9832891464eb794ac1cbf656f14 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:32:45.604126 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e799e-4251-4ed2-bfad-77fc924b847a admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:45.607754 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-6e1e799e-4251-4ed2-bfad-77fc924b847a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:45.636730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e799e-4251-4ed2-bfad-77fc924b847a admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:45.733170 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135d96d-f775-4400-a50d-536df3b47bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:45.733818 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135d96d-f775-4400-a50d-536df3b47bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:45.734099 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135d96d-f775-4400-a50d-536df3b47bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:45.734380 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135d96d-f775-4400-a50d-536df3b47bd2 admin admin] PATH_INFO: `/v3/projects/9d5d4b7766db4e93b9ba42879f7c2889` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:45.735548 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4135d96d-f775-4400-a50d-536df3b47bd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d5d4b7766db4e93b9ba42879f7c2889)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:45.737561 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4135d96d-f775-4400-a50d-536df3b47bd2 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:45.802109 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4135d96d-f775-4400-a50d-536df3b47bd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d5d4b7766db4e93b9ba42879f7c2889', 'request_id': 'req-4135d96d-f775-4400-a50d-536df3b47bd2'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:45.808269 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4135d96d-f775-4400-a50d-536df3b47bd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d5d4b7766db4e93b9ba42879f7c2889', 'request_id': 'req-4135d96d-f775-4400-a50d-536df3b47bd2'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:45.819011 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4135d96d-f775-4400-a50d-536df3b47bd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d5d4b7766db4e93b9ba42879f7c2889', 'request_id': 'req-4135d96d-f775-4400-a50d-536df3b47bd2'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:45.840223 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4135d96d-f775-4400-a50d-536df3b47bd2 admin admin] The token cache is being invalidate because project 9d5d4b7766db4e93b9ba42879f7c2889 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:32:45.840724 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4135d96d-f775-4400-a50d-536df3b47bd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:45.841518 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4135d96d-f775-4400-a50d-536df3b47bd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:45.846218 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1002/2008] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:32:45 2022] DELETE /identity/v3/projects/9d5d4b7766db4e93b9ba42879f7c2889 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:32:45.847466 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b7643-aec5-4dc1-b06f-44fa161ef121 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:45.849192 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-711b7643-aec5-4dc1-b06f-44fa161ef121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:45.868677 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b7643-aec5-4dc1-b06f-44fa161ef121 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:45.953249 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaadc40-9f03-4fff-aef8-73ab59cbc9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:45.954424 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaadc40-9f03-4fff-aef8-73ab59cbc9a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:45.954713 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaadc40-9f03-4fff-aef8-73ab59cbc9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:45.954996 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaadc40-9f03-4fff-aef8-73ab59cbc9a0 admin admin] PATH_INFO: `/v3/users/ad4387b042ce49caa9324a3e5e230434` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:45.956389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaadc40-9f03-4fff-aef8-73ab59cbc9a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad4387b042ce49caa9324a3e5e230434)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:45.958387 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaadc40-9f03-4fff-aef8-73ab59cbc9a0 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:46.020832 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:46.039618 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-9eaadc40-9f03-4fff-aef8-73ab59cbc9a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad4387b042ce49caa9324a3e5e230434'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:46.040310 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-9eaadc40-9f03-4fff-aef8-73ab59cbc9a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad4387b042ce49caa9324a3e5e230434'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:46.048321 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-9eaadc40-9f03-4fff-aef8-73ab59cbc9a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad4387b042ce49caa9324a3e5e230434'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:46.049062 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-9eaadc40-9f03-4fff-aef8-73ab59cbc9a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad4387b042ce49caa9324a3e5e230434'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:46.063940 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-9eaadc40-9f03-4fff-aef8-73ab59cbc9a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad4387b042ce49caa9324a3e5e230434'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:46.078512 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1007/2009] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:32:45 2022] DELETE /identity/v3/users/ad4387b042ce49caa9324a3e5e230434 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:32:46.390998 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135d96d-f775-4400-a50d-536df3b47bd2 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:46.396572 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-4135d96d-f775-4400-a50d-536df3b47bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:46.410612 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135d96d-f775-4400-a50d-536df3b47bd2 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:46.485409 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d96710-65ab-4664-908a-70165d4925ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:46.485974 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d96710-65ab-4664-908a-70165d4925ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:46.486257 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d96710-65ab-4664-908a-70165d4925ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:46.486535 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d96710-65ab-4664-908a-70165d4925ae admin admin] PATH_INFO: `/v3/projects/36472e8e066f44bd8101bee9deb041ce` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:46.487654 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d96710-65ab-4664-908a-70165d4925ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=36472e8e066f44bd8101bee9deb041ce)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:46.490158 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d96710-65ab-4664-908a-70165d4925ae admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:46.504758 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:46.547854 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-f4d96710-65ab-4664-908a-70165d4925ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36472e8e066f44bd8101bee9deb041ce', 'request_id': 'req-f4d96710-65ab-4664-908a-70165d4925ae'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:46.554031 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-f4d96710-65ab-4664-908a-70165d4925ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36472e8e066f44bd8101bee9deb041ce', 'request_id': 'req-f4d96710-65ab-4664-908a-70165d4925ae'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:46.560840 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-f4d96710-65ab-4664-908a-70165d4925ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36472e8e066f44bd8101bee9deb041ce', 'request_id': 'req-f4d96710-65ab-4664-908a-70165d4925ae'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:46.575010 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-f4d96710-65ab-4664-908a-70165d4925ae admin admin] The token cache is being invalidate because project 36472e8e066f44bd8101bee9deb041ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:32:46.575338 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-f4d96710-65ab-4664-908a-70165d4925ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:46.575982 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-f4d96710-65ab-4664-908a-70165d4925ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:32:46.578155 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1003/2010] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:32:46 2022] DELETE /identity/v3/projects/36472e8e066f44bd8101bee9deb041ce => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:32:56.074401 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=16,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:32:56.232794 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc734b8-95de-4047-b163-34686da88c23 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:56.233140 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc734b8-95de-4047-b163-34686da88c23 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:56.233347 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc734b8-95de-4047-b163-34686da88c23 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:56.234783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1008/2011] 10.222.0.23 () {54 vars in 921 bytes} [Wed Nov 2 20:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:32:56.241631 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d25dc-4622-4539-8c34-1335b327dde2 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:56.242667 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d25dc-4622-4539-8c34-1335b327dde2 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:56.243399 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d25dc-4622-4539-8c34-1335b327dde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:56.272019 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-612d25dc-4622-4539-8c34-1335b327dde2 None None] MFA Rules not processed for user `f906fd11db004026a78eb3d69fa5b298`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:56.274260 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-612d25dc-4622-4539-8c34-1335b327dde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:56.393186 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1004/2012] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Nov 2 20:32:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:32:56.408514 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc734b8-95de-4047-b163-34686da88c23 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:56.410504 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-5bc734b8-95de-4047-b163-34686da88c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:56.474563 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc734b8-95de-4047-b163-34686da88c23 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:56.478314 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c23d2-c599-40f9-bec8-f7b7100d0e6d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62ca656e59ff46b08661385d8ec79846', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:56.478928 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c23d2-c599-40f9-bec8-f7b7100d0e6d service glance] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:56.479213 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c23d2-c599-40f9-bec8-f7b7100d0e6d service glance] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:56.479494 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c23d2-c599-40f9-bec8-f7b7100d0e6d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:56.490244 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c23d2-c599-40f9-bec8-f7b7100d0e6d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:56.491673 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c23d2-c599-40f9-bec8-f7b7100d0e6d service glance] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:56.503066 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1009/2013] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:32:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:32:56.573574 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630d836-f252-4570-8999-560e1daeb476 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:56.573887 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630d836-f252-4570-8999-560e1daeb476 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:56.574167 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630d836-f252-4570-8999-560e1daeb476 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:56.575556 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1005/2014] 10.222.0.23 () {54 vars in 921 bytes} [Wed Nov 2 20:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:32:56.581632 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649681dc-7d3b-4654-95df-ec088ba3854c None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:56.581952 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649681dc-7d3b-4654-95df-ec088ba3854c None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:56.582236 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649681dc-7d3b-4654-95df-ec088ba3854c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:56.602036 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-649681dc-7d3b-4654-95df-ec088ba3854c None None] MFA Rules not processed for user `fdb57cba49ce43ad95096047859dfe1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:56.603561 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-649681dc-7d3b-4654-95df-ec088ba3854c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:56.654131 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1010/2015] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Nov 2 20:32:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:32:56.665828 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630d836-f252-4570-8999-560e1daeb476 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:56.667705 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-0630d836-f252-4570-8999-560e1daeb476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:56.681306 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630d836-f252-4570-8999-560e1daeb476 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:56.684840 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90b378-ad4c-48aa-8e86-d4ef8a3b1c10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:56.685426 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90b378-ad4c-48aa-8e86-d4ef8a3b1c10 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:56.685711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90b378-ad4c-48aa-8e86-d4ef8a3b1c10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:56.685989 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90b378-ad4c-48aa-8e86-d4ef8a3b1c10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:56.693678 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b90b378-ad4c-48aa-8e86-d4ef8a3b1c10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:56.695146 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b90b378-ad4c-48aa-8e86-d4ef8a3b1c10 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:56.703261 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1006/2016] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:32:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:32:56.787268 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773518e-ab4b-4718-be1e-5031f3ce5547 None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:56.787608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773518e-ab4b-4718-be1e-5031f3ce5547 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:56.787894 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773518e-ab4b-4718-be1e-5031f3ce5547 None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:56.789348 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1011/2017] 10.222.0.23 () {54 vars in 921 bytes} [Wed Nov 2 20:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:32:56.794775 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eccaca-bcfe-4230-b687-47c490c1f7ac None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:56.795065 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eccaca-bcfe-4230-b687-47c490c1f7ac None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:56.795344 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eccaca-bcfe-4230-b687-47c490c1f7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:56.814883 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-f3eccaca-bcfe-4230-b687-47c490c1f7ac None None] MFA Rules not processed for user `f906fd11db004026a78eb3d69fa5b298`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:56.816146 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-f3eccaca-bcfe-4230-b687-47c490c1f7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:56.825618 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1007/2018] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Nov 2 20:32:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:32:56.836748 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6773518e-ab4b-4718-be1e-5031f3ce5547 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:32:56.838504 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-6773518e-ab4b-4718-be1e-5031f3ce5547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:56.852355 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6773518e-ab4b-4718-be1e-5031f3ce5547 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:32:56.856012 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e33627-7591-463b-9c89-7d7f81724c2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:32:56.856651 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e33627-7591-463b-9c89-7d7f81724c2b service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:56.856939 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e33627-7591-463b-9c89-7d7f81724c2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:56.857381 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e33627-7591-463b-9c89-7d7f81724c2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:56.867408 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e33627-7591-463b-9c89-7d7f81724c2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:32:56.868855 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e33627-7591-463b-9c89-7d7f81724c2b service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:32:56.880556 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1012/2019] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:32:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:32:59.740248 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca616fd-7864-4455-be7e-7f51d6078ca1 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:32:59.740800 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca616fd-7864-4455-be7e-7f51d6078ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:32:59.740923 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca616fd-7864-4455-be7e-7f51d6078ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:32:59.761600 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-7ca616fd-7864-4455-be7e-7f51d6078ca1 None None] MFA Rules not processed for user `13d6d307bd3b436f9f18be0e762038fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:32:59.762795 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-7ca616fd-7864-4455-be7e-7f51d6078ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:32:59.816453 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1008/2020] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:32:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:33:00.475443 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac79bda-d489-4971-bdd2-25d4503b58c2 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:33:00.475925 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac79bda-d489-4971-bdd2-25d4503b58c2 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:33:00.476031 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac79bda-d489-4971-bdd2-25d4503b58c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:33:00.500067 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-6ac79bda-d489-4971-bdd2-25d4503b58c2 None None] MFA Rules not processed for user `66937804f65147f392f4ddfc3e961d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:33:00.501389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-6ac79bda-d489-4971-bdd2-25d4503b58c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:33:00.573339 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1013/2021] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Nov 2 20:33:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:33:00.599668 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca616fd-7864-4455-be7e-7f51d6078ca1 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:33:00.601195 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-7ca616fd-7864-4455-be7e-7f51d6078ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:33:00.623858 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:33:00.689649 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca616fd-7864-4455-be7e-7f51d6078ca1 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:33:00.694782 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632d4ae-a1a9-4059-945e-bac485865100 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f22f80ac694e9888c132af1e58e292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:33:00.695400 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632d4ae-a1a9-4059-945e-bac485865100 service swift] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:33:00.695683 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632d4ae-a1a9-4059-945e-bac485865100 service swift] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:33:00.695961 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632d4ae-a1a9-4059-945e-bac485865100 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:33:00.705330 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0632d4ae-a1a9-4059-945e-bac485865100 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:33:00.707438 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0632d4ae-a1a9-4059-945e-bac485865100 service swift] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:33:00.716978 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1009/2022] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Nov 2 20:33:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 20:33:10.566746 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=80 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:33:10.712604 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=24 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:33:13.977846 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac79bda-d489-4971-bdd2-25d4503b58c2 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:33:13.987420 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac79bda-d489-4971-bdd2-25d4503b58c2 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:33:13.991594 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c863a2d-0e6b-4d6d-9c9b-9fd74737ad4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:33:13.992203 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c863a2d-0e6b-4d6d-9c9b-9fd74737ad4b service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:33:13.992539 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c863a2d-0e6b-4d6d-9c9b-9fd74737ad4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:33:13.992854 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c863a2d-0e6b-4d6d-9c9b-9fd74737ad4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:33:13.994605 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-7c863a2d-0e6b-4d6d-9c9b-9fd74737ad4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:33:14.059561 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c863a2d-0e6b-4d6d-9c9b-9fd74737ad4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:33:14.061037 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c863a2d-0e6b-4d6d-9c9b-9fd74737ad4b service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:33:14.070880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1014/2023] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:33:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:33:15.471232 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e70831-487b-4ba0-863b-25eb343b3b04 None None] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:33:15.471690 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e70831-487b-4ba0-863b-25eb343b3b04 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:33:15.471779 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e70831-487b-4ba0-863b-25eb343b3b04 None None] PATH_INFO: `/` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:33:15.473201 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1010/2024] 10.222.0.23 () {54 vars in 961 bytes} [Wed Nov 2 20:33:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:33:15.480604 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c0ca6-03d1-4064-816d-a722c96c6874 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:33:15.482173 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c0ca6-03d1-4064-816d-a722c96c6874 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:33:15.482702 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c0ca6-03d1-4064-816d-a722c96c6874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:33:15.506483 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-408c0ca6-03d1-4064-816d-a722c96c6874 None None] MFA Rules not processed for user `603a9f31ae814003a2cbd02f964f4ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:33:15.507874 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-408c0ca6-03d1-4064-816d-a722c96c6874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:33:15.600231 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1015/2025] 10.222.0.23 () {58 vars in 1058 bytes} [Wed Nov 2 20:33:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:33:15.607712 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e70831-487b-4ba0-863b-25eb343b3b04 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:33:15.627698 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e70831-487b-4ba0-863b-25eb343b3b04 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:33:15.641515 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407a0f9-fa1b-4eee-ad7e-7e3adaa88570 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603a9f31ae814003a2cbd02f964f4ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:33:15.642249 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407a0f9-fa1b-4eee-ad7e-7e3adaa88570 service placement] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:33:15.642968 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407a0f9-fa1b-4eee-ad7e-7e3adaa88570 service placement] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:33:15.643397 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407a0f9-fa1b-4eee-ad7e-7e3adaa88570 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:33:15.646030 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-d407a0f9-fa1b-4eee-ad7e-7e3adaa88570 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:33:15.659158 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407a0f9-fa1b-4eee-ad7e-7e3adaa88570 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:33:15.663137 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407a0f9-fa1b-4eee-ad7e-7e3adaa88570 service placement] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:33:15.672053 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1011/2026] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:33:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:33:19.414966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948ae45-fdd5-4dd0-a5c6-24d92304bf02 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:33:19.414966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948ae45-fdd5-4dd0-a5c6-24d92304bf02 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:33:19.414966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948ae45-fdd5-4dd0-a5c6-24d92304bf02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:33:19.441015 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-0948ae45-fdd5-4dd0-a5c6-24d92304bf02 None None] MFA Rules not processed for user `66937804f65147f392f4ddfc3e961d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:33:19.443505 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-0948ae45-fdd5-4dd0-a5c6-24d92304bf02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:33:19.453561 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1016/2027] 10.222.0.23 () {58 vars in 967 bytes} [Wed Nov 2 20:33:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:33:19.467915 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407a0f9-fa1b-4eee-ad7e-7e3adaa88570 service placement] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:33:19.480456 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407a0f9-fa1b-4eee-ad7e-7e3adaa88570 service placement] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:33:19.486791 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355ba31-f018-44e5-8ce4-f1287f539c66 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f22f80ac694e9888c132af1e58e292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:33:19.487602 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355ba31-f018-44e5-8ce4-f1287f539c66 service swift] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:33:19.488031 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355ba31-f018-44e5-8ce4-f1287f539c66 service swift] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:33:19.488479 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355ba31-f018-44e5-8ce4-f1287f539c66 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:33:19.502092 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355ba31-f018-44e5-8ce4-f1287f539c66 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:33:19.504127 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355ba31-f018-44e5-8ce4-f1287f539c66 service swift] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:33:19.531468 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1012/2028] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Nov 2 20:33:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 20:33:29.431632 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=62 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:33:29.511840 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=12 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:34:01.142346 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44f385-2f6a-4674-877d-271c08213d6e None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:34:01.142881 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44f385-2f6a-4674-877d-271c08213d6e None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:34:01.142881 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44f385-2f6a-4674-877d-271c08213d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:34:01.161844 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-5a44f385-2f6a-4674-877d-271c08213d6e None None] MFA Rules not processed for user `4bd602c085ad406eab3705dc8500a003`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:34:01.163030 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-5a44f385-2f6a-4674-877d-271c08213d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:34:01.219584 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1017/2029] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:34:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:34:11.213965 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=25 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:34:14.450994 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa8c6a-ee2b-45c7-9186-6d9e7fed7948 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:34:14.451562 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa8c6a-ee2b-45c7-9186-6d9e7fed7948 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:34:14.451562 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa8c6a-ee2b-45c7-9186-6d9e7fed7948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:34:14.470770 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-48fa8c6a-ee2b-45c7-9186-6d9e7fed7948 None None] MFA Rules not processed for user `469b5cd3abf74c7984dd02faa1abfcd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:34:14.471965 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-48fa8c6a-ee2b-45c7-9186-6d9e7fed7948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:34:14.530821 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1013/2030] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:34:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:34:19.059981 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ed205-6878-42f7-b4d0-21714a4281c0 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:34:19.060596 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ed205-6878-42f7-b4d0-21714a4281c0 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:34:19.060596 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ed205-6878-42f7-b4d0-21714a4281c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:34:19.082183 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-5f6ed205-6878-42f7-b4d0-21714a4281c0 None None] MFA Rules not processed for user `6147bac8e2104d04b727c1e3bc7fff6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:34:19.083419 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-5f6ed205-6878-42f7-b4d0-21714a4281c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:34:19.145581 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1018/2031] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:34:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:34:24.520178 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=25 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:34:27.923441 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981dec53-518c-45d3-83f8-9c9eaa26f13b None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:34:27.924042 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981dec53-518c-45d3-83f8-9c9eaa26f13b None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:34:27.924042 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981dec53-518c-45d3-83f8-9c9eaa26f13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:34:27.943486 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-981dec53-518c-45d3-83f8-9c9eaa26f13b None None] MFA Rules not processed for user `13d6d307bd3b436f9f18be0e762038fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:34:27.944734 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-981dec53-518c-45d3-83f8-9c9eaa26f13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:34:27.951755 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1014/2032] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:34:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:34:29.138622 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=25 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:34:37.937810 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=3 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:34:51.268798 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90e47e-ef98-4dc5-aded-dbf0745a4d7c None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:34:51.269263 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90e47e-ef98-4dc5-aded-dbf0745a4d7c None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:34:51.269366 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90e47e-ef98-4dc5-aded-dbf0745a4d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:34:51.290383 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-0e90e47e-ef98-4dc5-aded-dbf0745a4d7c None None] MFA Rules not processed for user `66937804f65147f392f4ddfc3e961d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:34:51.291601 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-0e90e47e-ef98-4dc5-aded-dbf0745a4d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:34:51.298870 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1019/2033] 10.222.0.23 () {58 vars in 967 bytes} [Wed Nov 2 20:34:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:34:51.351285 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981dec53-518c-45d3-83f8-9c9eaa26f13b None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:34:51.365262 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981dec53-518c-45d3-83f8-9c9eaa26f13b None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:34:51.370427 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f1cd7-ddd6-428e-9849-1c5c9702b345 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f22f80ac694e9888c132af1e58e292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:34:51.371072 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f1cd7-ddd6-428e-9849-1c5c9702b345 service swift] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:34:51.371366 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f1cd7-ddd6-428e-9849-1c5c9702b345 service swift] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:34:51.371652 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f1cd7-ddd6-428e-9849-1c5c9702b345 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:34:51.380131 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f1cd7-ddd6-428e-9849-1c5c9702b345 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:34:51.381824 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f1cd7-ddd6-428e-9849-1c5c9702b345 service swift] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:34:51.390448 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1015/2034] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Nov 2 20:34:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 20:34:55.292490 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72a43a-1523-4a4e-b1a5-4dbfb46eed6e None None] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:34:55.294118 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72a43a-1523-4a4e-b1a5-4dbfb46eed6e None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:34:55.294679 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72a43a-1523-4a4e-b1a5-4dbfb46eed6e None None] PATH_INFO: `/` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:34:55.298134 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1020/2035] 10.222.0.23 () {54 vars in 921 bytes} [Wed Nov 2 20:34:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 20:34:55.302441 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6113a68-13e3-4ae0-8b2b-b229bb8905fd None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:34:55.303385 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6113a68-13e3-4ae0-8b2b-b229bb8905fd None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:34:55.304002 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6113a68-13e3-4ae0-8b2b-b229bb8905fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:34:55.336934 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-b6113a68-13e3-4ae0-8b2b-b229bb8905fd None None] MFA Rules not processed for user `603a9f31ae814003a2cbd02f964f4ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:34:55.338905 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-b6113a68-13e3-4ae0-8b2b-b229bb8905fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:34:55.355842 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1016/2036] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Nov 2 20:34:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:34:55.376566 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72a43a-1523-4a4e-b1a5-4dbfb46eed6e None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:34:55.386813 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-3d72a43a-1523-4a4e-b1a5-4dbfb46eed6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:34:55.405956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72a43a-1523-4a4e-b1a5-4dbfb46eed6e None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:34:55.411776 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09481a8b-d2e4-4d40-92c5-9a75097d55d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603a9f31ae814003a2cbd02f964f4ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:34:55.412484 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09481a8b-d2e4-4d40-92c5-9a75097d55d9 service placement] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:34:55.413017 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09481a8b-d2e4-4d40-92c5-9a75097d55d9 service placement] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:34:55.413596 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09481a8b-d2e4-4d40-92c5-9a75097d55d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:34:55.423348 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09481a8b-d2e4-4d40-92c5-9a75097d55d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:34:55.425122 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09481a8b-d2e4-4d40-92c5-9a75097d55d9 service placement] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:34:55.445636 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1021/2037] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:34:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:34:58.754566 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6113a68-13e3-4ae0-8b2b-b229bb8905fd None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:34:58.756193 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-b6113a68-13e3-4ae0-8b2b-b229bb8905fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:34:58.825080 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6113a68-13e3-4ae0-8b2b-b229bb8905fd None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:34:58.829663 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be076198-cd63-4b77-9f53-6a0b1534c3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:34:58.830295 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be076198-cd63-4b77-9f53-6a0b1534c3ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:34:58.830580 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be076198-cd63-4b77-9f53-6a0b1534c3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:34:58.830869 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be076198-cd63-4b77-9f53-6a0b1534c3ee admin admin] PATH_INFO: `/v3/users/7f47aaae28384df9a675fc4b950cc1f7` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:34:58.831963 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be076198-cd63-4b77-9f53-6a0b1534c3ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f47aaae28384df9a675fc4b950cc1f7)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:34:58.833907 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be076198-cd63-4b77-9f53-6a0b1534c3ee admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:34:58.881898 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-be076198-cd63-4b77-9f53-6a0b1534c3ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f47aaae28384df9a675fc4b950cc1f7'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:34:58.882560 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-be076198-cd63-4b77-9f53-6a0b1534c3ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f47aaae28384df9a675fc4b950cc1f7'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:34:58.895345 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-be076198-cd63-4b77-9f53-6a0b1534c3ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f47aaae28384df9a675fc4b950cc1f7'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:34:58.895938 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-be076198-cd63-4b77-9f53-6a0b1534c3ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f47aaae28384df9a675fc4b950cc1f7'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:34:58.903567 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-be076198-cd63-4b77-9f53-6a0b1534c3ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f47aaae28384df9a675fc4b950cc1f7'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:34:58.915346 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1017/2038] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:34:58 2022] DELETE /identity/v3/users/7f47aaae28384df9a675fc4b950cc1f7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:34:59.085502 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09481a8b-d2e4-4d40-92c5-9a75097d55d9 service placement] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:34:59.101636 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09481a8b-d2e4-4d40-92c5-9a75097d55d9 service placement] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:34:59.162164 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933f9d2-5c3e-4c1e-8447-38e7908a413f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:34:59.162832 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933f9d2-5c3e-4c1e-8447-38e7908a413f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:34:59.163111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933f9d2-5c3e-4c1e-8447-38e7908a413f admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:34:59.163388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933f9d2-5c3e-4c1e-8447-38e7908a413f admin admin] PATH_INFO: `/v3/projects/0e2310edb12c4410a499ddd4ea201fb5` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:34:59.164633 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933f9d2-5c3e-4c1e-8447-38e7908a413f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e2310edb12c4410a499ddd4ea201fb5)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:34:59.166560 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933f9d2-5c3e-4c1e-8447-38e7908a413f admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:34:59.218880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0933f9d2-5c3e-4c1e-8447-38e7908a413f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e2310edb12c4410a499ddd4ea201fb5', 'request_id': 'req-0933f9d2-5c3e-4c1e-8447-38e7908a413f'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:34:59.225239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0933f9d2-5c3e-4c1e-8447-38e7908a413f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e2310edb12c4410a499ddd4ea201fb5', 'request_id': 'req-0933f9d2-5c3e-4c1e-8447-38e7908a413f'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:34:59.233061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0933f9d2-5c3e-4c1e-8447-38e7908a413f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e2310edb12c4410a499ddd4ea201fb5', 'request_id': 'req-0933f9d2-5c3e-4c1e-8447-38e7908a413f'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:34:59.249192 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0933f9d2-5c3e-4c1e-8447-38e7908a413f admin admin] The token cache is being invalidate because project 0e2310edb12c4410a499ddd4ea201fb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:34:59.249526 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0933f9d2-5c3e-4c1e-8447-38e7908a413f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:34:59.250147 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0933f9d2-5c3e-4c1e-8447-38e7908a413f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:34:59.251900 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1022/2039] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:34:59 2022] DELETE /identity/v3/projects/0e2310edb12c4410a499ddd4ea201fb5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:34:59.256934 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be076198-cd63-4b77-9f53-6a0b1534c3ee admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:34:59.259293 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-be076198-cd63-4b77-9f53-6a0b1534c3ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:34:59.276140 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be076198-cd63-4b77-9f53-6a0b1534c3ee admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:34:59.336999 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58359c3a-f816-4a7d-b7c7-1b9e71b44a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:34:59.337636 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58359c3a-f816-4a7d-b7c7-1b9e71b44a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:34:59.337920 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58359c3a-f816-4a7d-b7c7-1b9e71b44a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:34:59.338198 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58359c3a-f816-4a7d-b7c7-1b9e71b44a11 admin admin] PATH_INFO: `/v3/users/0293ac8472674b9a9220fc88b0d67e02` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:34:59.339337 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58359c3a-f816-4a7d-b7c7-1b9e71b44a11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0293ac8472674b9a9220fc88b0d67e02)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:34:59.341651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58359c3a-f816-4a7d-b7c7-1b9e71b44a11 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:34:59.343296 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:34:59.398289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-58359c3a-f816-4a7d-b7c7-1b9e71b44a11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0293ac8472674b9a9220fc88b0d67e02'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:34:59.402126 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-58359c3a-f816-4a7d-b7c7-1b9e71b44a11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0293ac8472674b9a9220fc88b0d67e02'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:34:59.422822 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-58359c3a-f816-4a7d-b7c7-1b9e71b44a11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0293ac8472674b9a9220fc88b0d67e02'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:34:59.423679 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-58359c3a-f816-4a7d-b7c7-1b9e71b44a11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0293ac8472674b9a9220fc88b0d67e02'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:34:59.430961 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-58359c3a-f816-4a7d-b7c7-1b9e71b44a11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0293ac8472674b9a9220fc88b0d67e02'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:34:59.445606 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1018/2040] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:34:59 2022] DELETE /identity/v3/users/0293ac8472674b9a9220fc88b0d67e02 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:34:59.625388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933f9d2-5c3e-4c1e-8447-38e7908a413f admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:34:59.626816 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-0933f9d2-5c3e-4c1e-8447-38e7908a413f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:34:59.639996 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933f9d2-5c3e-4c1e-8447-38e7908a413f admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:34:59.696594 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a666cf-e6f2-4265-baa1-5352cd58c12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:34:59.696776 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a666cf-e6f2-4265-baa1-5352cd58c12b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:34:59.697043 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a666cf-e6f2-4265-baa1-5352cd58c12b admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:34:59.697328 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a666cf-e6f2-4265-baa1-5352cd58c12b admin admin] PATH_INFO: `/v3/projects/b94cf19702fa4b96aa1f6f98c8a49a2e` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:34:59.698645 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a666cf-e6f2-4265-baa1-5352cd58c12b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b94cf19702fa4b96aa1f6f98c8a49a2e)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:34:59.701282 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a666cf-e6f2-4265-baa1-5352cd58c12b admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:34:59.713267 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:34:59.749088 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-33a666cf-e6f2-4265-baa1-5352cd58c12b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b94cf19702fa4b96aa1f6f98c8a49a2e', 'request_id': 'req-33a666cf-e6f2-4265-baa1-5352cd58c12b'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:34:59.755437 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-33a666cf-e6f2-4265-baa1-5352cd58c12b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b94cf19702fa4b96aa1f6f98c8a49a2e', 'request_id': 'req-33a666cf-e6f2-4265-baa1-5352cd58c12b'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:34:59.761931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-33a666cf-e6f2-4265-baa1-5352cd58c12b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b94cf19702fa4b96aa1f6f98c8a49a2e', 'request_id': 'req-33a666cf-e6f2-4265-baa1-5352cd58c12b'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:34:59.772766 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-33a666cf-e6f2-4265-baa1-5352cd58c12b admin admin] The token cache is being invalidate because project b94cf19702fa4b96aa1f6f98c8a49a2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:34:59.773055 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-33a666cf-e6f2-4265-baa1-5352cd58c12b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:34:59.773674 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-33a666cf-e6f2-4265-baa1-5352cd58c12b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:34:59.775147 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1023/2041] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:34:59 2022] DELETE /identity/v3/projects/b94cf19702fa4b96aa1f6f98c8a49a2e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:34:59.780099 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e0a87-d335-44be-ae18-2f6ea22e886b None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:34:59.780587 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e0a87-d335-44be-ae18-2f6ea22e886b None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:34:59.780686 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e0a87-d335-44be-ae18-2f6ea22e886b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:34:59.800322 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-b21e0a87-d335-44be-ae18-2f6ea22e886b None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:34:59.801570 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-b21e0a87-d335-44be-ae18-2f6ea22e886b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:34:59.860817 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1019/2042] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:34:59.868748 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac16ecb-b24c-4a52-852a-21cf6b5308f7 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:34:59.869044 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac16ecb-b24c-4a52-852a-21cf6b5308f7 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:34:59.869327 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac16ecb-b24c-4a52-852a-21cf6b5308f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:34:59.890797 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-2ac16ecb-b24c-4a52-852a-21cf6b5308f7 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:34:59.891984 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-2ac16ecb-b24c-4a52-852a-21cf6b5308f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:34:59.900090 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1024/2043] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:34:59.904117 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e0a87-d335-44be-ae18-2f6ea22e886b None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:34:59.913657 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e0a87-d335-44be-ae18-2f6ea22e886b None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:34:59.918142 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2943b16-6814-4c70-b8a3-6233c09ca961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:34:59.918731 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2943b16-6814-4c70-b8a3-6233c09ca961 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:34:59.919012 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2943b16-6814-4c70-b8a3-6233c09ca961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:34:59.919285 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2943b16-6814-4c70-b8a3-6233c09ca961 admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:34:59.919925 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2943b16-6814-4c70-b8a3-6233c09ca961 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:34:59.920227 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2943b16-6814-4c70-b8a3-6233c09ca961 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:34:59.921848 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2943b16-6814-4c70-b8a3-6233c09ca961 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:34:59.933028 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1020/2044] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:34:59.937704 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac16ecb-b24c-4a52-852a-21cf6b5308f7 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:34:59.946809 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac16ecb-b24c-4a52-852a-21cf6b5308f7 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:34:59.952024 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe942c-cae7-4031-bb2e-44fab5a500fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:34:59.952651 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe942c-cae7-4031-bb2e-44fab5a500fe admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:34:59.952936 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe942c-cae7-4031-bb2e-44fab5a500fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:34:59.953209 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe942c-cae7-4031-bb2e-44fab5a500fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:34:59.953845 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe942c-cae7-4031-bb2e-44fab5a500fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:34:59.955775 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe942c-cae7-4031-bb2e-44fab5a500fe admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:34:59.983443 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1025/2045] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:34:59 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:34:59.986007 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2943b16-6814-4c70-b8a3-6233c09ca961 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:34:59.995991 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2943b16-6814-4c70-b8a3-6233c09ca961 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:00.050788 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398faff-3c86-41eb-be92-b8a3063a62b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:00.051317 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398faff-3c86-41eb-be92-b8a3063a62b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:00.051600 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398faff-3c86-41eb-be92-b8a3063a62b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:00.051878 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398faff-3c86-41eb-be92-b8a3063a62b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:00.052513 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398faff-3c86-41eb-be92-b8a3063a62b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:00.054455 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398faff-3c86-41eb-be92-b8a3063a62b4 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:00.065683 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:00.078131 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1021/2046] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:34:59 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:35:00.082076 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe942c-cae7-4031-bb2e-44fab5a500fe admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:00.092317 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe942c-cae7-4031-bb2e-44fab5a500fe admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:00.096911 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49fb9b-eb0f-454f-864b-99c3ca64b2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:00.097501 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49fb9b-eb0f-454f-864b-99c3ca64b2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:00.097781 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49fb9b-eb0f-454f-864b-99c3ca64b2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:00.098085 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49fb9b-eb0f-454f-864b-99c3ca64b2c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:00.098883 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49fb9b-eb0f-454f-864b-99c3ca64b2c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:00.100453 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49fb9b-eb0f-454f-864b-99c3ca64b2c9 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:00.110671 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1026/2047] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:35:00.114526 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398faff-3c86-41eb-be92-b8a3063a62b4 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:00.124860 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398faff-3c86-41eb-be92-b8a3063a62b4 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:00.129447 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544a833-79cb-442d-8559-71c50b2081e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:00.130035 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544a833-79cb-442d-8559-71c50b2081e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:00.130319 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544a833-79cb-442d-8559-71c50b2081e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:00.130597 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544a833-79cb-442d-8559-71c50b2081e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:00.131238 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544a833-79cb-442d-8559-71c50b2081e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:00.132878 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544a833-79cb-442d-8559-71c50b2081e6 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:00.143253 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1022/2048] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:35:00.147353 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49fb9b-eb0f-454f-864b-99c3ca64b2c9 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:00.157173 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49fb9b-eb0f-454f-864b-99c3ca64b2c9 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:00.161892 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176764d1-cf15-4b30-ae06-3f51a65f8502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:00.162541 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176764d1-cf15-4b30-ae06-3f51a65f8502 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:00.162823 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176764d1-cf15-4b30-ae06-3f51a65f8502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:00.163097 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176764d1-cf15-4b30-ae06-3f51a65f8502 admin admin] PATH_INFO: `/v3/projects/7d3c307e18e14232af08674a06513195/users/b5ed8544b1964c5ab7795abbb9f5c27a/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:00.178310 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176764d1-cf15-4b30-ae06-3f51a65f8502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d3c307e18e14232af08674a06513195, user_id=b5ed8544b1964c5ab7795abbb9f5c27a, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:00.180968 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176764d1-cf15-4b30-ae06-3f51a65f8502 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:00.194943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1027/2049] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:35:00 2022] PUT /identity/v3/projects/7d3c307e18e14232af08674a06513195/users/b5ed8544b1964c5ab7795abbb9f5c27a/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:35:00.199943 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36485b-9718-4c31-8305-ed76397ed7f0 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:00.200234 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36485b-9718-4c31-8305-ed76397ed7f0 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:00.200512 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36485b-9718-4c31-8305-ed76397ed7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:00.219133 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-7a36485b-9718-4c31-8305-ed76397ed7f0 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:35:00.220316 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-7a36485b-9718-4c31-8305-ed76397ed7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:00.278076 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1023/2050] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:35:00.287766 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176764d1-cf15-4b30-ae06-3f51a65f8502 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:00.289565 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-176764d1-cf15-4b30-ae06-3f51a65f8502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:00.346888 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176764d1-cf15-4b30-ae06-3f51a65f8502 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:00.350635 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248733b-52d7-44e3-bcc2-b512ae12c1a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:00.351242 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248733b-52d7-44e3-bcc2-b512ae12c1a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:00.351522 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248733b-52d7-44e3-bcc2-b512ae12c1a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:00.351794 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248733b-52d7-44e3-bcc2-b512ae12c1a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:00.360744 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248733b-52d7-44e3-bcc2-b512ae12c1a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:00.362151 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248733b-52d7-44e3-bcc2-b512ae12c1a8 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:00.371527 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1028/2051] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:35:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:35:04.920233 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91515173-fc3d-4532-a95b-ef5d25ffa633 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:04.920794 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91515173-fc3d-4532-a95b-ef5d25ffa633 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:04.920794 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91515173-fc3d-4532-a95b-ef5d25ffa633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:04.952395 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-91515173-fc3d-4532-a95b-ef5d25ffa633 None None] MFA Rules not processed for user `b5ed8544b1964c5ab7795abbb9f5c27a`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:35:04.953664 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-91515173-fc3d-4532-a95b-ef5d25ffa633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:05.021740 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1024/2052] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:35:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:35:05.026308 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248733b-52d7-44e3-bcc2-b512ae12c1a8 service neutron] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:05.037158 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248733b-52d7-44e3-bcc2-b512ae12c1a8 service neutron] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:05.042100 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423139c-2da2-444f-9a20-8f7aa432f64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:05.042711 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423139c-2da2-444f-9a20-8f7aa432f64e admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:05.042998 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423139c-2da2-444f-9a20-8f7aa432f64e admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:05.043280 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423139c-2da2-444f-9a20-8f7aa432f64e admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:05.044724 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423139c-2da2-444f-9a20-8f7aa432f64e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:05.046622 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423139c-2da2-444f-9a20-8f7aa432f64e admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:05.076314 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1029/2053] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:35:05 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:35:05.077729 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91515173-fc3d-4532-a95b-ef5d25ffa633 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:05.088965 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91515173-fc3d-4532-a95b-ef5d25ffa633 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:05.149117 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab43719-fd6d-4905-b175-386aa42b69a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:05.149719 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab43719-fd6d-4905-b175-386aa42b69a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:05.149999 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab43719-fd6d-4905-b175-386aa42b69a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:05.150273 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab43719-fd6d-4905-b175-386aa42b69a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:05.150897 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab43719-fd6d-4905-b175-386aa42b69a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:05.153346 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab43719-fd6d-4905-b175-386aa42b69a3 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:05.175197 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1025/2054] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:35:05 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:35:05.179147 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423139c-2da2-444f-9a20-8f7aa432f64e admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:05.189536 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423139c-2da2-444f-9a20-8f7aa432f64e admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:05.194053 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00754322-946d-45c7-b4d6-8a46987033d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:05.194647 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00754322-946d-45c7-b4d6-8a46987033d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:05.194926 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00754322-946d-45c7-b4d6-8a46987033d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:05.195201 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00754322-946d-45c7-b4d6-8a46987033d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:05.195841 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00754322-946d-45c7-b4d6-8a46987033d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:05.197475 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00754322-946d-45c7-b4d6-8a46987033d0 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:05.208031 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1030/2055] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:35:05.212048 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab43719-fd6d-4905-b175-386aa42b69a3 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:05.219155 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:05.223443 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab43719-fd6d-4905-b175-386aa42b69a3 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:05.228707 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b8973-98b2-4480-b4e6-ed6eee78fe1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:05.229405 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b8973-98b2-4480-b4e6-ed6eee78fe1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:05.229670 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b8973-98b2-4480-b4e6-ed6eee78fe1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:05.229945 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b8973-98b2-4480-b4e6-ed6eee78fe1c admin admin] PATH_INFO: `/v3/projects/94ca394f37634fe39eca8c151a89ab2f/users/614088013d0a47b6a802249488423aaf/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:05.245073 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b8973-98b2-4480-b4e6-ed6eee78fe1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=94ca394f37634fe39eca8c151a89ab2f, user_id=614088013d0a47b6a802249488423aaf, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:05.247722 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b8973-98b2-4480-b4e6-ed6eee78fe1c admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:05.260098 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1026/2056] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:35:05 2022] PUT /identity/v3/projects/94ca394f37634fe39eca8c151a89ab2f/users/614088013d0a47b6a802249488423aaf/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:35:05.264494 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00754322-946d-45c7-b4d6-8a46987033d0 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:05.274427 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00754322-946d-45c7-b4d6-8a46987033d0 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:05.278516 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:05.335704 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bfeec4-404b-41f9-8dcc-9d829bd28b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:05.336319 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfeec4-404b-41f9-8dcc-9d829bd28b9e admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:05.336646 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfeec4-404b-41f9-8dcc-9d829bd28b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:05.336929 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfeec4-404b-41f9-8dcc-9d829bd28b9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:05.337572 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bfeec4-404b-41f9-8dcc-9d829bd28b9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:05.339161 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bfeec4-404b-41f9-8dcc-9d829bd28b9e admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:05.349518 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1031/2057] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:35:05.353650 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b8973-98b2-4480-b4e6-ed6eee78fe1c admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:05.363942 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b8973-98b2-4480-b4e6-ed6eee78fe1c admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:05.368579 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75265c5c-7ca3-4086-ae56-26fbf3ec7edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:05.369218 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75265c5c-7ca3-4086-ae56-26fbf3ec7edc admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:05.369502 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75265c5c-7ca3-4086-ae56-26fbf3ec7edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:05.369833 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75265c5c-7ca3-4086-ae56-26fbf3ec7edc admin admin] PATH_INFO: `/v3/projects/94ca394f37634fe39eca8c151a89ab2f/users/614088013d0a47b6a802249488423aaf/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:05.371724 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75265c5c-7ca3-4086-ae56-26fbf3ec7edc admin admin] RBAC: Authorizing `identity:create_grant(project_id=94ca394f37634fe39eca8c151a89ab2f, user_id=614088013d0a47b6a802249488423aaf, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:05.374403 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75265c5c-7ca3-4086-ae56-26fbf3ec7edc admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:05.384513 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1027/2058] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:35:05 2022] PUT /identity/v3/projects/94ca394f37634fe39eca8c151a89ab2f/users/614088013d0a47b6a802249488423aaf/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:35:10.745214 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393210e-aadb-47da-8478-bd2dac5e4f00 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:10.745672 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393210e-aadb-47da-8478-bd2dac5e4f00 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:10.745766 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393210e-aadb-47da-8478-bd2dac5e4f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:10.773421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-e393210e-aadb-47da-8478-bd2dac5e4f00 None None] MFA Rules not processed for user `614088013d0a47b6a802249488423aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:35:10.774559 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-e393210e-aadb-47da-8478-bd2dac5e4f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:10.845438 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1032/2059] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:35:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:35:10.859696 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75265c5c-7ca3-4086-ae56-26fbf3ec7edc admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:10.861498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-75265c5c-7ca3-4086-ae56-26fbf3ec7edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:10.864772 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393210e-aadb-47da-8478-bd2dac5e4f00 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:10.921192 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393210e-aadb-47da-8478-bd2dac5e4f00 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:10.924888 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8f8e9-a36b-478b-b64e-1642be5ae231 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:10.925495 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8f8e9-a36b-478b-b64e-1642be5ae231 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:10.925779 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8f8e9-a36b-478b-b64e-1642be5ae231 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:10.926053 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8f8e9-a36b-478b-b64e-1642be5ae231 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:10.927771 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-68c8f8e9-a36b-478b-b64e-1642be5ae231 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:10.938943 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75265c5c-7ca3-4086-ae56-26fbf3ec7edc admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:10.944681 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0531f1-bdcb-4a2a-99e9-65dd6ece395d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:10.945292 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0531f1-bdcb-4a2a-99e9-65dd6ece395d service nova] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:10.945575 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0531f1-bdcb-4a2a-99e9-65dd6ece395d service nova] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:10.945852 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0531f1-bdcb-4a2a-99e9-65dd6ece395d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:10.972575 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:10.995378 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8f8e9-a36b-478b-b64e-1642be5ae231 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:10.998006 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8f8e9-a36b-478b-b64e-1642be5ae231 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:11.006243 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0531f1-bdcb-4a2a-99e9-65dd6ece395d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:11.007854 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0531f1-bdcb-4a2a-99e9-65dd6ece395d service nova] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:11.008925 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1033/2060] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:35:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 20:35:11.022091 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1028/2061] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:35:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:35:12.124485 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9de671-df4d-47af-8cce-90a829ff97d1 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:12.125050 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9de671-df4d-47af-8cce-90a829ff97d1 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:12.125050 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9de671-df4d-47af-8cce-90a829ff97d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:12.146704 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-cc9de671-df4d-47af-8cce-90a829ff97d1 None None] MFA Rules not processed for user `b5ed8544b1964c5ab7795abbb9f5c27a`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:35:12.148221 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-cc9de671-df4d-47af-8cce-90a829ff97d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:12.165401 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1034/2062] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:35:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:35:14.845652 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0531f1-bdcb-4a2a-99e9-65dd6ece395d service nova] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:14.847215 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-1b0531f1-bdcb-4a2a-99e9-65dd6ece395d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:14.926100 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0531f1-bdcb-4a2a-99e9-65dd6ece395d service nova] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:14.931484 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9de671-df4d-47af-8cce-90a829ff97d1 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:14.933082 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-cc9de671-df4d-47af-8cce-90a829ff97d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:14.934312 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e745a5-860f-4eae-9d24-85e90e6a9de2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62ca656e59ff46b08661385d8ec79846', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:14.935126 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e745a5-860f-4eae-9d24-85e90e6a9de2 service glance] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:14.935588 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e745a5-860f-4eae-9d24-85e90e6a9de2 service glance] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:14.935926 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e745a5-860f-4eae-9d24-85e90e6a9de2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:14.938015 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-23e745a5-860f-4eae-9d24-85e90e6a9de2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:14.955530 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9de671-df4d-47af-8cce-90a829ff97d1 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:14.957642 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e745a5-860f-4eae-9d24-85e90e6a9de2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:14.959557 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e745a5-860f-4eae-9d24-85e90e6a9de2 service glance] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:14.961372 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80c45c-8f40-43dc-936d-c7e2cbc2c000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:14.961996 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80c45c-8f40-43dc-936d-c7e2cbc2c000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:14.962281 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80c45c-8f40-43dc-936d-c7e2cbc2c000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:14.962710 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80c45c-8f40-43dc-936d-c7e2cbc2c000 admin admin] PATH_INFO: `/v3/users/4bd602c085ad406eab3705dc8500a003` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:14.963882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c80c45c-8f40-43dc-936d-c7e2cbc2c000 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bd602c085ad406eab3705dc8500a003)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:14.967006 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c80c45c-8f40-43dc-936d-c7e2cbc2c000 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:14.990641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1029/2063] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:35:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:35:15.021455 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8c80c45c-8f40-43dc-936d-c7e2cbc2c000 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bd602c085ad406eab3705dc8500a003'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:15.022206 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8c80c45c-8f40-43dc-936d-c7e2cbc2c000 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bd602c085ad406eab3705dc8500a003'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:15.032013 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8c80c45c-8f40-43dc-936d-c7e2cbc2c000 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bd602c085ad406eab3705dc8500a003'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:15.032832 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8c80c45c-8f40-43dc-936d-c7e2cbc2c000 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bd602c085ad406eab3705dc8500a003'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:15.045020 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8c80c45c-8f40-43dc-936d-c7e2cbc2c000 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bd602c085ad406eab3705dc8500a003'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:15.058164 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1035/2064] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:35:14 2022] DELETE /identity/v3/users/4bd602c085ad406eab3705dc8500a003 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:35:15.173508 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e745a5-860f-4eae-9d24-85e90e6a9de2 service glance] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:15.185974 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e745a5-860f-4eae-9d24-85e90e6a9de2 service glance] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:15.190060 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:15.243553 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9070df-2207-4b14-a368-fe12ba23b062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:15.244439 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9070df-2207-4b14-a368-fe12ba23b062 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:15.244927 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9070df-2207-4b14-a368-fe12ba23b062 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:15.245371 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9070df-2207-4b14-a368-fe12ba23b062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:15.246618 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80c45c-8f40-43dc-936d-c7e2cbc2c000 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:15.248282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-5e9070df-2207-4b14-a368-fe12ba23b062 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:15.248580 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-8c80c45c-8f40-43dc-936d-c7e2cbc2c000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:15.334877 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9070df-2207-4b14-a368-fe12ba23b062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:15.335666 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80c45c-8f40-43dc-936d-c7e2cbc2c000 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:15.336349 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9070df-2207-4b14-a368-fe12ba23b062 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:15.344223 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b159d-9264-4e02-81b6-590b87f97815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:15.344898 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b159d-9264-4e02-81b6-590b87f97815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:15.345367 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b159d-9264-4e02-81b6-590b87f97815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:15.345807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b159d-9264-4e02-81b6-590b87f97815 admin admin] PATH_INFO: `/v3/projects/bca6de3f1c6e42eb95efeb8a9a39b001` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:15.347122 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b159d-9264-4e02-81b6-590b87f97815 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bca6de3f1c6e42eb95efeb8a9a39b001)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:15.348423 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1030/2065] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:35:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:35:15.349077 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b159d-9264-4e02-81b6-590b87f97815 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:15.396828 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:15.400467 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-b08b159d-9264-4e02-81b6-590b87f97815 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bca6de3f1c6e42eb95efeb8a9a39b001', 'request_id': 'req-b08b159d-9264-4e02-81b6-590b87f97815'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:15.416092 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-b08b159d-9264-4e02-81b6-590b87f97815 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bca6de3f1c6e42eb95efeb8a9a39b001', 'request_id': 'req-b08b159d-9264-4e02-81b6-590b87f97815'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:15.425862 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-b08b159d-9264-4e02-81b6-590b87f97815 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bca6de3f1c6e42eb95efeb8a9a39b001', 'request_id': 'req-b08b159d-9264-4e02-81b6-590b87f97815'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:15.437504 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-b08b159d-9264-4e02-81b6-590b87f97815 admin admin] The token cache is being invalidate because project bca6de3f1c6e42eb95efeb8a9a39b001 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:35:15.438117 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-b08b159d-9264-4e02-81b6-590b87f97815 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:15.438796 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-b08b159d-9264-4e02-81b6-590b87f97815 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:15.445792 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f002f5-2ea3-4eab-b5bb-898bdb672034 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:15.446295 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f002f5-2ea3-4eab-b5bb-898bdb672034 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:15.446840 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f002f5-2ea3-4eab-b5bb-898bdb672034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:15.449944 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1036/2066] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:35:15 2022] DELETE /identity/v3/projects/bca6de3f1c6e42eb95efeb8a9a39b001 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:35:15.483859 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-d6f002f5-2ea3-4eab-b5bb-898bdb672034 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:35:15.487472 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-d6f002f5-2ea3-4eab-b5bb-898bdb672034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:15.592771 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1031/2067] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:35:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:35:15.601736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11329c-9062-4bac-ab58-55fe278d62db None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:15.602027 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11329c-9062-4bac-ab58-55fe278d62db None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:15.602401 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11329c-9062-4bac-ab58-55fe278d62db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:15.626242 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-ce11329c-9062-4bac-ab58-55fe278d62db None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:35:15.628038 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-ce11329c-9062-4bac-ab58-55fe278d62db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:15.640437 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1037/2068] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:35:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:35:15.644634 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f002f5-2ea3-4eab-b5bb-898bdb672034 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:15.673612 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f002f5-2ea3-4eab-b5bb-898bdb672034 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:15.700979 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419c93e-6bb4-4d95-b2be-3d7365a4a96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:15.700979 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419c93e-6bb4-4d95-b2be-3d7365a4a96c admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:15.700979 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419c93e-6bb4-4d95-b2be-3d7365a4a96c admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:15.700979 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419c93e-6bb4-4d95-b2be-3d7365a4a96c admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:15.701772 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419c93e-6bb4-4d95-b2be-3d7365a4a96c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:35:15.701772 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419c93e-6bb4-4d95-b2be-3d7365a4a96c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:15.703934 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419c93e-6bb4-4d95-b2be-3d7365a4a96c admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:15.732371 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1032/2069] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:35:15.737125 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11329c-9062-4bac-ab58-55fe278d62db None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:15.748507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11329c-9062-4bac-ab58-55fe278d62db None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:15.754882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bbdb1-ee2b-4858-a034-531956c3dbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:15.756028 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bbdb1-ee2b-4858-a034-531956c3dbb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:15.756524 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bbdb1-ee2b-4858-a034-531956c3dbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:15.757550 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bbdb1-ee2b-4858-a034-531956c3dbb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:15.759591 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079bbdb1-ee2b-4858-a034-531956c3dbb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:15.763513 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079bbdb1-ee2b-4858-a034-531956c3dbb2 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:15.808519 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1038/2070] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:35:15 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:35:15.812670 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419c93e-6bb4-4d95-b2be-3d7365a4a96c admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:15.832777 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419c93e-6bb4-4d95-b2be-3d7365a4a96c admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:15.909085 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:15.948332 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7c614-2828-4ac5-896a-22dd06a6f207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:15.949389 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7c614-2828-4ac5-896a-22dd06a6f207 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:15.949931 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7c614-2828-4ac5-896a-22dd06a6f207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:15.950417 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7c614-2828-4ac5-896a-22dd06a6f207 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:15.951237 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7c614-2828-4ac5-896a-22dd06a6f207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:15.953820 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7c614-2828-4ac5-896a-22dd06a6f207 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:16.021882 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1033/2071] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:35:15 2022] POST /identity/v3/users => generated 287 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:35:16.026047 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bbdb1-ee2b-4858-a034-531956c3dbb2 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:16.038410 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bbdb1-ee2b-4858-a034-531956c3dbb2 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:16.046924 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4684c-5e20-410e-9b1c-cb983f7a2659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:16.047714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4684c-5e20-410e-9b1c-cb983f7a2659 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:16.048176 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4684c-5e20-410e-9b1c-cb983f7a2659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:16.048640 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4684c-5e20-410e-9b1c-cb983f7a2659 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:16.049444 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4684c-5e20-410e-9b1c-cb983f7a2659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:16.051182 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4684c-5e20-410e-9b1c-cb983f7a2659 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:16.077353 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1039/2072] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:35:16.084385 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7c614-2828-4ac5-896a-22dd06a6f207 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:16.095053 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7c614-2828-4ac5-896a-22dd06a6f207 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:16.100134 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5421a9d5-5e37-41db-880b-1c891218b93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:16.100778 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421a9d5-5e37-41db-880b-1c891218b93b admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:16.101088 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421a9d5-5e37-41db-880b-1c891218b93b admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:16.101369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421a9d5-5e37-41db-880b-1c891218b93b admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:16.102022 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5421a9d5-5e37-41db-880b-1c891218b93b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:16.103640 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5421a9d5-5e37-41db-880b-1c891218b93b admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:16.118496 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1034/2073] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:35:16.119761 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4684c-5e20-410e-9b1c-cb983f7a2659 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:16.130652 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4684c-5e20-410e-9b1c-cb983f7a2659 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:16.135300 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772f309-809e-4e19-a2a1-61f4c8d5ee17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:16.135952 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772f309-809e-4e19-a2a1-61f4c8d5ee17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:16.136238 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772f309-809e-4e19-a2a1-61f4c8d5ee17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:16.136520 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772f309-809e-4e19-a2a1-61f4c8d5ee17 admin admin] PATH_INFO: `/v3/projects/8e670947fab54ecab70e11f9210cdbd8/users/46af520964c44833b367cb39bc7086b0/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:16.156286 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772f309-809e-4e19-a2a1-61f4c8d5ee17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e670947fab54ecab70e11f9210cdbd8, user_id=46af520964c44833b367cb39bc7086b0, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:16.159467 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772f309-809e-4e19-a2a1-61f4c8d5ee17 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:16.173925 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1040/2074] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:35:16 2022] PUT /identity/v3/projects/8e670947fab54ecab70e11f9210cdbd8/users/46af520964c44833b367cb39bc7086b0/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:35:16.184289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549b6d3-47fa-4f46-8bb8-6c8a3e3cc87c None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:16.184781 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549b6d3-47fa-4f46-8bb8-6c8a3e3cc87c None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:16.185177 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549b6d3-47fa-4f46-8bb8-6c8a3e3cc87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:16.217424 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-8549b6d3-47fa-4f46-8bb8-6c8a3e3cc87c None None] MFA Rules not processed for user `46af520964c44833b367cb39bc7086b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:35:16.218703 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-8549b6d3-47fa-4f46-8bb8-6c8a3e3cc87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:16.288230 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1035/2075] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:35:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:35:16.300221 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772f309-809e-4e19-a2a1-61f4c8d5ee17 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:16.302065 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-0772f309-809e-4e19-a2a1-61f4c8d5ee17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:16.378449 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772f309-809e-4e19-a2a1-61f4c8d5ee17 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:16.384014 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1a380-45f5-4f74-839f-9ff7c9a57f40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:16.384657 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1a380-45f5-4f74-839f-9ff7c9a57f40 service nova] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:16.384946 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1a380-45f5-4f74-839f-9ff7c9a57f40 service nova] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:16.385225 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1a380-45f5-4f74-839f-9ff7c9a57f40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:16.393024 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1a380-45f5-4f74-839f-9ff7c9a57f40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:16.394932 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1a380-45f5-4f74-839f-9ff7c9a57f40 service nova] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:16.406096 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1041/2076] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:35:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:35:16.618210 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549b6d3-47fa-4f46-8bb8-6c8a3e3cc87c None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:16.697711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549b6d3-47fa-4f46-8bb8-6c8a3e3cc87c None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:16.707355 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95edf5-fbff-4c1a-98de-0084f36aea40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:16.707979 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95edf5-fbff-4c1a-98de-0084f36aea40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:16.708268 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95edf5-fbff-4c1a-98de-0084f36aea40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:16.708572 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95edf5-fbff-4c1a-98de-0084f36aea40 admin admin] PATH_INFO: `/v3/users/46af520964c44833b367cb39bc7086b0` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:16.709712 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95edf5-fbff-4c1a-98de-0084f36aea40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46af520964c44833b367cb39bc7086b0)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:16.711750 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95edf5-fbff-4c1a-98de-0084f36aea40 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:16.765355 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:16.767215 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-af95edf5-fbff-4c1a-98de-0084f36aea40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46af520964c44833b367cb39bc7086b0'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:16.768515 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-af95edf5-fbff-4c1a-98de-0084f36aea40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46af520964c44833b367cb39bc7086b0'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:16.782159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-af95edf5-fbff-4c1a-98de-0084f36aea40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46af520964c44833b367cb39bc7086b0'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:16.782878 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-af95edf5-fbff-4c1a-98de-0084f36aea40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46af520964c44833b367cb39bc7086b0'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:16.789815 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-af95edf5-fbff-4c1a-98de-0084f36aea40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46af520964c44833b367cb39bc7086b0'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:16.802845 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1036/2077] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:35:16 2022] DELETE /identity/v3/users/46af520964c44833b367cb39bc7086b0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:35:16.807353 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d217d-7a01-4911-bdf4-fd0d960fa019 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:16.807673 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d217d-7a01-4911-bdf4-fd0d960fa019 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:16.807950 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d217d-7a01-4911-bdf4-fd0d960fa019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:16.829577 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-a94d217d-7a01-4911-bdf4-fd0d960fa019 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:35:16.830851 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-a94d217d-7a01-4911-bdf4-fd0d960fa019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:16.880606 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:16.894447 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1042/2078] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:35:16.904399 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95edf5-fbff-4c1a-98de-0084f36aea40 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:16.905878 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-af95edf5-fbff-4c1a-98de-0084f36aea40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:16.965640 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95edf5-fbff-4c1a-98de-0084f36aea40 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:16.969548 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d2b29-c172-4963-a3aa-8067b02f82e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:16.970152 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d2b29-c172-4963-a3aa-8067b02f82e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:16.970435 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d2b29-c172-4963-a3aa-8067b02f82e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:16.970714 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d2b29-c172-4963-a3aa-8067b02f82e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:16.979578 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d2b29-c172-4963-a3aa-8067b02f82e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:16.981171 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d2b29-c172-4963-a3aa-8067b02f82e8 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:16.992215 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1037/2079] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:35:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 20:35:17.286806 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d217d-7a01-4911-bdf4-fd0d960fa019 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:17.288380 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-a94d217d-7a01-4911-bdf4-fd0d960fa019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:17.304483 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d217d-7a01-4911-bdf4-fd0d960fa019 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:17.310541 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b118002-d6c0-4a76-b30d-89393e599558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:17.311265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b118002-d6c0-4a76-b30d-89393e599558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:17.311458 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b118002-d6c0-4a76-b30d-89393e599558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:17.311827 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b118002-d6c0-4a76-b30d-89393e599558 admin admin] PATH_INFO: `/v3/projects/8e670947fab54ecab70e11f9210cdbd8` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:17.313054 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b118002-d6c0-4a76-b30d-89393e599558 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e670947fab54ecab70e11f9210cdbd8)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:17.315115 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b118002-d6c0-4a76-b30d-89393e599558 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:17.362837 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-5b118002-d6c0-4a76-b30d-89393e599558 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e670947fab54ecab70e11f9210cdbd8', 'request_id': 'req-5b118002-d6c0-4a76-b30d-89393e599558'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:17.369264 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-5b118002-d6c0-4a76-b30d-89393e599558 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e670947fab54ecab70e11f9210cdbd8', 'request_id': 'req-5b118002-d6c0-4a76-b30d-89393e599558'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:17.377559 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-5b118002-d6c0-4a76-b30d-89393e599558 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e670947fab54ecab70e11f9210cdbd8', 'request_id': 'req-5b118002-d6c0-4a76-b30d-89393e599558'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:17.388448 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-5b118002-d6c0-4a76-b30d-89393e599558 admin admin] The token cache is being invalidate because project 8e670947fab54ecab70e11f9210cdbd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:35:17.388778 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-5b118002-d6c0-4a76-b30d-89393e599558 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:17.389403 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-5b118002-d6c0-4a76-b30d-89393e599558 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:17.390890 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1043/2080] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:35:17 2022] DELETE /identity/v3/projects/8e670947fab54ecab70e11f9210cdbd8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:35:17.395905 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9272b-b48e-4b71-971b-74c61c9283ea None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:17.396197 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9272b-b48e-4b71-971b-74c61c9283ea None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:17.396480 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9272b-b48e-4b71-971b-74c61c9283ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:17.417632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-40b9272b-b48e-4b71-971b-74c61c9283ea None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:35:17.419362 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-40b9272b-b48e-4b71-971b-74c61c9283ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:17.490405 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1038/2081] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:35:17.492161 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a03f5-6f90-4a16-8f81-ff35506685b4 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:17.492453 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a03f5-6f90-4a16-8f81-ff35506685b4 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:17.492769 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a03f5-6f90-4a16-8f81-ff35506685b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:17.513598 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-b37a03f5-6f90-4a16-8f81-ff35506685b4 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:35:17.515061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-b37a03f5-6f90-4a16-8f81-ff35506685b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:17.526704 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1044/2082] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:35:17.528151 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9272b-b48e-4b71-971b-74c61c9283ea None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:17.537997 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9272b-b48e-4b71-971b-74c61c9283ea None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:17.542993 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3eaff-0903-4af8-82d5-cddb93740810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:17.544284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3eaff-0903-4af8-82d5-cddb93740810 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:17.544594 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3eaff-0903-4af8-82d5-cddb93740810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:17.544879 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3eaff-0903-4af8-82d5-cddb93740810 admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:17.545710 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3eaff-0903-4af8-82d5-cddb93740810 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:35:17.546029 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3eaff-0903-4af8-82d5-cddb93740810 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:17.547873 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3eaff-0903-4af8-82d5-cddb93740810 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:17.560760 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1039/2083] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:35:17.565127 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a03f5-6f90-4a16-8f81-ff35506685b4 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:17.574482 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a03f5-6f90-4a16-8f81-ff35506685b4 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:17.579453 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f5849-aec5-4920-838a-37e91e3bc208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:17.580063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f5849-aec5-4920-838a-37e91e3bc208 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:17.580365 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f5849-aec5-4920-838a-37e91e3bc208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:17.580642 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f5849-aec5-4920-838a-37e91e3bc208 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:17.581283 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f5849-aec5-4920-838a-37e91e3bc208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:17.583225 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f5849-aec5-4920-838a-37e91e3bc208 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:17.612593 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1045/2084] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:35:17 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:35:17.616626 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3eaff-0903-4af8-82d5-cddb93740810 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:17.627776 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3eaff-0903-4af8-82d5-cddb93740810 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:17.682527 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:17.692639 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f2672-14cf-42d8-8bd6-2800b8f17562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:17.693242 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f2672-14cf-42d8-8bd6-2800b8f17562 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:17.693522 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f2672-14cf-42d8-8bd6-2800b8f17562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:17.693821 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f2672-14cf-42d8-8bd6-2800b8f17562 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:17.694488 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f2672-14cf-42d8-8bd6-2800b8f17562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:17.696473 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f2672-14cf-42d8-8bd6-2800b8f17562 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:17.721051 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1040/2085] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:35:17 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:35:17.725245 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f5849-aec5-4920-838a-37e91e3bc208 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:17.740373 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f5849-aec5-4920-838a-37e91e3bc208 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:17.745178 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae256e-f5d4-49b5-bfeb-a024b9307649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:17.745857 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae256e-f5d4-49b5-bfeb-a024b9307649 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:17.746213 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae256e-f5d4-49b5-bfeb-a024b9307649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:17.746590 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae256e-f5d4-49b5-bfeb-a024b9307649 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:17.747326 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae256e-f5d4-49b5-bfeb-a024b9307649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:17.749036 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae256e-f5d4-49b5-bfeb-a024b9307649 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:17.762586 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1046/2086] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:35:17.763741 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f2672-14cf-42d8-8bd6-2800b8f17562 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:17.775311 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f2672-14cf-42d8-8bd6-2800b8f17562 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:17.780878 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc6ea4-c91d-4ba7-b98d-807b17e2f64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:17.781507 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc6ea4-c91d-4ba7-b98d-807b17e2f64a admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:17.781789 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc6ea4-c91d-4ba7-b98d-807b17e2f64a admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:17.782064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc6ea4-c91d-4ba7-b98d-807b17e2f64a admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:17.782719 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc6ea4-c91d-4ba7-b98d-807b17e2f64a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:17.784331 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc6ea4-c91d-4ba7-b98d-807b17e2f64a admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:17.795901 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1041/2087] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:35:17.800171 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae256e-f5d4-49b5-bfeb-a024b9307649 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:17.815544 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae256e-f5d4-49b5-bfeb-a024b9307649 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:17.820389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b71fd-c364-45d6-86da-34a8e2e08817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:17.821100 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b71fd-c364-45d6-86da-34a8e2e08817 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:17.821393 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b71fd-c364-45d6-86da-34a8e2e08817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:17.821672 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b71fd-c364-45d6-86da-34a8e2e08817 admin admin] PATH_INFO: `/v3/projects/b04ec5a111794f7db29da1095dfeb7a0/users/0f5e85fe8d4e436eafdf38f8276674c7/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:17.837025 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b71fd-c364-45d6-86da-34a8e2e08817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b04ec5a111794f7db29da1095dfeb7a0, user_id=0f5e85fe8d4e436eafdf38f8276674c7, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:17.839703 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b71fd-c364-45d6-86da-34a8e2e08817 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:17.856638 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1047/2088] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:35:17 2022] PUT /identity/v3/projects/b04ec5a111794f7db29da1095dfeb7a0/users/0f5e85fe8d4e436eafdf38f8276674c7/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:35:17.865406 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57385c6-b433-4217-86a5-f40799d5275e None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:17.865706 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57385c6-b433-4217-86a5-f40799d5275e None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:17.865955 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57385c6-b433-4217-86a5-f40799d5275e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:17.893331 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-a57385c6-b433-4217-86a5-f40799d5275e None None] MFA Rules not processed for user `0f5e85fe8d4e436eafdf38f8276674c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:35:17.894531 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-a57385c6-b433-4217-86a5-f40799d5275e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:17.962998 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1042/2089] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:35:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:35:17.968255 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b71fd-c364-45d6-86da-34a8e2e08817 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:18.034562 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b71fd-c364-45d6-86da-34a8e2e08817 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:18.039421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503429e-5e4e-406f-a2ed-bff7eaedff08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:18.040031 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503429e-5e4e-406f-a2ed-bff7eaedff08 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:18.040314 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503429e-5e4e-406f-a2ed-bff7eaedff08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:18.040629 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503429e-5e4e-406f-a2ed-bff7eaedff08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:18.041305 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a503429e-5e4e-406f-a2ed-bff7eaedff08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:18.043233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a503429e-5e4e-406f-a2ed-bff7eaedff08 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:18.068950 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:18.077488 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1048/2090] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:35:17 2022] POST /identity/v3/projects => generated 363 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:35:18.081153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57385c6-b433-4217-86a5-f40799d5275e None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:18.092763 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57385c6-b433-4217-86a5-f40799d5275e None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:18.151226 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc519c5-dca1-4112-9834-a8fdfb4d6a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:18.151752 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc519c5-dca1-4112-9834-a8fdfb4d6a24 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:18.152036 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc519c5-dca1-4112-9834-a8fdfb4d6a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:18.152352 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc519c5-dca1-4112-9834-a8fdfb4d6a24 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:18.153069 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc519c5-dca1-4112-9834-a8fdfb4d6a24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:18.155261 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc519c5-dca1-4112-9834-a8fdfb4d6a24 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:18.177320 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1043/2091] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:35:18 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:35:18.181367 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503429e-5e4e-406f-a2ed-bff7eaedff08 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:18.193478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503429e-5e4e-406f-a2ed-bff7eaedff08 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:18.198282 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6650cf5-f127-4da6-9183-a1f78df62a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:18.198920 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6650cf5-f127-4da6-9183-a1f78df62a3f admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:18.199205 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6650cf5-f127-4da6-9183-a1f78df62a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:18.199487 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6650cf5-f127-4da6-9183-a1f78df62a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:18.200136 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6650cf5-f127-4da6-9183-a1f78df62a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:18.201778 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6650cf5-f127-4da6-9183-a1f78df62a3f admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:18.212745 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1049/2092] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:35:18.217233 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc519c5-dca1-4112-9834-a8fdfb4d6a24 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:18.227670 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc519c5-dca1-4112-9834-a8fdfb4d6a24 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:18.233470 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fe11e-00ca-4f14-a2c1-f048b4c5705a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:18.234066 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fe11e-00ca-4f14-a2c1-f048b4c5705a admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:18.234349 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fe11e-00ca-4f14-a2c1-f048b4c5705a admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:18.234869 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fe11e-00ca-4f14-a2c1-f048b4c5705a admin admin] PATH_INFO: `/v3/projects/8823c30115ea479b86747d10b3de314c/users/1b6f181078374a2db4b7ce111ac65567/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:18.250487 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fe11e-00ca-4f14-a2c1-f048b4c5705a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8823c30115ea479b86747d10b3de314c, user_id=1b6f181078374a2db4b7ce111ac65567, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:18.253221 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fe11e-00ca-4f14-a2c1-f048b4c5705a admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:18.268441 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1044/2093] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:35:18 2022] PUT /identity/v3/projects/8823c30115ea479b86747d10b3de314c/users/1b6f181078374a2db4b7ce111ac65567/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:35:18.272468 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6650cf5-f127-4da6-9183-a1f78df62a3f admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:18.282569 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6650cf5-f127-4da6-9183-a1f78df62a3f admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:18.343249 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ffecf-da3b-49d4-93af-c366adccf506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:18.343977 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ffecf-da3b-49d4-93af-c366adccf506 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:18.344135 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ffecf-da3b-49d4-93af-c366adccf506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:18.344414 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ffecf-da3b-49d4-93af-c366adccf506 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:18.345116 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ffecf-da3b-49d4-93af-c366adccf506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:18.346719 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ffecf-da3b-49d4-93af-c366adccf506 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:18.357118 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1050/2094] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:35:18.361534 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fe11e-00ca-4f14-a2c1-f048b4c5705a admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:18.372801 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fe11e-00ca-4f14-a2c1-f048b4c5705a admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:18.377452 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7ff46-7cac-4899-8522-0bc9cbaa4030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:18.378105 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7ff46-7cac-4899-8522-0bc9cbaa4030 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:18.378387 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7ff46-7cac-4899-8522-0bc9cbaa4030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:18.378663 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7ff46-7cac-4899-8522-0bc9cbaa4030 admin admin] PATH_INFO: `/v3/projects/8823c30115ea479b86747d10b3de314c/users/1b6f181078374a2db4b7ce111ac65567/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:18.380583 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7ff46-7cac-4899-8522-0bc9cbaa4030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8823c30115ea479b86747d10b3de314c, user_id=1b6f181078374a2db4b7ce111ac65567, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:18.383258 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7ff46-7cac-4899-8522-0bc9cbaa4030 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:18.393880 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1045/2095] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:35:18 2022] PUT /identity/v3/projects/8823c30115ea479b86747d10b3de314c/users/1b6f181078374a2db4b7ce111ac65567/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:35:18.406163 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a2574-a298-4548-8572-f5d4322f78c6 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:18.406462 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a2574-a298-4548-8572-f5d4322f78c6 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:18.406729 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a2574-a298-4548-8572-f5d4322f78c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:18.435296 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-844a2574-a298-4548-8572-f5d4322f78c6 None None] MFA Rules not processed for user `1b6f181078374a2db4b7ce111ac65567`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:35:18.436503 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-844a2574-a298-4548-8572-f5d4322f78c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:18.506840 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1051/2096] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:35:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:35:18.520079 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7ff46-7cac-4899-8522-0bc9cbaa4030 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:18.522781 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-55f7ff46-7cac-4899-8522-0bc9cbaa4030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:18.538293 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:18.583820 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7ff46-7cac-4899-8522-0bc9cbaa4030 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:18.588079 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1c4cd-6b88-40d8-bb65-780c30c0688e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:18.588739 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1c4cd-6b88-40d8-bb65-780c30c0688e service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:18.589116 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1c4cd-6b88-40d8-bb65-780c30c0688e service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:18.589476 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1c4cd-6b88-40d8-bb65-780c30c0688e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:18.600015 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1c4cd-6b88-40d8-bb65-780c30c0688e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:18.601493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1c4cd-6b88-40d8-bb65-780c30c0688e service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:18.611507 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1046/2097] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:35:18 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:35:18.687789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a2574-a298-4548-8572-f5d4322f78c6 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:18.697928 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a2574-a298-4548-8572-f5d4322f78c6 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:18.701642 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dea29-6c4d-424f-8ed7-3a5f4afa2d70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:18.702283 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dea29-6c4d-424f-8ed7-3a5f4afa2d70 service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:18.702564 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dea29-6c4d-424f-8ed7-3a5f4afa2d70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:18.702838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dea29-6c4d-424f-8ed7-3a5f4afa2d70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:18.761598 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3dea29-6c4d-424f-8ed7-3a5f4afa2d70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:18.763494 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3dea29-6c4d-424f-8ed7-3a5f4afa2d70 service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:18.772496 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1052/2098] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:35:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:35:21.297128 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1c4cd-6b88-40d8-bb65-780c30c0688e service cinder] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:21.299108 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-81f1c4cd-6b88-40d8-bb65-780c30c0688e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:21.379261 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1c4cd-6b88-40d8-bb65-780c30c0688e service cinder] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:21.384862 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459252b-e8e6-4946-986e-5abff559c50b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:21.385646 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459252b-e8e6-4946-986e-5abff559c50b service nova] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:21.385931 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459252b-e8e6-4946-986e-5abff559c50b service nova] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:21.386204 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459252b-e8e6-4946-986e-5abff559c50b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:21.387967 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-7459252b-e8e6-4946-986e-5abff559c50b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:21.459013 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459252b-e8e6-4946-986e-5abff559c50b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:21.460726 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459252b-e8e6-4946-986e-5abff559c50b service nova] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:21.470954 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1047/2099] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:35:21 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:35:21.529882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dea29-6c4d-424f-8ed7-3a5f4afa2d70 service cinder] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:21.541377 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:21.600828 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dea29-6c4d-424f-8ed7-3a5f4afa2d70 service cinder] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:21.605497 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8678f-dce5-4e82-83e5-7ad28133047a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:21.606136 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8678f-dce5-4e82-83e5-7ad28133047a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:21.606418 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8678f-dce5-4e82-83e5-7ad28133047a admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:21.606694 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8678f-dce5-4e82-83e5-7ad28133047a admin admin] PATH_INFO: `/v3/users/0f5e85fe8d4e436eafdf38f8276674c7` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:21.607852 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8678f-dce5-4e82-83e5-7ad28133047a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f5e85fe8d4e436eafdf38f8276674c7)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:21.609802 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8678f-dce5-4e82-83e5-7ad28133047a admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:21.659085 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-b8d8678f-dce5-4e82-83e5-7ad28133047a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f5e85fe8d4e436eafdf38f8276674c7'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:21.659779 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-b8d8678f-dce5-4e82-83e5-7ad28133047a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f5e85fe8d4e436eafdf38f8276674c7'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:21.666783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-b8d8678f-dce5-4e82-83e5-7ad28133047a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f5e85fe8d4e436eafdf38f8276674c7'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:21.667431 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-b8d8678f-dce5-4e82-83e5-7ad28133047a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f5e85fe8d4e436eafdf38f8276674c7'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:21.680247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-b8d8678f-dce5-4e82-83e5-7ad28133047a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f5e85fe8d4e436eafdf38f8276674c7'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:21.692874 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1053/2100] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:35:21 2022] DELETE /identity/v3/users/0f5e85fe8d4e436eafdf38f8276674c7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:35:21.698635 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d49b3-7a6e-41f3-b1a8-7cdf5315ec96 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:21.698952 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d49b3-7a6e-41f3-b1a8-7cdf5315ec96 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:21.699234 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d49b3-7a6e-41f3-b1a8-7cdf5315ec96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:21.720718 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-6b2d49b3-7a6e-41f3-b1a8-7cdf5315ec96 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:35:21.721913 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-6b2d49b3-7a6e-41f3-b1a8-7cdf5315ec96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:21.770314 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:21.784304 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1048/2101] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:35:21.794029 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8678f-dce5-4e82-83e5-7ad28133047a admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:21.795424 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-b8d8678f-dce5-4e82-83e5-7ad28133047a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:21.853714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8678f-dce5-4e82-83e5-7ad28133047a admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:21.857478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923ca1a-1dd1-427d-a496-d839b7afd04e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:21.858091 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923ca1a-1dd1-427d-a496-d839b7afd04e service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:21.858382 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923ca1a-1dd1-427d-a496-d839b7afd04e service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:21.858784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923ca1a-1dd1-427d-a496-d839b7afd04e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:21.868174 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a923ca1a-1dd1-427d-a496-d839b7afd04e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:21.869639 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a923ca1a-1dd1-427d-a496-d839b7afd04e service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:21.879123 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1054/2102] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:35:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:35:22.147708 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d49b3-7a6e-41f3-b1a8-7cdf5315ec96 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:22.149318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-6b2d49b3-7a6e-41f3-b1a8-7cdf5315ec96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:22.161115 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d49b3-7a6e-41f3-b1a8-7cdf5315ec96 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:22.165993 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f77ef-991d-4703-a94e-8b3ea0782562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:22.166582 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f77ef-991d-4703-a94e-8b3ea0782562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:22.166906 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f77ef-991d-4703-a94e-8b3ea0782562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:22.167095 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f77ef-991d-4703-a94e-8b3ea0782562 admin admin] PATH_INFO: `/v3/projects/b04ec5a111794f7db29da1095dfeb7a0` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:22.168229 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f77ef-991d-4703-a94e-8b3ea0782562 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b04ec5a111794f7db29da1095dfeb7a0)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:22.171041 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f77ef-991d-4703-a94e-8b3ea0782562 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:22.221064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-544f77ef-991d-4703-a94e-8b3ea0782562 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b04ec5a111794f7db29da1095dfeb7a0', 'request_id': 'req-544f77ef-991d-4703-a94e-8b3ea0782562'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:22.226748 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-544f77ef-991d-4703-a94e-8b3ea0782562 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b04ec5a111794f7db29da1095dfeb7a0', 'request_id': 'req-544f77ef-991d-4703-a94e-8b3ea0782562'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:22.233435 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-544f77ef-991d-4703-a94e-8b3ea0782562 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b04ec5a111794f7db29da1095dfeb7a0', 'request_id': 'req-544f77ef-991d-4703-a94e-8b3ea0782562'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:22.246474 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-544f77ef-991d-4703-a94e-8b3ea0782562 admin admin] The token cache is being invalidate because project b04ec5a111794f7db29da1095dfeb7a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:35:22.246767 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-544f77ef-991d-4703-a94e-8b3ea0782562 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:22.247414 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-544f77ef-991d-4703-a94e-8b3ea0782562 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:22.248927 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1049/2103] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:35:22 2022] DELETE /identity/v3/projects/b04ec5a111794f7db29da1095dfeb7a0 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:35:22.253497 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923ca1a-1dd1-427d-a496-d839b7afd04e service neutron] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:22.263993 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923ca1a-1dd1-427d-a496-d839b7afd04e service neutron] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:22.292675 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:22.324973 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af4340-9c80-4aa9-a86c-ea77e68622b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:22.325612 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af4340-9c80-4aa9-a86c-ea77e68622b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:22.325895 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af4340-9c80-4aa9-a86c-ea77e68622b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:22.326172 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af4340-9c80-4aa9-a86c-ea77e68622b7 admin admin] PATH_INFO: `/v3/users/1b6f181078374a2db4b7ce111ac65567` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:22.327293 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af4340-9c80-4aa9-a86c-ea77e68622b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b6f181078374a2db4b7ce111ac65567)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:22.329875 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af4340-9c80-4aa9-a86c-ea77e68622b7 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:22.378910 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-85af4340-9c80-4aa9-a86c-ea77e68622b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b6f181078374a2db4b7ce111ac65567'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:22.379580 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-85af4340-9c80-4aa9-a86c-ea77e68622b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b6f181078374a2db4b7ce111ac65567'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:22.386890 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-85af4340-9c80-4aa9-a86c-ea77e68622b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b6f181078374a2db4b7ce111ac65567'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:22.387540 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-85af4340-9c80-4aa9-a86c-ea77e68622b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b6f181078374a2db4b7ce111ac65567'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:22.400758 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-85af4340-9c80-4aa9-a86c-ea77e68622b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b6f181078374a2db4b7ce111ac65567'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:22.417414 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1055/2104] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:35:22 2022] DELETE /identity/v3/users/1b6f181078374a2db4b7ce111ac65567 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:35:22.694712 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f77ef-991d-4703-a94e-8b3ea0782562 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:22.696186 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-544f77ef-991d-4703-a94e-8b3ea0782562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:22.709888 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f77ef-991d-4703-a94e-8b3ea0782562 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:22.771756 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c76375-63fa-40b0-a2e4-e9fc916cfc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:22.772412 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c76375-63fa-40b0-a2e4-e9fc916cfc5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:22.772724 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c76375-63fa-40b0-a2e4-e9fc916cfc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:22.773000 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c76375-63fa-40b0-a2e4-e9fc916cfc5a admin admin] PATH_INFO: `/v3/projects/8823c30115ea479b86747d10b3de314c` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:22.774126 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c76375-63fa-40b0-a2e4-e9fc916cfc5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8823c30115ea479b86747d10b3de314c)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:22.776039 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c76375-63fa-40b0-a2e4-e9fc916cfc5a admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:22.824534 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-35c76375-63fa-40b0-a2e4-e9fc916cfc5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8823c30115ea479b86747d10b3de314c', 'request_id': 'req-35c76375-63fa-40b0-a2e4-e9fc916cfc5a'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:22.831144 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-35c76375-63fa-40b0-a2e4-e9fc916cfc5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8823c30115ea479b86747d10b3de314c', 'request_id': 'req-35c76375-63fa-40b0-a2e4-e9fc916cfc5a'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:22.848208 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-35c76375-63fa-40b0-a2e4-e9fc916cfc5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8823c30115ea479b86747d10b3de314c', 'request_id': 'req-35c76375-63fa-40b0-a2e4-e9fc916cfc5a'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:22.861844 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-35c76375-63fa-40b0-a2e4-e9fc916cfc5a admin admin] The token cache is being invalidate because project 8823c30115ea479b86747d10b3de314c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:35:22.861844 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-35c76375-63fa-40b0-a2e4-e9fc916cfc5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:22.862412 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-35c76375-63fa-40b0-a2e4-e9fc916cfc5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:22.863895 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1050/2105] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:35:22 2022] DELETE /identity/v3/projects/8823c30115ea479b86747d10b3de314c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:35:22.868889 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6cbe3-4f85-45de-850c-b16a4a1fcafe None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:22.869352 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6cbe3-4f85-45de-850c-b16a4a1fcafe None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:22.869453 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6cbe3-4f85-45de-850c-b16a4a1fcafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:22.891016 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-06d6cbe3-4f85-45de-850c-b16a4a1fcafe None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:35:22.892234 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-06d6cbe3-4f85-45de-850c-b16a4a1fcafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:22.951682 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1056/2106] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:35:22.960007 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd96790-aa0c-4e99-b77e-659f68992c3b None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:22.960297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd96790-aa0c-4e99-b77e-659f68992c3b None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:22.960596 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd96790-aa0c-4e99-b77e-659f68992c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:22.975192 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:22.981367 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-1bd96790-aa0c-4e99-b77e-659f68992c3b None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:35:22.983169 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-1bd96790-aa0c-4e99-b77e-659f68992c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:22.993541 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1051/2107] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:35:22.997795 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6cbe3-4f85-45de-850c-b16a4a1fcafe None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:23.010432 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6cbe3-4f85-45de-850c-b16a4a1fcafe None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:23.015163 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7b34a-2e47-4aee-9cb0-63945001c60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:23.016303 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7b34a-2e47-4aee-9cb0-63945001c60a admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:23.016613 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7b34a-2e47-4aee-9cb0-63945001c60a admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:23.016895 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7b34a-2e47-4aee-9cb0-63945001c60a admin admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:23.017548 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7b34a-2e47-4aee-9cb0-63945001c60a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:35:23.017857 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7b34a-2e47-4aee-9cb0-63945001c60a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:23.019453 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7b34a-2e47-4aee-9cb0-63945001c60a admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:23.031088 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1057/2108] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:35:23.035541 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd96790-aa0c-4e99-b77e-659f68992c3b None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:23.045511 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd96790-aa0c-4e99-b77e-659f68992c3b None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:23.050281 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e650f8-8cd4-418b-90c6-e3885b42502f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:23.050883 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e650f8-8cd4-418b-90c6-e3885b42502f admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:23.051164 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e650f8-8cd4-418b-90c6-e3885b42502f admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:23.051436 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e650f8-8cd4-418b-90c6-e3885b42502f admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:23.052078 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e650f8-8cd4-418b-90c6-e3885b42502f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:23.053999 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e650f8-8cd4-418b-90c6-e3885b42502f admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:23.083725 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1052/2109] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:35:23 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:35:23.087841 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7b34a-2e47-4aee-9cb0-63945001c60a admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:23.098272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7b34a-2e47-4aee-9cb0-63945001c60a admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:23.131064 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:23.155933 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890c977-c07b-44ab-9fd9-6258a1726122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:23.156541 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890c977-c07b-44ab-9fd9-6258a1726122 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:23.156856 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890c977-c07b-44ab-9fd9-6258a1726122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:23.157135 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890c977-c07b-44ab-9fd9-6258a1726122 admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:23.157768 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890c977-c07b-44ab-9fd9-6258a1726122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:23.159671 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890c977-c07b-44ab-9fd9-6258a1726122 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:23.180269 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1058/2110] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:35:23 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:35:23.184327 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e650f8-8cd4-418b-90c6-e3885b42502f admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:23.195062 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e650f8-8cd4-418b-90c6-e3885b42502f admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:23.199792 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67be45-9ae0-42de-b0a5-5098d0d0ab67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:23.200426 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67be45-9ae0-42de-b0a5-5098d0d0ab67 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:23.200764 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67be45-9ae0-42de-b0a5-5098d0d0ab67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:23.201043 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67be45-9ae0-42de-b0a5-5098d0d0ab67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:23.201689 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae67be45-9ae0-42de-b0a5-5098d0d0ab67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:23.203877 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae67be45-9ae0-42de-b0a5-5098d0d0ab67 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:23.214276 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1053/2111] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:35:23.217888 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890c977-c07b-44ab-9fd9-6258a1726122 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:23.227872 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890c977-c07b-44ab-9fd9-6258a1726122 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:23.232487 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19902c8f-bfe6-4a41-a17c-123f5b175c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:23.233177 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19902c8f-bfe6-4a41-a17c-123f5b175c9b admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:23.233460 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19902c8f-bfe6-4a41-a17c-123f5b175c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:23.233736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19902c8f-bfe6-4a41-a17c-123f5b175c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:23.234868 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19902c8f-bfe6-4a41-a17c-123f5b175c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:23.236581 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19902c8f-bfe6-4a41-a17c-123f5b175c9b admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:23.246622 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1059/2112] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:35:23.251756 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67be45-9ae0-42de-b0a5-5098d0d0ab67 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:23.262752 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67be45-9ae0-42de-b0a5-5098d0d0ab67 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:23.267653 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fbf92-1dec-4612-83ea-b1403d0c597d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:23.268319 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fbf92-1dec-4612-83ea-b1403d0c597d admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:23.268607 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fbf92-1dec-4612-83ea-b1403d0c597d admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:23.268887 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fbf92-1dec-4612-83ea-b1403d0c597d admin admin] PATH_INFO: `/v3/projects/a0813d8db05a4e778877284d2d3519d1/users/9a22c9ebe91845e8b4c220fb7ff3d13e/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:23.284380 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944fbf92-1dec-4612-83ea-b1403d0c597d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0813d8db05a4e778877284d2d3519d1, user_id=9a22c9ebe91845e8b4c220fb7ff3d13e, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:23.287255 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944fbf92-1dec-4612-83ea-b1403d0c597d admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:23.302886 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1054/2113] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:35:23 2022] PUT /identity/v3/projects/a0813d8db05a4e778877284d2d3519d1/users/9a22c9ebe91845e8b4c220fb7ff3d13e/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:35:23.314018 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8c435-fe51-4ac0-a960-19d9ee5e17ab None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:23.314364 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8c435-fe51-4ac0-a960-19d9ee5e17ab None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:23.314638 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8c435-fe51-4ac0-a960-19d9ee5e17ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:23.347156 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-4ee8c435-fe51-4ac0-a960-19d9ee5e17ab None None] MFA Rules not processed for user `9a22c9ebe91845e8b4c220fb7ff3d13e`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:35:23.348538 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-4ee8c435-fe51-4ac0-a960-19d9ee5e17ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:23.414244 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1060/2114] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:35:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:35:23.418831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fbf92-1dec-4612-83ea-b1403d0c597d admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:23.491139 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fbf92-1dec-4612-83ea-b1403d0c597d admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:23.496645 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d4370-dc62-46d4-912d-b3f33d0eb626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:23.497333 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d4370-dc62-46d4-912d-b3f33d0eb626 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:23.497620 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d4370-dc62-46d4-912d-b3f33d0eb626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:23.497902 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d4370-dc62-46d4-912d-b3f33d0eb626 admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:23.498694 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d4370-dc62-46d4-912d-b3f33d0eb626 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:23.501264 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d4370-dc62-46d4-912d-b3f33d0eb626 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:23.537736 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1055/2115] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:35:23 2022] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:35:23.542064 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8c435-fe51-4ac0-a960-19d9ee5e17ab None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:23.554771 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8c435-fe51-4ac0-a960-19d9ee5e17ab None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:23.621069 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e522f3-baff-4132-a814-1353a73ef501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:23.621691 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e522f3-baff-4132-a814-1353a73ef501 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:23.621980 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e522f3-baff-4132-a814-1353a73ef501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:23.622283 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e522f3-baff-4132-a814-1353a73ef501 admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:23.622932 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e522f3-baff-4132-a814-1353a73ef501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:23.624906 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e522f3-baff-4132-a814-1353a73ef501 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:23.646129 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1061/2116] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:35:23 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:35:23.650243 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d4370-dc62-46d4-912d-b3f33d0eb626 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:23.660937 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d4370-dc62-46d4-912d-b3f33d0eb626 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:23.665647 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ed455-9d29-4771-9bd6-d5ef91c16a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:23.666233 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ed455-9d29-4771-9bd6-d5ef91c16a88 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:23.666513 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ed455-9d29-4771-9bd6-d5ef91c16a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:23.666787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ed455-9d29-4771-9bd6-d5ef91c16a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:23.667452 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ed455-9d29-4771-9bd6-d5ef91c16a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:23.669110 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ed455-9d29-4771-9bd6-d5ef91c16a88 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:23.680111 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1056/2117] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:35:23.684209 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e522f3-baff-4132-a814-1353a73ef501 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:23.693948 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e522f3-baff-4132-a814-1353a73ef501 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:23.698469 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a46812-9a87-4191-aa10-d9b49cbd0815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:23.699051 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a46812-9a87-4191-aa10-d9b49cbd0815 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:23.699327 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a46812-9a87-4191-aa10-d9b49cbd0815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:23.699598 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a46812-9a87-4191-aa10-d9b49cbd0815 admin admin] PATH_INFO: `/v3/projects/ede9a943a9fb43b6bfbec57496666b4e/users/60129a4b8f4743a1b8fc36fffa257537/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:23.715643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a46812-9a87-4191-aa10-d9b49cbd0815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ede9a943a9fb43b6bfbec57496666b4e, user_id=60129a4b8f4743a1b8fc36fffa257537, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:23.719239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a46812-9a87-4191-aa10-d9b49cbd0815 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:23.731876 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1062/2118] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:35:23 2022] PUT /identity/v3/projects/ede9a943a9fb43b6bfbec57496666b4e/users/60129a4b8f4743a1b8fc36fffa257537/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:35:23.736592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ed455-9d29-4771-9bd6-d5ef91c16a88 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:23.746924 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ed455-9d29-4771-9bd6-d5ef91c16a88 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:23.802606 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a3af5-a41c-4f50-bd21-837755c74ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:23.803211 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a3af5-a41c-4f50-bd21-837755c74ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:23.803496 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a3af5-a41c-4f50-bd21-837755c74ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:23.803774 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a3af5-a41c-4f50-bd21-837755c74ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:23.804411 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127a3af5-a41c-4f50-bd21-837755c74ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:23.806051 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127a3af5-a41c-4f50-bd21-837755c74ab2 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:23.815630 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1057/2119] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:35:23.819773 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a46812-9a87-4191-aa10-d9b49cbd0815 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:23.830070 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a46812-9a87-4191-aa10-d9b49cbd0815 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:23.834468 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7ce01-7b9b-4077-a258-270e87b1a7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:23.835112 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7ce01-7b9b-4077-a258-270e87b1a7ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:23.835469 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7ce01-7b9b-4077-a258-270e87b1a7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:23.835759 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7ce01-7b9b-4077-a258-270e87b1a7ed admin admin] PATH_INFO: `/v3/projects/ede9a943a9fb43b6bfbec57496666b4e/users/60129a4b8f4743a1b8fc36fffa257537/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:23.838052 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d7ce01-7b9b-4077-a258-270e87b1a7ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=ede9a943a9fb43b6bfbec57496666b4e, user_id=60129a4b8f4743a1b8fc36fffa257537, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:23.840755 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d7ce01-7b9b-4077-a258-270e87b1a7ed admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:23.847137 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:23.854385 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1063/2120] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:35:23 2022] PUT /identity/v3/projects/ede9a943a9fb43b6bfbec57496666b4e/users/60129a4b8f4743a1b8fc36fffa257537/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:35:23.868049 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17c9e5-0778-42e3-b41a-8ebe79d185f8 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:23.868354 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17c9e5-0778-42e3-b41a-8ebe79d185f8 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:23.868660 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17c9e5-0778-42e3-b41a-8ebe79d185f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:23.894325 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:23.897675 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-ce17c9e5-0778-42e3-b41a-8ebe79d185f8 None None] MFA Rules not processed for user `60129a4b8f4743a1b8fc36fffa257537`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:35:23.910555 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-ce17c9e5-0778-42e3-b41a-8ebe79d185f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:23.990300 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1058/2121] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:35:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:35:24.001480 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7ce01-7b9b-4077-a258-270e87b1a7ed admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:24.003201 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-12d7ce01-7b9b-4077-a258-270e87b1a7ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:24.064665 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7ce01-7b9b-4077-a258-270e87b1a7ed admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:24.068267 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d9564-9767-43d2-a603-2a9a3bd4cf71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:24.068921 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d9564-9767-43d2-a603-2a9a3bd4cf71 service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:24.069229 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d9564-9767-43d2-a603-2a9a3bd4cf71 service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:24.069505 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d9564-9767-43d2-a603-2a9a3bd4cf71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:24.079012 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d9564-9767-43d2-a603-2a9a3bd4cf71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:24.080483 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d9564-9767-43d2-a603-2a9a3bd4cf71 service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:24.089749 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1064/2122] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:35:24 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:35:24.455175 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17c9e5-0778-42e3-b41a-8ebe79d185f8 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:24.517719 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17c9e5-0778-42e3-b41a-8ebe79d185f8 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:24.522299 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffe84a-92e7-48ce-bc2c-cea39f1b56bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:24.522937 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffe84a-92e7-48ce-bc2c-cea39f1b56bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:24.523225 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffe84a-92e7-48ce-bc2c-cea39f1b56bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:24.523502 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffe84a-92e7-48ce-bc2c-cea39f1b56bd admin admin] PATH_INFO: `/v3/users/9a22c9ebe91845e8b4c220fb7ff3d13e` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:24.524769 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fffe84a-92e7-48ce-bc2c-cea39f1b56bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a22c9ebe91845e8b4c220fb7ff3d13e)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:24.526806 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fffe84a-92e7-48ce-bc2c-cea39f1b56bd admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:24.571801 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-0fffe84a-92e7-48ce-bc2c-cea39f1b56bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a22c9ebe91845e8b4c220fb7ff3d13e'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:24.572459 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-0fffe84a-92e7-48ce-bc2c-cea39f1b56bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a22c9ebe91845e8b4c220fb7ff3d13e'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:24.584066 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-0fffe84a-92e7-48ce-bc2c-cea39f1b56bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a22c9ebe91845e8b4c220fb7ff3d13e'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:24.584724 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-0fffe84a-92e7-48ce-bc2c-cea39f1b56bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a22c9ebe91845e8b4c220fb7ff3d13e'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:24.591503 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-0fffe84a-92e7-48ce-bc2c-cea39f1b56bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a22c9ebe91845e8b4c220fb7ff3d13e'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:24.605114 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1059/2123] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:35:24 2022] DELETE /identity/v3/users/9a22c9ebe91845e8b4c220fb7ff3d13e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:35:24.610108 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a0b65-5d1c-44f2-8a1e-c5b167b7654f None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:24.610490 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a0b65-5d1c-44f2-8a1e-c5b167b7654f None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:24.610873 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a0b65-5d1c-44f2-8a1e-c5b167b7654f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:24.630365 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-799a0b65-5d1c-44f2-8a1e-c5b167b7654f None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:35:24.631827 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-799a0b65-5d1c-44f2-8a1e-c5b167b7654f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:24.693187 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1065/2124] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:35:24.703358 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffe84a-92e7-48ce-bc2c-cea39f1b56bd admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:24.704788 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-0fffe84a-92e7-48ce-bc2c-cea39f1b56bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:24.726204 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:24.769885 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffe84a-92e7-48ce-bc2c-cea39f1b56bd admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:24.773579 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243297f5-7402-42b6-bb14-9f4efee447d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:24.774195 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243297f5-7402-42b6-bb14-9f4efee447d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:24.774481 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243297f5-7402-42b6-bb14-9f4efee447d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:24.774762 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243297f5-7402-42b6-bb14-9f4efee447d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:24.784633 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243297f5-7402-42b6-bb14-9f4efee447d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:24.786080 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243297f5-7402-42b6-bb14-9f4efee447d6 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:24.795703 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1060/2125] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:35:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:35:25.113334 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a0b65-5d1c-44f2-8a1e-c5b167b7654f None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:25.115148 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-799a0b65-5d1c-44f2-8a1e-c5b167b7654f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:25.129008 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a0b65-5d1c-44f2-8a1e-c5b167b7654f None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:25.137541 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6b08e-03e6-485b-a46a-97615f6806f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:25.138713 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6b08e-03e6-485b-a46a-97615f6806f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:25.139077 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6b08e-03e6-485b-a46a-97615f6806f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:25.139277 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6b08e-03e6-485b-a46a-97615f6806f9 admin admin] PATH_INFO: `/v3/projects/a0813d8db05a4e778877284d2d3519d1` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:25.140470 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6b08e-03e6-485b-a46a-97615f6806f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0813d8db05a4e778877284d2d3519d1)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:25.143124 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6b08e-03e6-485b-a46a-97615f6806f9 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:25.195157 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-23c6b08e-03e6-485b-a46a-97615f6806f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0813d8db05a4e778877284d2d3519d1', 'request_id': 'req-23c6b08e-03e6-485b-a46a-97615f6806f9'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:25.202178 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-23c6b08e-03e6-485b-a46a-97615f6806f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0813d8db05a4e778877284d2d3519d1', 'request_id': 'req-23c6b08e-03e6-485b-a46a-97615f6806f9'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:25.211485 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-23c6b08e-03e6-485b-a46a-97615f6806f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0813d8db05a4e778877284d2d3519d1', 'request_id': 'req-23c6b08e-03e6-485b-a46a-97615f6806f9'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:25.224719 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-23c6b08e-03e6-485b-a46a-97615f6806f9 admin admin] The token cache is being invalidate because project a0813d8db05a4e778877284d2d3519d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:35:25.225047 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-23c6b08e-03e6-485b-a46a-97615f6806f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:25.225827 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-23c6b08e-03e6-485b-a46a-97615f6806f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:25.227299 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1066/2126] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:35:25 2022] DELETE /identity/v3/projects/a0813d8db05a4e778877284d2d3519d1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:35:25.231222 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243297f5-7402-42b6-bb14-9f4efee447d6 service neutron] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:25.241762 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243297f5-7402-42b6-bb14-9f4efee447d6 service neutron] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:25.297040 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e3e30-9001-4912-83b2-f2b67be6fc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:25.298542 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e3e30-9001-4912-83b2-f2b67be6fc29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:25.298714 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e3e30-9001-4912-83b2-f2b67be6fc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:25.298991 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e3e30-9001-4912-83b2-f2b67be6fc29 admin admin] PATH_INFO: `/v3/users/60129a4b8f4743a1b8fc36fffa257537` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:25.300117 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e3e30-9001-4912-83b2-f2b67be6fc29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60129a4b8f4743a1b8fc36fffa257537)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:25.302052 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e3e30-9001-4912-83b2-f2b67be6fc29 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:25.350649 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-421e3e30-9001-4912-83b2-f2b67be6fc29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60129a4b8f4743a1b8fc36fffa257537'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:25.351305 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-421e3e30-9001-4912-83b2-f2b67be6fc29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60129a4b8f4743a1b8fc36fffa257537'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:25.363210 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-421e3e30-9001-4912-83b2-f2b67be6fc29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60129a4b8f4743a1b8fc36fffa257537'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:25.363847 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-421e3e30-9001-4912-83b2-f2b67be6fc29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60129a4b8f4743a1b8fc36fffa257537'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:25.370711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-421e3e30-9001-4912-83b2-f2b67be6fc29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60129a4b8f4743a1b8fc36fffa257537'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:25.384120 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1061/2127] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:35:25 2022] DELETE /identity/v3/users/60129a4b8f4743a1b8fc36fffa257537 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:35:25.657211 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6b08e-03e6-485b-a46a-97615f6806f9 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:25.659015 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-23c6b08e-03e6-485b-a46a-97615f6806f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:25.676761 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6b08e-03e6-485b-a46a-97615f6806f9 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:25.700071 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:25.742041 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e08125-cebb-4291-9531-de2d935497fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:25.742819 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e08125-cebb-4291-9531-de2d935497fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:25.743047 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e08125-cebb-4291-9531-de2d935497fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:25.743269 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e08125-cebb-4291-9531-de2d935497fb admin admin] PATH_INFO: `/v3/projects/ede9a943a9fb43b6bfbec57496666b4e` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:25.744570 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e08125-cebb-4291-9531-de2d935497fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ede9a943a9fb43b6bfbec57496666b4e)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:25.746521 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e08125-cebb-4291-9531-de2d935497fb admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:25.798757 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-b5e08125-cebb-4291-9531-de2d935497fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ede9a943a9fb43b6bfbec57496666b4e', 'request_id': 'req-b5e08125-cebb-4291-9531-de2d935497fb'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:25.805248 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-b5e08125-cebb-4291-9531-de2d935497fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ede9a943a9fb43b6bfbec57496666b4e', 'request_id': 'req-b5e08125-cebb-4291-9531-de2d935497fb'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:25.813434 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-b5e08125-cebb-4291-9531-de2d935497fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ede9a943a9fb43b6bfbec57496666b4e', 'request_id': 'req-b5e08125-cebb-4291-9531-de2d935497fb'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:25.823904 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-b5e08125-cebb-4291-9531-de2d935497fb admin admin] The token cache is being invalidate because project ede9a943a9fb43b6bfbec57496666b4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:35:25.824194 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-b5e08125-cebb-4291-9531-de2d935497fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:25.824931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-b5e08125-cebb-4291-9531-de2d935497fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:25.826425 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1067/2128] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:35:25 2022] DELETE /identity/v3/projects/ede9a943a9fb43b6bfbec57496666b4e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:35:25.831509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb37a5-2101-4d48-98c2-75b1f81fee7f None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:25.831963 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb37a5-2101-4d48-98c2-75b1f81fee7f None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:25.832074 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb37a5-2101-4d48-98c2-75b1f81fee7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:25.852241 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-a9eb37a5-2101-4d48-98c2-75b1f81fee7f None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:35:25.853463 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-a9eb37a5-2101-4d48-98c2-75b1f81fee7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:25.885910 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:25.912690 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1062/2129] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:35:25.920460 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c641f7-4fd6-4a0f-b4c9-15afe61a6872 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:25.920843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c641f7-4fd6-4a0f-b4c9-15afe61a6872 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:25.921124 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c641f7-4fd6-4a0f-b4c9-15afe61a6872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:25.941179 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-05c641f7-4fd6-4a0f-b4c9-15afe61a6872 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:35:25.942372 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-05c641f7-4fd6-4a0f-b4c9-15afe61a6872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:25.950204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1068/2130] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:35:25.954271 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb37a5-2101-4d48-98c2-75b1f81fee7f None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:25.963831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb37a5-2101-4d48-98c2-75b1f81fee7f None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:25.969377 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4ef80-3b21-4e32-a363-b9cb9228c6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:25.969969 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4ef80-3b21-4e32-a363-b9cb9228c6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:25.970246 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4ef80-3b21-4e32-a363-b9cb9228c6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:25.970519 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4ef80-3b21-4e32-a363-b9cb9228c6d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:25.971200 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4ef80-3b21-4e32-a363-b9cb9228c6d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:35:25.971519 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4ef80-3b21-4e32-a363-b9cb9228c6d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:25.973171 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4ef80-3b21-4e32-a363-b9cb9228c6d6 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:25.985268 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1063/2131] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:35:25.989332 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c641f7-4fd6-4a0f-b4c9-15afe61a6872 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:25.998468 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c641f7-4fd6-4a0f-b4c9-15afe61a6872 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:26.003210 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522973a-5394-4c07-985a-2291d166368b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:26.003820 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522973a-5394-4c07-985a-2291d166368b admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:26.004080 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522973a-5394-4c07-985a-2291d166368b admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:26.004354 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522973a-5394-4c07-985a-2291d166368b admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:26.005028 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522973a-5394-4c07-985a-2291d166368b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:26.006920 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522973a-5394-4c07-985a-2291d166368b admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:26.036661 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1069/2132] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:35:25 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:35:26.040873 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4ef80-3b21-4e32-a363-b9cb9228c6d6 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:26.051790 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4ef80-3b21-4e32-a363-b9cb9228c6d6 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:26.125493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1413230-05e2-4b9f-bd38-45ce821ef6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:26.126357 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1413230-05e2-4b9f-bd38-45ce821ef6de admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:26.126701 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1413230-05e2-4b9f-bd38-45ce821ef6de admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:26.127662 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1413230-05e2-4b9f-bd38-45ce821ef6de admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:26.128430 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1413230-05e2-4b9f-bd38-45ce821ef6de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:26.130432 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1413230-05e2-4b9f-bd38-45ce821ef6de admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:26.158647 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1064/2133] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:35:26 2022] POST /identity/v3/users => generated 286 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:35:26.160186 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522973a-5394-4c07-985a-2291d166368b admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:26.172292 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522973a-5394-4c07-985a-2291d166368b admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:26.177048 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ffd56-61bd-4121-af40-ea8a30ddc5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:26.177651 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ffd56-61bd-4121-af40-ea8a30ddc5ac admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:26.177935 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ffd56-61bd-4121-af40-ea8a30ddc5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:26.178209 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ffd56-61bd-4121-af40-ea8a30ddc5ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:26.178980 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ffd56-61bd-4121-af40-ea8a30ddc5ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:26.180637 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ffd56-61bd-4121-af40-ea8a30ddc5ac admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:26.192999 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1070/2134] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:35:26.197472 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1413230-05e2-4b9f-bd38-45ce821ef6de admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:26.217920 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1413230-05e2-4b9f-bd38-45ce821ef6de admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:26.224734 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c2b77-f369-4347-a92b-d8f1a10d999d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:26.225338 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c2b77-f369-4347-a92b-d8f1a10d999d admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:26.225555 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c2b77-f369-4347-a92b-d8f1a10d999d admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:26.225832 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c2b77-f369-4347-a92b-d8f1a10d999d admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:26.226514 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c2b77-f369-4347-a92b-d8f1a10d999d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:26.228118 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c2b77-f369-4347-a92b-d8f1a10d999d admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:26.239858 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1065/2135] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:35:26.244188 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ffd56-61bd-4121-af40-ea8a30ddc5ac admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:26.255823 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ffd56-61bd-4121-af40-ea8a30ddc5ac admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:26.261228 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088bce7-63ff-4b5f-951c-9d6eb5e22c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:26.261963 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088bce7-63ff-4b5f-951c-9d6eb5e22c71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:26.262198 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088bce7-63ff-4b5f-951c-9d6eb5e22c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:26.262451 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088bce7-63ff-4b5f-951c-9d6eb5e22c71 admin admin] PATH_INFO: `/v3/projects/cc00e3332ff341c2998f195d1fece3a9/users/4dd92924f4c540c39b1999c81309a6fa/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:26.279323 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088bce7-63ff-4b5f-951c-9d6eb5e22c71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc00e3332ff341c2998f195d1fece3a9, user_id=4dd92924f4c540c39b1999c81309a6fa, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:26.283030 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088bce7-63ff-4b5f-951c-9d6eb5e22c71 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:26.300626 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1071/2136] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:35:26 2022] PUT /identity/v3/projects/cc00e3332ff341c2998f195d1fece3a9/users/4dd92924f4c540c39b1999c81309a6fa/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:35:26.308484 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf5d52-c7ea-4da6-a302-95c2394a0bc8 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:26.309095 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf5d52-c7ea-4da6-a302-95c2394a0bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:26.309612 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf5d52-c7ea-4da6-a302-95c2394a0bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:26.347516 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-ecdf5d52-c7ea-4da6-a302-95c2394a0bc8 None None] MFA Rules not processed for user `4dd92924f4c540c39b1999c81309a6fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:35:26.350076 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-ecdf5d52-c7ea-4da6-a302-95c2394a0bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:26.427094 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1066/2137] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:35:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:35:26.439682 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088bce7-63ff-4b5f-951c-9d6eb5e22c71 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:26.441734 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-b088bce7-63ff-4b5f-951c-9d6eb5e22c71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:26.501004 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088bce7-63ff-4b5f-951c-9d6eb5e22c71 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:26.504611 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b3044-c597-4bf6-84d6-c1d8b275bf53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:26.505213 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b3044-c597-4bf6-84d6-c1d8b275bf53 service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:26.505489 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b3044-c597-4bf6-84d6-c1d8b275bf53 service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:26.505761 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b3044-c597-4bf6-84d6-c1d8b275bf53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:26.511018 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:26.522476 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b3044-c597-4bf6-84d6-c1d8b275bf53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:26.523586 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b3044-c597-4bf6-84d6-c1d8b275bf53 service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:26.534827 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1072/2138] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:35:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:35:26.556685 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf5d52-c7ea-4da6-a302-95c2394a0bc8 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:26.597035 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:26.624206 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf5d52-c7ea-4da6-a302-95c2394a0bc8 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:26.629542 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386276d2-1112-4a3f-80d1-20fd03f09a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:26.630191 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386276d2-1112-4a3f-80d1-20fd03f09a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:26.630478 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386276d2-1112-4a3f-80d1-20fd03f09a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:26.630751 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386276d2-1112-4a3f-80d1-20fd03f09a52 admin admin] PATH_INFO: `/v3/users/4dd92924f4c540c39b1999c81309a6fa` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:26.631893 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386276d2-1112-4a3f-80d1-20fd03f09a52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dd92924f4c540c39b1999c81309a6fa)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:26.633956 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386276d2-1112-4a3f-80d1-20fd03f09a52 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:26.684135 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-386276d2-1112-4a3f-80d1-20fd03f09a52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dd92924f4c540c39b1999c81309a6fa'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:26.685131 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-386276d2-1112-4a3f-80d1-20fd03f09a52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dd92924f4c540c39b1999c81309a6fa'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:26.698911 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-386276d2-1112-4a3f-80d1-20fd03f09a52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dd92924f4c540c39b1999c81309a6fa'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:26.699591 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-386276d2-1112-4a3f-80d1-20fd03f09a52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dd92924f4c540c39b1999c81309a6fa'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:26.707042 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-386276d2-1112-4a3f-80d1-20fd03f09a52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dd92924f4c540c39b1999c81309a6fa'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:26.721205 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1067/2139] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:35:26 2022] DELETE /identity/v3/users/4dd92924f4c540c39b1999c81309a6fa => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:35:26.725828 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e861c-b002-4393-a682-83279ddfe139 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:26.726188 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e861c-b002-4393-a682-83279ddfe139 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:26.726632 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e861c-b002-4393-a682-83279ddfe139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:26.746512 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-663e861c-b002-4393-a682-83279ddfe139 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:35:26.747805 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-663e861c-b002-4393-a682-83279ddfe139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:26.809419 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1073/2140] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:35:26.819660 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386276d2-1112-4a3f-80d1-20fd03f09a52 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:26.821285 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-386276d2-1112-4a3f-80d1-20fd03f09a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:26.879292 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386276d2-1112-4a3f-80d1-20fd03f09a52 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:26.883082 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca62e39-4da4-4be4-890a-a60961cb79e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:26.883690 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca62e39-4da4-4be4-890a-a60961cb79e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:26.883974 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca62e39-4da4-4be4-890a-a60961cb79e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:26.884256 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca62e39-4da4-4be4-890a-a60961cb79e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:26.894085 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca62e39-4da4-4be4-890a-a60961cb79e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:26.895535 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca62e39-4da4-4be4-890a-a60961cb79e0 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:26.905407 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1068/2141] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:35:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:35:27.095929 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e861c-b002-4393-a682-83279ddfe139 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:27.097946 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-663e861c-b002-4393-a682-83279ddfe139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:27.179131 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e861c-b002-4393-a682-83279ddfe139 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:27.184501 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca62e39-4da4-4be4-890a-a60961cb79e0 service neutron] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:27.186097 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-3ca62e39-4da4-4be4-890a-a60961cb79e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:27.190389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e71bb-c225-45d1-9243-5eb72ebb5cb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:27.191017 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e71bb-c225-45d1-9243-5eb72ebb5cb9 service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:27.191302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e71bb-c225-45d1-9243-5eb72ebb5cb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:27.191580 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e71bb-c225-45d1-9243-5eb72ebb5cb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:27.195411 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-143e71bb-c225-45d1-9243-5eb72ebb5cb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:27.200323 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca62e39-4da4-4be4-890a-a60961cb79e0 service neutron] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:27.205607 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b95754-0096-41af-bbda-9677124d43a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:27.206251 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b95754-0096-41af-bbda-9677124d43a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:27.206530 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b95754-0096-41af-bbda-9677124d43a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:27.206802 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b95754-0096-41af-bbda-9677124d43a4 admin admin] PATH_INFO: `/v3/projects/cc00e3332ff341c2998f195d1fece3a9` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:27.208034 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b95754-0096-41af-bbda-9677124d43a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc00e3332ff341c2998f195d1fece3a9)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:27.210047 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b95754-0096-41af-bbda-9677124d43a4 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:27.267914 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-68b95754-0096-41af-bbda-9677124d43a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc00e3332ff341c2998f195d1fece3a9', 'request_id': 'req-68b95754-0096-41af-bbda-9677124d43a4'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:27.270311 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:27.275349 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-68b95754-0096-41af-bbda-9677124d43a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc00e3332ff341c2998f195d1fece3a9', 'request_id': 'req-68b95754-0096-41af-bbda-9677124d43a4'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:27.280574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e71bb-c225-45d1-9243-5eb72ebb5cb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:27.282894 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e71bb-c225-45d1-9243-5eb72ebb5cb9 service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:27.286626 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-68b95754-0096-41af-bbda-9677124d43a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc00e3332ff341c2998f195d1fece3a9', 'request_id': 'req-68b95754-0096-41af-bbda-9677124d43a4'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:27.293760 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1074/2142] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:35:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:35:27.302309 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-68b95754-0096-41af-bbda-9677124d43a4 admin admin] The token cache is being invalidate because project cc00e3332ff341c2998f195d1fece3a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:35:27.302681 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-68b95754-0096-41af-bbda-9677124d43a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:27.303940 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-68b95754-0096-41af-bbda-9677124d43a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:27.305509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1069/2143] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:35:27 2022] DELETE /identity/v3/projects/cc00e3332ff341c2998f195d1fece3a9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:35:27.312378 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7172e4-fcff-436a-8885-cb8185ed33bf None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:27.312694 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7172e4-fcff-436a-8885-cb8185ed33bf None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:27.312978 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7172e4-fcff-436a-8885-cb8185ed33bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:27.335532 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-0c7172e4-fcff-436a-8885-cb8185ed33bf None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:35:27.336781 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-0c7172e4-fcff-436a-8885-cb8185ed33bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:27.391142 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:27.409453 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1075/2144] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:35:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:35:27.419154 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d3a1a-6e54-4126-b543-690848f296f4 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:27.419855 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d3a1a-6e54-4126-b543-690848f296f4 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:27.420301 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d3a1a-6e54-4126-b543-690848f296f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:27.442993 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-a27d3a1a-6e54-4126-b543-690848f296f4 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:35:27.444348 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-a27d3a1a-6e54-4126-b543-690848f296f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:27.467906 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1070/2145] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:35:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:35:27.471989 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7172e4-fcff-436a-8885-cb8185ed33bf None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:27.495759 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7172e4-fcff-436a-8885-cb8185ed33bf None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:27.519460 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4309b-bd8a-481d-93a9-068b2158ddda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:27.519460 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4309b-bd8a-481d-93a9-068b2158ddda admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:27.519460 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4309b-bd8a-481d-93a9-068b2158ddda admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:27.519460 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4309b-bd8a-481d-93a9-068b2158ddda admin admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:27.519971 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4309b-bd8a-481d-93a9-068b2158ddda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:35:27.519971 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4309b-bd8a-481d-93a9-068b2158ddda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:27.523507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4309b-bd8a-481d-93a9-068b2158ddda admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:27.554272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1076/2146] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:35:27.555591 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d3a1a-6e54-4126-b543-690848f296f4 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:27.568759 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d3a1a-6e54-4126-b543-690848f296f4 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:27.581829 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c37e7-9a74-4a27-a5c4-3565c8af65ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:27.582866 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c37e7-9a74-4a27-a5c4-3565c8af65ee admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:27.583229 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c37e7-9a74-4a27-a5c4-3565c8af65ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:27.583678 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c37e7-9a74-4a27-a5c4-3565c8af65ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:27.584746 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c37e7-9a74-4a27-a5c4-3565c8af65ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:27.599897 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c37e7-9a74-4a27-a5c4-3565c8af65ee admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:27.652131 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1071/2147] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:35:27 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:35:27.653889 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4309b-bd8a-481d-93a9-068b2158ddda admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:27.670138 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4309b-bd8a-481d-93a9-068b2158ddda admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:27.756605 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289021b4-cc91-40bb-b68f-12dcf391d415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:27.757456 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289021b4-cc91-40bb-b68f-12dcf391d415 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:27.757817 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289021b4-cc91-40bb-b68f-12dcf391d415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:27.758530 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289021b4-cc91-40bb-b68f-12dcf391d415 admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:27.759431 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289021b4-cc91-40bb-b68f-12dcf391d415 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:27.761653 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289021b4-cc91-40bb-b68f-12dcf391d415 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:27.797942 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1077/2148] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:35:27 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:35:27.802443 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c37e7-9a74-4a27-a5c4-3565c8af65ee admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:27.820799 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c37e7-9a74-4a27-a5c4-3565c8af65ee admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:27.826489 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b688351-1911-4af5-8db2-341def3fd1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:27.827396 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b688351-1911-4af5-8db2-341def3fd1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:27.828584 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b688351-1911-4af5-8db2-341def3fd1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:27.829235 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b688351-1911-4af5-8db2-341def3fd1e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:27.830278 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b688351-1911-4af5-8db2-341def3fd1e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:27.832303 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b688351-1911-4af5-8db2-341def3fd1e2 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:27.847689 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1072/2149] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:35:27.852350 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289021b4-cc91-40bb-b68f-12dcf391d415 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:27.865447 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289021b4-cc91-40bb-b68f-12dcf391d415 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:27.874872 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acc14e-81db-4d7b-b5ef-ebf420e5c513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:27.876172 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acc14e-81db-4d7b-b5ef-ebf420e5c513 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:27.876172 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acc14e-81db-4d7b-b5ef-ebf420e5c513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:27.876966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acc14e-81db-4d7b-b5ef-ebf420e5c513 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:27.877955 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83acc14e-81db-4d7b-b5ef-ebf420e5c513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:27.879911 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83acc14e-81db-4d7b-b5ef-ebf420e5c513 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:27.893172 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1078/2150] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:35:27.897268 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b688351-1911-4af5-8db2-341def3fd1e2 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:27.910980 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b688351-1911-4af5-8db2-341def3fd1e2 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:27.924182 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de8027-45c0-476a-9ad0-d888c4671b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:27.924974 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de8027-45c0-476a-9ad0-d888c4671b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:27.925833 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de8027-45c0-476a-9ad0-d888c4671b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:27.926170 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de8027-45c0-476a-9ad0-d888c4671b9d admin admin] PATH_INFO: `/v3/projects/0cd7b23f081147cba75844a277ff24f3/users/7f4320aea5034770820eff966a4153fe/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:27.952449 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de8027-45c0-476a-9ad0-d888c4671b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cd7b23f081147cba75844a277ff24f3, user_id=7f4320aea5034770820eff966a4153fe, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:27.957518 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de8027-45c0-476a-9ad0-d888c4671b9d admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:27.977312 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1073/2151] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:35:27 2022] PUT /identity/v3/projects/0cd7b23f081147cba75844a277ff24f3/users/7f4320aea5034770820eff966a4153fe/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:35:27.983321 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd27798-d8bd-45f6-bd1c-e28c3e56f59a None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:27.983607 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd27798-d8bd-45f6-bd1c-e28c3e56f59a None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:27.983948 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd27798-d8bd-45f6-bd1c-e28c3e56f59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:28.018478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-bdd27798-d8bd-45f6-bd1c-e28c3e56f59a None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:35:28.039835 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-bdd27798-d8bd-45f6-bd1c-e28c3e56f59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:28.151922 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1079/2152] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:35:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:35:28.162502 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de8027-45c0-476a-9ad0-d888c4671b9d admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:28.164234 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-45de8027-45c0-476a-9ad0-d888c4671b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:28.229464 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de8027-45c0-476a-9ad0-d888c4671b9d admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:28.233332 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d21b7-e138-4c92-b6e2-a4c02a8531c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:28.234616 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d21b7-e138-4c92-b6e2-a4c02a8531c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:28.234905 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d21b7-e138-4c92-b6e2-a4c02a8531c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:28.235406 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d21b7-e138-4c92-b6e2-a4c02a8531c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:28.246397 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d21b7-e138-4c92-b6e2-a4c02a8531c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:28.248463 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d21b7-e138-4c92-b6e2-a4c02a8531c1 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:28.259394 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1074/2153] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:35:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:35:29.197443 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464848e-de48-4f16-bd1f-05d74145974e None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:29.197948 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464848e-de48-4f16-bd1f-05d74145974e None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:29.198034 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464848e-de48-4f16-bd1f-05d74145974e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:29.232863 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-7464848e-de48-4f16-bd1f-05d74145974e None None] MFA Rules not processed for user `7f4320aea5034770820eff966a4153fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:35:29.235305 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-7464848e-de48-4f16-bd1f-05d74145974e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:29.286192 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:29.309332 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1080/2154] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:35:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:35:29.329718 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d21b7-e138-4c92-b6e2-a4c02a8531c1 service neutron] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:29.332151 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-6e9d21b7-e138-4c92-b6e2-a4c02a8531c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:29.416371 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d21b7-e138-4c92-b6e2-a4c02a8531c1 service neutron] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:29.420715 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77c752-4bcd-4b75-8f11-620357c2dc1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:29.421355 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77c752-4bcd-4b75-8f11-620357c2dc1a service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:29.421645 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77c752-4bcd-4b75-8f11-620357c2dc1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:29.421922 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77c752-4bcd-4b75-8f11-620357c2dc1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:29.432166 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77c752-4bcd-4b75-8f11-620357c2dc1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:29.433874 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77c752-4bcd-4b75-8f11-620357c2dc1a service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:29.462390 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1075/2155] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:35:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:35:31.033339 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd185382-f9ac-49e0-9e8a-00a50485737e None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:31.033902 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd185382-f9ac-49e0-9e8a-00a50485737e None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:31.033902 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd185382-f9ac-49e0-9e8a-00a50485737e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:31.053904 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-bd185382-f9ac-49e0-9e8a-00a50485737e None None] MFA Rules not processed for user `7f4320aea5034770820eff966a4153fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:35:31.055188 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-bd185382-f9ac-49e0-9e8a-00a50485737e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:31.067272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1081/2156] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:35:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:35:36.814815 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87cdf6-71d2-49d8-bbf2-f157c5762bfc None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:36.815277 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87cdf6-71d2-49d8-bbf2-f157c5762bfc None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:36.815582 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87cdf6-71d2-49d8-bbf2-f157c5762bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:36.860197 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-2e87cdf6-71d2-49d8-bbf2-f157c5762bfc None None] MFA Rules not processed for user `66937804f65147f392f4ddfc3e961d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:35:36.863122 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-2e87cdf6-71d2-49d8-bbf2-f157c5762bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:36.933112 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:37.018884 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1076/2157] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Nov 2 20:35:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:35:37.034462 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd185382-f9ac-49e0-9e8a-00a50485737e None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:37.039426 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-bd185382-f9ac-49e0-9e8a-00a50485737e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:37.194989 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd185382-f9ac-49e0-9e8a-00a50485737e None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:37.201263 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acea66b-f3f6-4e37-8c10-a1d7c663b6e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f22f80ac694e9888c132af1e58e292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:37.201932 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acea66b-f3f6-4e37-8c10-a1d7c663b6e8 service swift] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:37.202484 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acea66b-f3f6-4e37-8c10-a1d7c663b6e8 service swift] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:37.202993 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acea66b-f3f6-4e37-8c10-a1d7c663b6e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:37.214492 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acea66b-f3f6-4e37-8c10-a1d7c663b6e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:37.216672 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acea66b-f3f6-4e37-8c10-a1d7c663b6e8 service swift] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:37.228644 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1082/2158] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Nov 2 20:35:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 20:35:40.543779 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87cdf6-71d2-49d8-bbf2-f157c5762bfc None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:40.554326 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87cdf6-71d2-49d8-bbf2-f157c5762bfc None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:40.559570 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5edee8-01ec-412b-a072-098feb9bf6c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:40.560408 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5edee8-01ec-412b-a072-098feb9bf6c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:40.560906 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5edee8-01ec-412b-a072-098feb9bf6c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:40.561183 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5edee8-01ec-412b-a072-098feb9bf6c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:40.565326 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-4a5edee8-01ec-412b-a072-098feb9bf6c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:40.648625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5edee8-01ec-412b-a072-098feb9bf6c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:40.650402 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5edee8-01ec-412b-a072-098feb9bf6c4 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:40.665660 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1077/2159] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:35:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:35:44.273372 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acea66b-f3f6-4e37-8c10-a1d7c663b6e8 service swift] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:44.293791 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acea66b-f3f6-4e37-8c10-a1d7c663b6e8 service swift] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:44.305467 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0e069-2c0f-4a30-b151-68c6a330d2e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:44.308788 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0e069-2c0f-4a30-b151-68c6a330d2e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:44.310537 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0e069-2c0f-4a30-b151-68c6a330d2e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:44.311079 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0e069-2c0f-4a30-b151-68c6a330d2e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:44.318860 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-4dc0e069-2c0f-4a30-b151-68c6a330d2e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:44.360277 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0e069-2c0f-4a30-b151-68c6a330d2e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:44.365169 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0e069-2c0f-4a30-b151-68c6a330d2e1 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:44.401888 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1083/2160] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:35:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:35:45.959046 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582be085-ade6-47c7-8f0b-6a2c64f2ae9b None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:45.959911 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582be085-ade6-47c7-8f0b-6a2c64f2ae9b None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:45.960531 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582be085-ade6-47c7-8f0b-6a2c64f2ae9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:45.993972 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-582be085-ade6-47c7-8f0b-6a2c64f2ae9b None None] MFA Rules not processed for user `13d6d307bd3b436f9f18be0e762038fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:35:45.995198 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-582be085-ade6-47c7-8f0b-6a2c64f2ae9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:46.120014 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1078/2161] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:35:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:35:46.618344 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0e069-2c0f-4a30-b151-68c6a330d2e1 service neutron] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:46.620774 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-4dc0e069-2c0f-4a30-b151-68c6a330d2e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:46.638126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0e069-2c0f-4a30-b151-68c6a330d2e1 service neutron] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:46.648526 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960694b2-c9f6-4690-8ceb-984afedb0bfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:46.649954 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960694b2-c9f6-4690-8ceb-984afedb0bfa service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:46.650474 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960694b2-c9f6-4690-8ceb-984afedb0bfa service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:46.651582 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960694b2-c9f6-4690-8ceb-984afedb0bfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:46.654600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-960694b2-c9f6-4690-8ceb-984afedb0bfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:46.670271 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960694b2-c9f6-4690-8ceb-984afedb0bfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:46.672739 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960694b2-c9f6-4690-8ceb-984afedb0bfa service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:46.688749 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1084/2162] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:35:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:35:47.175101 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582be085-ade6-47c7-8f0b-6a2c64f2ae9b None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:47.178056 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-582be085-ade6-47c7-8f0b-6a2c64f2ae9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:47.432720 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582be085-ade6-47c7-8f0b-6a2c64f2ae9b None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:47.442178 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdbe42-2ca1-4ba9-8701-8425c08a75b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603a9f31ae814003a2cbd02f964f4ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:47.443125 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdbe42-2ca1-4ba9-8701-8425c08a75b1 service placement] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:47.443596 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdbe42-2ca1-4ba9-8701-8425c08a75b1 service placement] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:47.444025 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdbe42-2ca1-4ba9-8701-8425c08a75b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:47.446156 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-96fdbe42-2ca1-4ba9-8701-8425c08a75b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:47.457385 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:47.461957 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdbe42-2ca1-4ba9-8701-8425c08a75b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:47.464399 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdbe42-2ca1-4ba9-8701-8425c08a75b1 service placement] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:47.489228 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1079/2163] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:35:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:35:51.069884 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960694b2-c9f6-4690-8ceb-984afedb0bfa service neutron] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:51.081677 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960694b2-c9f6-4690-8ceb-984afedb0bfa service neutron] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:51.087440 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96ef3b-c2e1-4be9-be2a-bf39cfaccaf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:51.088058 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96ef3b-c2e1-4be9-be2a-bf39cfaccaf5 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:51.088633 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96ef3b-c2e1-4be9-be2a-bf39cfaccaf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:51.089142 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96ef3b-c2e1-4be9-be2a-bf39cfaccaf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:51.091142 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-3b96ef3b-c2e1-4be9-be2a-bf39cfaccaf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:51.105700 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96ef3b-c2e1-4be9-be2a-bf39cfaccaf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:51.107775 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96ef3b-c2e1-4be9-be2a-bf39cfaccaf5 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:51.142515 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1085/2164] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:35:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:35:55.367433 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdbe42-2ca1-4ba9-8701-8425c08a75b1 service placement] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:55.368994 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-96fdbe42-2ca1-4ba9-8701-8425c08a75b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:55.388107 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdbe42-2ca1-4ba9-8701-8425c08a75b1 service placement] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:55.394672 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41bc7c-21b2-4596-b566-3d243994fb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:55.395527 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41bc7c-21b2-4596-b566-3d243994fb96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:55.395797 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41bc7c-21b2-4596-b566-3d243994fb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:55.396133 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41bc7c-21b2-4596-b566-3d243994fb96 admin admin] PATH_INFO: `/v3/users/6147bac8e2104d04b727c1e3bc7fff6c` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:55.397620 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41bc7c-21b2-4596-b566-3d243994fb96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6147bac8e2104d04b727c1e3bc7fff6c)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:55.399769 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41bc7c-21b2-4596-b566-3d243994fb96 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:55.452084 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-ef41bc7c-21b2-4596-b566-3d243994fb96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6147bac8e2104d04b727c1e3bc7fff6c'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:55.453286 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-ef41bc7c-21b2-4596-b566-3d243994fb96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6147bac8e2104d04b727c1e3bc7fff6c'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:55.483735 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-ef41bc7c-21b2-4596-b566-3d243994fb96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6147bac8e2104d04b727c1e3bc7fff6c'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:55.485449 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-ef41bc7c-21b2-4596-b566-3d243994fb96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6147bac8e2104d04b727c1e3bc7fff6c'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:55.498618 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-ef41bc7c-21b2-4596-b566-3d243994fb96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6147bac8e2104d04b727c1e3bc7fff6c'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:55.524591 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1080/2165] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:35:55 2022] DELETE /identity/v3/users/6147bac8e2104d04b727c1e3bc7fff6c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:35:55.803162 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96ef3b-c2e1-4be9-be2a-bf39cfaccaf5 service neutron] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:55.825426 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96ef3b-c2e1-4be9-be2a-bf39cfaccaf5 service neutron] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:55.889122 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d6938-a3fd-41a1-9d82-455e8526b330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:55.889760 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d6938-a3fd-41a1-9d82-455e8526b330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:55.890042 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d6938-a3fd-41a1-9d82-455e8526b330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:55.890352 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d6938-a3fd-41a1-9d82-455e8526b330 admin admin] PATH_INFO: `/v3/projects/215e8300c2554f64b835b48c0d22c4d5` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:55.891465 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d6938-a3fd-41a1-9d82-455e8526b330 admin admin] RBAC: Authorizing `identity:delete_project(project_id=215e8300c2554f64b835b48c0d22c4d5)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:55.893407 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d6938-a3fd-41a1-9d82-455e8526b330 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:55.934421 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:55.949151 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-9a5d6938-a3fd-41a1-9d82-455e8526b330 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '215e8300c2554f64b835b48c0d22c4d5', 'request_id': 'req-9a5d6938-a3fd-41a1-9d82-455e8526b330'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:55.963965 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-9a5d6938-a3fd-41a1-9d82-455e8526b330 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '215e8300c2554f64b835b48c0d22c4d5', 'request_id': 'req-9a5d6938-a3fd-41a1-9d82-455e8526b330'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:55.975805 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-9a5d6938-a3fd-41a1-9d82-455e8526b330 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '215e8300c2554f64b835b48c0d22c4d5', 'request_id': 'req-9a5d6938-a3fd-41a1-9d82-455e8526b330'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:55.990199 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-9a5d6938-a3fd-41a1-9d82-455e8526b330 admin admin] The token cache is being invalidate because project 215e8300c2554f64b835b48c0d22c4d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:35:55.990579 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-9a5d6938-a3fd-41a1-9d82-455e8526b330 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:55.991321 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-9a5d6938-a3fd-41a1-9d82-455e8526b330 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:35:55.993630 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1086/2166] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:35:55 2022] DELETE /identity/v3/projects/215e8300c2554f64b835b48c0d22c4d5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:35:55.998918 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fbfb1-50ee-4652-95ef-ffe5b692695c None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:55.999575 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fbfb1-50ee-4652-95ef-ffe5b692695c None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:56.000123 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fbfb1-50ee-4652-95ef-ffe5b692695c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:56.022814 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-751fbfb1-50ee-4652-95ef-ffe5b692695c None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:35:56.024072 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-751fbfb1-50ee-4652-95ef-ffe5b692695c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:56.097698 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1081/2167] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:35:56.105985 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa15964-d817-4b3f-a9f4-bfb55a07d4c7 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:56.106276 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa15964-d817-4b3f-a9f4-bfb55a07d4c7 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:56.106547 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa15964-d817-4b3f-a9f4-bfb55a07d4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:56.126389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-4aa15964-d817-4b3f-a9f4-bfb55a07d4c7 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:35:56.127578 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-4aa15964-d817-4b3f-a9f4-bfb55a07d4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:56.135379 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1087/2168] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:35:56.139926 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fbfb1-50ee-4652-95ef-ffe5b692695c None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:56.150693 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fbfb1-50ee-4652-95ef-ffe5b692695c None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:56.155370 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07258d-e6e8-4fb0-9151-6e7d92c16325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:56.156001 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07258d-e6e8-4fb0-9151-6e7d92c16325 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:56.156283 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07258d-e6e8-4fb0-9151-6e7d92c16325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:56.156582 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07258d-e6e8-4fb0-9151-6e7d92c16325 admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:56.157261 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07258d-e6e8-4fb0-9151-6e7d92c16325 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:35:56.157568 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07258d-e6e8-4fb0-9151-6e7d92c16325 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:56.159168 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07258d-e6e8-4fb0-9151-6e7d92c16325 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:56.170790 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1082/2169] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:35:56.175516 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa15964-d817-4b3f-a9f4-bfb55a07d4c7 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:56.184954 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa15964-d817-4b3f-a9f4-bfb55a07d4c7 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:56.190281 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b15a6-a076-4722-af37-3ada6a0cb194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:56.190885 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b15a6-a076-4722-af37-3ada6a0cb194 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:56.191166 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b15a6-a076-4722-af37-3ada6a0cb194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:56.191440 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b15a6-a076-4722-af37-3ada6a0cb194 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:56.192072 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b15a6-a076-4722-af37-3ada6a0cb194 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:56.194005 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b15a6-a076-4722-af37-3ada6a0cb194 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:56.226214 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1088/2170] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:35:56 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:35:56.230787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07258d-e6e8-4fb0-9151-6e7d92c16325 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:56.244795 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07258d-e6e8-4fb0-9151-6e7d92c16325 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:56.297596 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:35:56.305897 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413ebbf-3581-40ae-8816-3186351cedaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:56.306696 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413ebbf-3581-40ae-8816-3186351cedaf admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:56.307224 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413ebbf-3581-40ae-8816-3186351cedaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:56.307674 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413ebbf-3581-40ae-8816-3186351cedaf admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:56.308441 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413ebbf-3581-40ae-8816-3186351cedaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:56.310579 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413ebbf-3581-40ae-8816-3186351cedaf admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:56.337129 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1083/2171] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:35:56 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:35:56.338301 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b15a6-a076-4722-af37-3ada6a0cb194 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:56.349173 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b15a6-a076-4722-af37-3ada6a0cb194 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:56.354143 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4be9b8-f544-4d5e-a394-b070fbd3efe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:56.354750 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4be9b8-f544-4d5e-a394-b070fbd3efe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:56.355061 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4be9b8-f544-4d5e-a394-b070fbd3efe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:56.355341 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4be9b8-f544-4d5e-a394-b070fbd3efe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:56.356000 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4be9b8-f544-4d5e-a394-b070fbd3efe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:56.357668 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4be9b8-f544-4d5e-a394-b070fbd3efe7 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:56.370062 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1089/2172] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:35:56.373900 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413ebbf-3581-40ae-8816-3186351cedaf admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:56.384617 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413ebbf-3581-40ae-8816-3186351cedaf admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:56.389326 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1feaa-8b40-4985-b085-517cf158f721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:56.389967 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1feaa-8b40-4985-b085-517cf158f721 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:56.390223 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1feaa-8b40-4985-b085-517cf158f721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:56.390510 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1feaa-8b40-4985-b085-517cf158f721 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:56.391274 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea1feaa-8b40-4985-b085-517cf158f721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:56.393193 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea1feaa-8b40-4985-b085-517cf158f721 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:56.405128 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1084/2173] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:35:56.409569 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4be9b8-f544-4d5e-a394-b070fbd3efe7 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:56.420789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4be9b8-f544-4d5e-a394-b070fbd3efe7 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:56.426973 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8571e7-06f5-4857-8412-440f3870d066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:56.427641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8571e7-06f5-4857-8412-440f3870d066 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:56.427962 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8571e7-06f5-4857-8412-440f3870d066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:56.428247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8571e7-06f5-4857-8412-440f3870d066 admin admin] PATH_INFO: `/v3/projects/24a0e467e01a497389a8bd8024b79a1d/users/48c3b5cfa44f44798f302bf286f9f65f/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:56.446600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8571e7-06f5-4857-8412-440f3870d066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24a0e467e01a497389a8bd8024b79a1d, user_id=48c3b5cfa44f44798f302bf286f9f65f, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:56.450411 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8571e7-06f5-4857-8412-440f3870d066 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:56.466069 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1090/2174] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:35:56 2022] PUT /identity/v3/projects/24a0e467e01a497389a8bd8024b79a1d/users/48c3b5cfa44f44798f302bf286f9f65f/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:35:56.477590 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c2a59-c51d-4f67-a9de-225de11baaf2 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:56.477808 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c2a59-c51d-4f67-a9de-225de11baaf2 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:56.478080 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c2a59-c51d-4f67-a9de-225de11baaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:56.507633 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-277c2a59-c51d-4f67-a9de-225de11baaf2 None None] MFA Rules not processed for user `48c3b5cfa44f44798f302bf286f9f65f`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:35:56.508952 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-277c2a59-c51d-4f67-a9de-225de11baaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:56.591771 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1085/2175] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:35:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:35:56.603191 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8571e7-06f5-4857-8412-440f3870d066 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:35:56.604923 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-8f8571e7-06f5-4857-8412-440f3870d066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:35:56.685227 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8571e7-06f5-4857-8412-440f3870d066 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:35:56.691324 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f924e-93ec-4714-84c5-a7c808b4b80c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:35:56.691939 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f924e-93ec-4714-84c5-a7c808b4b80c service nova] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:35:56.692222 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f924e-93ec-4714-84c5-a7c808b4b80c service nova] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:35:56.692500 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f924e-93ec-4714-84c5-a7c808b4b80c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:35:56.703308 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f924e-93ec-4714-84c5-a7c808b4b80c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:35:56.704978 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f924e-93ec-4714-84c5-a7c808b4b80c service nova] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:35:56.714602 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1091/2176] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:35:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:36:00.573166 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521a380-4259-4af4-bac3-f5de6113f3b1 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:00.573607 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521a380-4259-4af4-bac3-f5de6113f3b1 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:00.573871 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521a380-4259-4af4-bac3-f5de6113f3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:00.595803 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-e521a380-4259-4af4-bac3-f5de6113f3b1 None None] MFA Rules not processed for user `66937804f65147f392f4ddfc3e961d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:36:00.597069 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-e521a380-4259-4af4-bac3-f5de6113f3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:00.657602 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1086/2177] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Nov 2 20:36:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:36:00.669408 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f924e-93ec-4714-84c5-a7c808b4b80c service nova] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:00.671043 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-cd6f924e-93ec-4714-84c5-a7c808b4b80c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:00.719720 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:00.753594 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f924e-93ec-4714-84c5-a7c808b4b80c service nova] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:00.759078 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9a584-c1c8-4d49-a6a2-20e26e8b947d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f22f80ac694e9888c132af1e58e292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:00.759778 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9a584-c1c8-4d49-a6a2-20e26e8b947d service swift] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:00.760066 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9a584-c1c8-4d49-a6a2-20e26e8b947d service swift] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:00.760345 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9a584-c1c8-4d49-a6a2-20e26e8b947d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:00.770066 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9a584-c1c8-4d49-a6a2-20e26e8b947d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:00.771584 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9a584-c1c8-4d49-a6a2-20e26e8b947d service swift] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:00.779943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1092/2178] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Nov 2 20:36:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 20:36:02.295535 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521a380-4259-4af4-bac3-f5de6113f3b1 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:02.375535 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521a380-4259-4af4-bac3-f5de6113f3b1 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:02.380573 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5a55b-d43f-4c06-9e59-2fce357d55f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:02.381322 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5a55b-d43f-4c06-9e59-2fce357d55f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:02.381671 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5a55b-d43f-4c06-9e59-2fce357d55f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:02.382015 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5a55b-d43f-4c06-9e59-2fce357d55f2 admin admin] PATH_INFO: `/v3/users/48c3b5cfa44f44798f302bf286f9f65f` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:02.383230 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5a55b-d43f-4c06-9e59-2fce357d55f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48c3b5cfa44f44798f302bf286f9f65f)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:02.385425 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5a55b-d43f-4c06-9e59-2fce357d55f2 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:02.405672 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:02.436302 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9a584-c1c8-4d49-a6a2-20e26e8b947d service swift] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:02.439823 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-ebb9a584-c1c8-4d49-a6a2-20e26e8b947d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:02.472656 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9a584-c1c8-4d49-a6a2-20e26e8b947d service swift] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:02.475519 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-dfc5a55b-d43f-4c06-9e59-2fce357d55f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48c3b5cfa44f44798f302bf286f9f65f'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:02.476405 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-dfc5a55b-d43f-4c06-9e59-2fce357d55f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48c3b5cfa44f44798f302bf286f9f65f'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:02.483626 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5f93b-9c34-43de-932e-c52d1605acb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:02.486060 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5f93b-9c34-43de-932e-c52d1605acb2 service nova] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:02.487257 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5f93b-9c34-43de-932e-c52d1605acb2 service nova] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:02.487618 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5f93b-9c34-43de-932e-c52d1605acb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:02.493995 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-a6c5f93b-9c34-43de-932e-c52d1605acb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:02.513257 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-dfc5a55b-d43f-4c06-9e59-2fce357d55f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48c3b5cfa44f44798f302bf286f9f65f'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:02.514052 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-dfc5a55b-d43f-4c06-9e59-2fce357d55f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48c3b5cfa44f44798f302bf286f9f65f'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:02.522783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c5f93b-9c34-43de-932e-c52d1605acb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:02.524728 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c5f93b-9c34-43de-932e-c52d1605acb2 service nova] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:02.547967 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1093/2179] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:36:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:36:02.548734 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-dfc5a55b-d43f-4c06-9e59-2fce357d55f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48c3b5cfa44f44798f302bf286f9f65f'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:02.569671 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1087/2180] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:36:02 2022] DELETE /identity/v3/users/48c3b5cfa44f44798f302bf286f9f65f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:36:02.574219 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b14b23-bfaa-4653-898a-b2ba1111af43 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:02.574712 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b14b23-bfaa-4653-898a-b2ba1111af43 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:02.575386 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b14b23-bfaa-4653-898a-b2ba1111af43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:02.600608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-00b14b23-bfaa-4653-898a-b2ba1111af43 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:36:02.602226 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-00b14b23-bfaa-4653-898a-b2ba1111af43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:02.705310 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1094/2181] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:36:02.715472 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5a55b-d43f-4c06-9e59-2fce357d55f2 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:02.717845 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-dfc5a55b-d43f-4c06-9e59-2fce357d55f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:02.814371 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5a55b-d43f-4c06-9e59-2fce357d55f2 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:02.820486 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a721b-f372-401a-821d-ef01fd8b83ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:02.821435 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a721b-f372-401a-821d-ef01fd8b83ef service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:02.821839 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a721b-f372-401a-821d-ef01fd8b83ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:02.822370 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a721b-f372-401a-821d-ef01fd8b83ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:02.854011 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a721b-f372-401a-821d-ef01fd8b83ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:02.857020 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a721b-f372-401a-821d-ef01fd8b83ef service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:02.871650 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1088/2182] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:36:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:36:03.183021 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b14b23-bfaa-4653-898a-b2ba1111af43 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:03.184804 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-00b14b23-bfaa-4653-898a-b2ba1111af43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:03.207867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b14b23-bfaa-4653-898a-b2ba1111af43 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:03.217176 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0df85-14b6-4b50-8820-382adb9ebd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:03.218235 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0df85-14b6-4b50-8820-382adb9ebd11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:03.219171 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0df85-14b6-4b50-8820-382adb9ebd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:03.219545 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0df85-14b6-4b50-8820-382adb9ebd11 admin admin] PATH_INFO: `/v3/projects/24a0e467e01a497389a8bd8024b79a1d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:03.220884 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0df85-14b6-4b50-8820-382adb9ebd11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24a0e467e01a497389a8bd8024b79a1d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:03.223582 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0df85-14b6-4b50-8820-382adb9ebd11 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:03.282477 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-22e0df85-14b6-4b50-8820-382adb9ebd11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24a0e467e01a497389a8bd8024b79a1d', 'request_id': 'req-22e0df85-14b6-4b50-8820-382adb9ebd11'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:03.291624 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-22e0df85-14b6-4b50-8820-382adb9ebd11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24a0e467e01a497389a8bd8024b79a1d', 'request_id': 'req-22e0df85-14b6-4b50-8820-382adb9ebd11'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:03.301030 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-22e0df85-14b6-4b50-8820-382adb9ebd11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24a0e467e01a497389a8bd8024b79a1d', 'request_id': 'req-22e0df85-14b6-4b50-8820-382adb9ebd11'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:03.328513 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-22e0df85-14b6-4b50-8820-382adb9ebd11 admin admin] The token cache is being invalidate because project 24a0e467e01a497389a8bd8024b79a1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:36:03.329056 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-22e0df85-14b6-4b50-8820-382adb9ebd11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:03.329896 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-22e0df85-14b6-4b50-8820-382adb9ebd11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:03.334794 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1095/2183] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:36:03 2022] DELETE /identity/v3/projects/24a0e467e01a497389a8bd8024b79a1d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:36:03.337059 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27b072-929e-452c-8dc5-f3925be9b2be None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:03.337521 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27b072-929e-452c-8dc5-f3925be9b2be None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:03.337861 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27b072-929e-452c-8dc5-f3925be9b2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:03.369597 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-8c27b072-929e-452c-8dc5-f3925be9b2be None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:36:03.372845 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-8c27b072-929e-452c-8dc5-f3925be9b2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:03.461267 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1089/2184] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:36:03.469143 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd285862-6667-4db9-b9b0-4d595f43962b None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:03.469675 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd285862-6667-4db9-b9b0-4d595f43962b None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:03.469902 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd285862-6667-4db9-b9b0-4d595f43962b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:03.497639 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-bd285862-6667-4db9-b9b0-4d595f43962b None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:36:03.498996 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-bd285862-6667-4db9-b9b0-4d595f43962b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:03.511346 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1096/2185] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:36:03.516438 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27b072-929e-452c-8dc5-f3925be9b2be None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:03.532601 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27b072-929e-452c-8dc5-f3925be9b2be None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:03.537550 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1daef-ad8a-4ce9-8906-59d4c36e6051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:03.538197 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1daef-ad8a-4ce9-8906-59d4c36e6051 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:03.538471 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1daef-ad8a-4ce9-8906-59d4c36e6051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:03.538749 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1daef-ad8a-4ce9-8906-59d4c36e6051 admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:03.539415 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1daef-ad8a-4ce9-8906-59d4c36e6051 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:36:03.539724 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1daef-ad8a-4ce9-8906-59d4c36e6051 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:03.541488 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1daef-ad8a-4ce9-8906-59d4c36e6051 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:03.555728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1090/2186] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:36:03.559796 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd285862-6667-4db9-b9b0-4d595f43962b None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:03.570005 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd285862-6667-4db9-b9b0-4d595f43962b None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:03.575087 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdbbef-b919-4a2a-8576-7bb3d6bbd14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:03.575701 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdbbef-b919-4a2a-8576-7bb3d6bbd14e admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:03.575981 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdbbef-b919-4a2a-8576-7bb3d6bbd14e admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:03.576257 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdbbef-b919-4a2a-8576-7bb3d6bbd14e admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:03.576956 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bdbbef-b919-4a2a-8576-7bb3d6bbd14e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:03.579580 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bdbbef-b919-4a2a-8576-7bb3d6bbd14e admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:03.620984 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1097/2187] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:36:03 2022] POST /identity/v3/projects => generated 365 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:36:03.625366 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1daef-ad8a-4ce9-8906-59d4c36e6051 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:03.643886 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1daef-ad8a-4ce9-8906-59d4c36e6051 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:03.658736 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:03.726520 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be173a9-1613-44c7-b0f1-48f797bbc5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:03.727298 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be173a9-1613-44c7-b0f1-48f797bbc5d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:03.727697 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be173a9-1613-44c7-b0f1-48f797bbc5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:03.728074 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be173a9-1613-44c7-b0f1-48f797bbc5d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:03.728866 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be173a9-1613-44c7-b0f1-48f797bbc5d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:03.731240 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be173a9-1613-44c7-b0f1-48f797bbc5d9 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:03.767336 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1091/2188] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:36:03 2022] POST /identity/v3/users => generated 283 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:36:03.771543 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdbbef-b919-4a2a-8576-7bb3d6bbd14e admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:03.784797 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdbbef-b919-4a2a-8576-7bb3d6bbd14e admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:03.801118 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161351cc-ae17-4d27-834d-f917bdc48a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:03.801779 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161351cc-ae17-4d27-834d-f917bdc48a88 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:03.802065 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161351cc-ae17-4d27-834d-f917bdc48a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:03.802344 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161351cc-ae17-4d27-834d-f917bdc48a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:03.803014 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161351cc-ae17-4d27-834d-f917bdc48a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:03.804641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161351cc-ae17-4d27-834d-f917bdc48a88 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:03.810632 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:03.820598 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1098/2189] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:36:03.821553 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be173a9-1613-44c7-b0f1-48f797bbc5d9 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:03.834808 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be173a9-1613-44c7-b0f1-48f797bbc5d9 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:03.841631 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a248ba-85eb-461c-aa4b-fff4713212a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:03.842312 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a248ba-85eb-461c-aa4b-fff4713212a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:03.842681 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a248ba-85eb-461c-aa4b-fff4713212a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:03.843232 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a248ba-85eb-461c-aa4b-fff4713212a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:03.843937 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a248ba-85eb-461c-aa4b-fff4713212a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:03.847128 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a248ba-85eb-461c-aa4b-fff4713212a5 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:03.864458 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1092/2190] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:36:03.868389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161351cc-ae17-4d27-834d-f917bdc48a88 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:03.880327 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161351cc-ae17-4d27-834d-f917bdc48a88 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:03.889636 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bac7ce-dab9-44e3-8583-a1ff86dbd147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:03.896828 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bac7ce-dab9-44e3-8583-a1ff86dbd147 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:03.897427 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bac7ce-dab9-44e3-8583-a1ff86dbd147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:03.897954 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bac7ce-dab9-44e3-8583-a1ff86dbd147 admin admin] PATH_INFO: `/v3/projects/8e666799e6a3467bbcc5c7a0a8833209/users/2633f7ccff774e7a819519b2cb731924/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:03.919885 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bac7ce-dab9-44e3-8583-a1ff86dbd147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e666799e6a3467bbcc5c7a0a8833209, user_id=2633f7ccff774e7a819519b2cb731924, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:03.935693 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bac7ce-dab9-44e3-8583-a1ff86dbd147 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:03.957861 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1099/2191] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:36:03 2022] PUT /identity/v3/projects/8e666799e6a3467bbcc5c7a0a8833209/users/2633f7ccff774e7a819519b2cb731924/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:36:03.974464 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f374a-31c4-44e0-bb8d-95c01fe7ba92 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:03.974814 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f374a-31c4-44e0-bb8d-95c01fe7ba92 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:03.975023 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f374a-31c4-44e0-bb8d-95c01fe7ba92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:04.007304 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-181f374a-31c4-44e0-bb8d-95c01fe7ba92 None None] MFA Rules not processed for user `2633f7ccff774e7a819519b2cb731924`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:36:04.009332 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-181f374a-31c4-44e0-bb8d-95c01fe7ba92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:04.101624 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1093/2192] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:36:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:36:04.108692 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bac7ce-dab9-44e3-8583-a1ff86dbd147 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:04.172867 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bac7ce-dab9-44e3-8583-a1ff86dbd147 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:04.177493 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460969d7-f3f6-483a-b1b1-74130769f8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:04.178102 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460969d7-f3f6-483a-b1b1-74130769f8f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:04.178388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460969d7-f3f6-483a-b1b1-74130769f8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:04.178670 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460969d7-f3f6-483a-b1b1-74130769f8f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:04.179298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460969d7-f3f6-483a-b1b1-74130769f8f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:04.181239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460969d7-f3f6-483a-b1b1-74130769f8f3 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:04.208662 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1100/2193] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:36:04 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:36:04.212622 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f374a-31c4-44e0-bb8d-95c01fe7ba92 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:04.225129 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f374a-31c4-44e0-bb8d-95c01fe7ba92 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:04.285804 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ddbb8-2ff1-4232-a714-b6b3a4b51e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:04.286421 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ddbb8-2ff1-4232-a714-b6b3a4b51e69 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:04.286709 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ddbb8-2ff1-4232-a714-b6b3a4b51e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:04.286989 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ddbb8-2ff1-4232-a714-b6b3a4b51e69 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:04.287635 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ddbb8-2ff1-4232-a714-b6b3a4b51e69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:04.289604 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ddbb8-2ff1-4232-a714-b6b3a4b51e69 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:04.313104 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1094/2194] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:36:04 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:36:04.317369 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460969d7-f3f6-483a-b1b1-74130769f8f3 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:04.329510 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460969d7-f3f6-483a-b1b1-74130769f8f3 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:04.335595 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da996c67-c940-4835-aa55-69501d34eb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:04.336218 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da996c67-c940-4835-aa55-69501d34eb92 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:04.336500 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da996c67-c940-4835-aa55-69501d34eb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:04.336832 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da996c67-c940-4835-aa55-69501d34eb92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:04.337578 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da996c67-c940-4835-aa55-69501d34eb92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:04.339197 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da996c67-c940-4835-aa55-69501d34eb92 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:04.351426 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1101/2195] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:36:04.356025 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ddbb8-2ff1-4232-a714-b6b3a4b51e69 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:04.368568 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ddbb8-2ff1-4232-a714-b6b3a4b51e69 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:04.373959 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791f236-9452-4ada-8bd4-e6a17078c867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:04.374894 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791f236-9452-4ada-8bd4-e6a17078c867 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:04.375189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791f236-9452-4ada-8bd4-e6a17078c867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:04.375602 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791f236-9452-4ada-8bd4-e6a17078c867 admin admin] PATH_INFO: `/v3/projects/5505429d2e80421faf8db090b12ec843/users/29a85e42b5234766a7aee6aa4a090264/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:04.402998 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:04.408187 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8791f236-9452-4ada-8bd4-e6a17078c867 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5505429d2e80421faf8db090b12ec843, user_id=29a85e42b5234766a7aee6aa4a090264, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:04.411224 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8791f236-9452-4ada-8bd4-e6a17078c867 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:04.427857 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1095/2196] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:36:04 2022] PUT /identity/v3/projects/5505429d2e80421faf8db090b12ec843/users/29a85e42b5234766a7aee6aa4a090264/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:36:04.432089 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da996c67-c940-4835-aa55-69501d34eb92 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:04.444337 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da996c67-c940-4835-aa55-69501d34eb92 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:04.507958 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38bd596-560d-4296-894c-448c38957b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:04.508634 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bd596-560d-4296-894c-448c38957b00 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:04.508844 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bd596-560d-4296-894c-448c38957b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:04.509125 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bd596-560d-4296-894c-448c38957b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:04.509784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38bd596-560d-4296-894c-448c38957b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:04.511382 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38bd596-560d-4296-894c-448c38957b00 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:04.522707 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1102/2197] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:36:04.527175 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791f236-9452-4ada-8bd4-e6a17078c867 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:04.538436 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791f236-9452-4ada-8bd4-e6a17078c867 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:04.543257 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c0fd9-d15f-42fe-864f-fad9dff89210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:04.543927 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c0fd9-d15f-42fe-864f-fad9dff89210 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:04.544212 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c0fd9-d15f-42fe-864f-fad9dff89210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:04.544481 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c0fd9-d15f-42fe-864f-fad9dff89210 admin admin] PATH_INFO: `/v3/projects/5505429d2e80421faf8db090b12ec843/users/29a85e42b5234766a7aee6aa4a090264/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:04.546436 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c0fd9-d15f-42fe-864f-fad9dff89210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5505429d2e80421faf8db090b12ec843, user_id=29a85e42b5234766a7aee6aa4a090264, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:04.549179 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c0fd9-d15f-42fe-864f-fad9dff89210 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:04.560901 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1096/2198] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:36:04 2022] PUT /identity/v3/projects/5505429d2e80421faf8db090b12ec843/users/29a85e42b5234766a7aee6aa4a090264/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:36:04.572799 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79af7f0-6b10-4088-8e15-db5ad479fc42 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:04.573084 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79af7f0-6b10-4088-8e15-db5ad479fc42 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:04.573360 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79af7f0-6b10-4088-8e15-db5ad479fc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:04.603108 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-a79af7f0-6b10-4088-8e15-db5ad479fc42 None None] MFA Rules not processed for user `29a85e42b5234766a7aee6aa4a090264`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:36:04.604381 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-a79af7f0-6b10-4088-8e15-db5ad479fc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:04.642852 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:04.684159 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1103/2199] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:36:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:36:04.695338 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c0fd9-d15f-42fe-864f-fad9dff89210 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:04.697231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-0b6c0fd9-d15f-42fe-864f-fad9dff89210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:04.769261 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c0fd9-d15f-42fe-864f-fad9dff89210 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:04.772920 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075ea08-f004-4816-83e3-9b1b82299a96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:04.773534 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075ea08-f004-4816-83e3-9b1b82299a96 service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:04.773827 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075ea08-f004-4816-83e3-9b1b82299a96 service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:04.774090 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075ea08-f004-4816-83e3-9b1b82299a96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:04.783802 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075ea08-f004-4816-83e3-9b1b82299a96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:04.785270 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075ea08-f004-4816-83e3-9b1b82299a96 service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:04.795282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1097/2200] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:36:04 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:36:05.313206 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79af7f0-6b10-4088-8e15-db5ad479fc42 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:05.388416 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79af7f0-6b10-4088-8e15-db5ad479fc42 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:05.393382 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b40d7-3717-4a83-8327-b70455cfad2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:05.394047 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b40d7-3717-4a83-8327-b70455cfad2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:05.394336 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b40d7-3717-4a83-8327-b70455cfad2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:05.394620 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b40d7-3717-4a83-8327-b70455cfad2f admin admin] PATH_INFO: `/v3/users/2633f7ccff774e7a819519b2cb731924` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:05.395784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b40d7-3717-4a83-8327-b70455cfad2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2633f7ccff774e7a819519b2cb731924)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:05.397761 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b40d7-3717-4a83-8327-b70455cfad2f admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:05.450981 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-ff7b40d7-3717-4a83-8327-b70455cfad2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2633f7ccff774e7a819519b2cb731924'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:05.451718 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-ff7b40d7-3717-4a83-8327-b70455cfad2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2633f7ccff774e7a819519b2cb731924'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:05.459434 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-ff7b40d7-3717-4a83-8327-b70455cfad2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2633f7ccff774e7a819519b2cb731924'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:05.460136 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-ff7b40d7-3717-4a83-8327-b70455cfad2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2633f7ccff774e7a819519b2cb731924'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:05.473643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-ff7b40d7-3717-4a83-8327-b70455cfad2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2633f7ccff774e7a819519b2cb731924'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:05.491723 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1104/2201] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:36:05 2022] DELETE /identity/v3/users/2633f7ccff774e7a819519b2cb731924 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:36:05.496248 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534d5b2-4f6b-4493-b816-1d839f63e788 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:05.496843 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534d5b2-4f6b-4493-b816-1d839f63e788 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:05.497112 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534d5b2-4f6b-4493-b816-1d839f63e788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:05.517021 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-9534d5b2-4f6b-4493-b816-1d839f63e788 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:36:05.518425 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-9534d5b2-4f6b-4493-b816-1d839f63e788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:05.603937 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1098/2202] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:36:05.611207 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b40d7-3717-4a83-8327-b70455cfad2f admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:05.612639 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-ff7b40d7-3717-4a83-8327-b70455cfad2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:05.676115 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b40d7-3717-4a83-8327-b70455cfad2f admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:05.680018 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90a135-a236-4d8b-b4a2-e3befb740f17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:05.680742 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90a135-a236-4d8b-b4a2-e3befb740f17 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:05.681104 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90a135-a236-4d8b-b4a2-e3befb740f17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:05.681585 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90a135-a236-4d8b-b4a2-e3befb740f17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:05.688106 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:05.693701 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b90a135-a236-4d8b-b4a2-e3befb740f17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:05.699775 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b90a135-a236-4d8b-b4a2-e3befb740f17 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:05.713923 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1105/2203] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:36:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 20:36:06.000921 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534d5b2-4f6b-4493-b816-1d839f63e788 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:06.002467 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-9534d5b2-4f6b-4493-b816-1d839f63e788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:06.019119 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534d5b2-4f6b-4493-b816-1d839f63e788 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:06.024957 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16d940-54f2-4852-9ffe-02de4b17683b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:06.025601 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16d940-54f2-4852-9ffe-02de4b17683b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:06.025881 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16d940-54f2-4852-9ffe-02de4b17683b admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:06.030239 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16d940-54f2-4852-9ffe-02de4b17683b admin admin] PATH_INFO: `/v3/projects/8e666799e6a3467bbcc5c7a0a8833209` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:06.030239 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16d940-54f2-4852-9ffe-02de4b17683b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e666799e6a3467bbcc5c7a0a8833209)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:06.030471 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16d940-54f2-4852-9ffe-02de4b17683b admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:06.096342 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-3c16d940-54f2-4852-9ffe-02de4b17683b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e666799e6a3467bbcc5c7a0a8833209', 'request_id': 'req-3c16d940-54f2-4852-9ffe-02de4b17683b'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:06.102748 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-3c16d940-54f2-4852-9ffe-02de4b17683b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e666799e6a3467bbcc5c7a0a8833209', 'request_id': 'req-3c16d940-54f2-4852-9ffe-02de4b17683b'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:06.109447 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-3c16d940-54f2-4852-9ffe-02de4b17683b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e666799e6a3467bbcc5c7a0a8833209', 'request_id': 'req-3c16d940-54f2-4852-9ffe-02de4b17683b'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:06.130459 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-3c16d940-54f2-4852-9ffe-02de4b17683b admin admin] The token cache is being invalidate because project 8e666799e6a3467bbcc5c7a0a8833209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:36:06.130728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-3c16d940-54f2-4852-9ffe-02de4b17683b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:06.131384 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-3c16d940-54f2-4852-9ffe-02de4b17683b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:06.133322 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1099/2204] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:36:05 2022] DELETE /identity/v3/projects/8e666799e6a3467bbcc5c7a0a8833209 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:36:06.137581 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90a135-a236-4d8b-b4a2-e3befb740f17 service neutron] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:06.148629 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90a135-a236-4d8b-b4a2-e3befb740f17 service neutron] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:06.208089 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b19c8a-628d-4067-9156-95819735b538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:06.208768 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b19c8a-628d-4067-9156-95819735b538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:06.209054 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b19c8a-628d-4067-9156-95819735b538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:06.209332 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b19c8a-628d-4067-9156-95819735b538 admin admin] PATH_INFO: `/v3/users/29a85e42b5234766a7aee6aa4a090264` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:06.210463 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b19c8a-628d-4067-9156-95819735b538 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29a85e42b5234766a7aee6aa4a090264)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:06.212382 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b19c8a-628d-4067-9156-95819735b538 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:06.261736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-18b19c8a-628d-4067-9156-95819735b538 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29a85e42b5234766a7aee6aa4a090264'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:06.262444 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-18b19c8a-628d-4067-9156-95819735b538 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29a85e42b5234766a7aee6aa4a090264'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:06.270881 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-18b19c8a-628d-4067-9156-95819735b538 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29a85e42b5234766a7aee6aa4a090264'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:06.271707 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-18b19c8a-628d-4067-9156-95819735b538 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29a85e42b5234766a7aee6aa4a090264'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:06.285296 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-18b19c8a-628d-4067-9156-95819735b538 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29a85e42b5234766a7aee6aa4a090264'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:06.299170 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1106/2205] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:36:06 2022] DELETE /identity/v3/users/29a85e42b5234766a7aee6aa4a090264 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:36:06.691810 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16d940-54f2-4852-9ffe-02de4b17683b admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:06.693415 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-3c16d940-54f2-4852-9ffe-02de4b17683b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:06.702620 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:06.707028 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16d940-54f2-4852-9ffe-02de4b17683b admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:06.780320 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f15d5-76cc-4ffe-a1c0-1d48676d17ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:06.781573 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f15d5-76cc-4ffe-a1c0-1d48676d17ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:06.781863 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f15d5-76cc-4ffe-a1c0-1d48676d17ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:06.782141 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f15d5-76cc-4ffe-a1c0-1d48676d17ef admin admin] PATH_INFO: `/v3/projects/5505429d2e80421faf8db090b12ec843` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:06.783411 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f15d5-76cc-4ffe-a1c0-1d48676d17ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=5505429d2e80421faf8db090b12ec843)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:06.785352 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f15d5-76cc-4ffe-a1c0-1d48676d17ef admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:06.840981 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-fc5f15d5-76cc-4ffe-a1c0-1d48676d17ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5505429d2e80421faf8db090b12ec843', 'request_id': 'req-fc5f15d5-76cc-4ffe-a1c0-1d48676d17ef'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:06.848209 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-fc5f15d5-76cc-4ffe-a1c0-1d48676d17ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5505429d2e80421faf8db090b12ec843', 'request_id': 'req-fc5f15d5-76cc-4ffe-a1c0-1d48676d17ef'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:06.855636 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-fc5f15d5-76cc-4ffe-a1c0-1d48676d17ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5505429d2e80421faf8db090b12ec843', 'request_id': 'req-fc5f15d5-76cc-4ffe-a1c0-1d48676d17ef'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:06.870359 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-fc5f15d5-76cc-4ffe-a1c0-1d48676d17ef admin admin] The token cache is being invalidate because project 5505429d2e80421faf8db090b12ec843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:36:06.870830 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-fc5f15d5-76cc-4ffe-a1c0-1d48676d17ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:06.871608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-fc5f15d5-76cc-4ffe-a1c0-1d48676d17ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:06.873303 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1100/2206] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:36:06 2022] DELETE /identity/v3/projects/5505429d2e80421faf8db090b12ec843 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:36:06.878282 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18789612-74a5-4d7d-b96f-21645536289a None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:06.878778 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18789612-74a5-4d7d-b96f-21645536289a None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:06.878923 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18789612-74a5-4d7d-b96f-21645536289a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:06.899554 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-18789612-74a5-4d7d-b96f-21645536289a None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:36:06.900847 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-18789612-74a5-4d7d-b96f-21645536289a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:06.966403 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1107/2207] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:36:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:36:06.975065 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48637e4-afef-4a55-ad12-dfd524834424 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:06.975597 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48637e4-afef-4a55-ad12-dfd524834424 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:06.975879 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48637e4-afef-4a55-ad12-dfd524834424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:06.998518 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-a48637e4-afef-4a55-ad12-dfd524834424 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:36:06.999784 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-a48637e4-afef-4a55-ad12-dfd524834424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:07.007905 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1101/2208] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:36:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:36:07.012262 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18789612-74a5-4d7d-b96f-21645536289a None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:07.023078 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18789612-74a5-4d7d-b96f-21645536289a None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:07.027857 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5228d-f698-4833-88ce-bacf2cd8d496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:07.028477 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5228d-f698-4833-88ce-bacf2cd8d496 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:07.028809 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5228d-f698-4833-88ce-bacf2cd8d496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:07.029088 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5228d-f698-4833-88ce-bacf2cd8d496 admin admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:07.029741 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5228d-f698-4833-88ce-bacf2cd8d496 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:36:07.030068 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5228d-f698-4833-88ce-bacf2cd8d496 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:07.032240 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5228d-f698-4833-88ce-bacf2cd8d496 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:07.041453 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:07.049897 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1108/2209] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:36:07.050099 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48637e4-afef-4a55-ad12-dfd524834424 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:07.059882 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48637e4-afef-4a55-ad12-dfd524834424 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:07.064642 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d6a2a-1520-4c8d-8d01-671cdd3f661a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:07.065253 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d6a2a-1520-4c8d-8d01-671cdd3f661a admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:07.065532 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d6a2a-1520-4c8d-8d01-671cdd3f661a admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:07.065805 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d6a2a-1520-4c8d-8d01-671cdd3f661a admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:07.066735 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d6a2a-1520-4c8d-8d01-671cdd3f661a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:07.068717 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d6a2a-1520-4c8d-8d01-671cdd3f661a admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:07.103168 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1102/2210] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:36:07 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:36:07.104482 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5228d-f698-4833-88ce-bacf2cd8d496 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:07.114902 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5228d-f698-4833-88ce-bacf2cd8d496 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:07.174035 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11316e-584b-4fab-9e8a-0f93dd6edc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:07.174656 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11316e-584b-4fab-9e8a-0f93dd6edc06 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:07.174939 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11316e-584b-4fab-9e8a-0f93dd6edc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:07.175219 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11316e-584b-4fab-9e8a-0f93dd6edc06 admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:07.175875 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11316e-584b-4fab-9e8a-0f93dd6edc06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:07.177823 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11316e-584b-4fab-9e8a-0f93dd6edc06 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:07.202679 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1109/2211] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:36:07 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:36:07.207591 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d6a2a-1520-4c8d-8d01-671cdd3f661a admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:07.219230 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d6a2a-1520-4c8d-8d01-671cdd3f661a admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:07.224521 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3497b6-f33c-4247-afd5-d48b724a9b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:07.225272 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3497b6-f33c-4247-afd5-d48b724a9b5b admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:07.225617 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3497b6-f33c-4247-afd5-d48b724a9b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:07.225960 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3497b6-f33c-4247-afd5-d48b724a9b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:07.226687 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3497b6-f33c-4247-afd5-d48b724a9b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:07.228419 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3497b6-f33c-4247-afd5-d48b724a9b5b admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:07.239181 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1103/2212] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:36:07.243576 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11316e-584b-4fab-9e8a-0f93dd6edc06 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:07.255178 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11316e-584b-4fab-9e8a-0f93dd6edc06 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:07.261188 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302fce50-9b39-4f5b-988c-a4208f7e1ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:07.261888 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fce50-9b39-4f5b-988c-a4208f7e1ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:07.262180 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fce50-9b39-4f5b-988c-a4208f7e1ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:07.262531 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fce50-9b39-4f5b-988c-a4208f7e1ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:07.263265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302fce50-9b39-4f5b-988c-a4208f7e1ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:07.265265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302fce50-9b39-4f5b-988c-a4208f7e1ce6 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:07.277676 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1110/2213] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:36:07.282036 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3497b6-f33c-4247-afd5-d48b724a9b5b admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:07.292311 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3497b6-f33c-4247-afd5-d48b724a9b5b admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:07.297470 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e380e5-9f42-4bf8-a042-bcada6b2f28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:07.298591 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e380e5-9f42-4bf8-a042-bcada6b2f28a admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:07.299072 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e380e5-9f42-4bf8-a042-bcada6b2f28a admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:07.299568 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e380e5-9f42-4bf8-a042-bcada6b2f28a admin admin] PATH_INFO: `/v3/projects/fe08353b4e3641058ca125edd01ed961/users/6be01355620e48adae97fcb2c036b946/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:07.319253 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e380e5-9f42-4bf8-a042-bcada6b2f28a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe08353b4e3641058ca125edd01ed961, user_id=6be01355620e48adae97fcb2c036b946, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:07.322467 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e380e5-9f42-4bf8-a042-bcada6b2f28a admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:07.347180 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1104/2214] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:36:07 2022] PUT /identity/v3/projects/fe08353b4e3641058ca125edd01ed961/users/6be01355620e48adae97fcb2c036b946/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:36:07.348807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ae273-6261-41b6-9d14-0049ec0375d5 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:07.349369 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ae273-6261-41b6-9d14-0049ec0375d5 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:07.349711 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ae273-6261-41b6-9d14-0049ec0375d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:07.380759 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-449ae273-6261-41b6-9d14-0049ec0375d5 None None] MFA Rules not processed for user `6be01355620e48adae97fcb2c036b946`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:36:07.382259 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-449ae273-6261-41b6-9d14-0049ec0375d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:07.457559 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1111/2215] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:36:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:36:07.459093 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e380e5-9f42-4bf8-a042-bcada6b2f28a admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:07.502245 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:07.544589 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e380e5-9f42-4bf8-a042-bcada6b2f28a admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:07.550097 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684f74f-b1d8-4b89-bffb-cf062e20f378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:07.550718 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684f74f-b1d8-4b89-bffb-cf062e20f378 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:07.551012 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684f74f-b1d8-4b89-bffb-cf062e20f378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:07.551294 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684f74f-b1d8-4b89-bffb-cf062e20f378 admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:07.552067 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684f74f-b1d8-4b89-bffb-cf062e20f378 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:07.554170 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684f74f-b1d8-4b89-bffb-cf062e20f378 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:07.593637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1105/2216] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:36:07 2022] POST /identity/v3/projects => generated 387 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:36:07.594848 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ae273-6261-41b6-9d14-0049ec0375d5 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:07.606955 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ae273-6261-41b6-9d14-0049ec0375d5 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:07.690931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d61e56-2272-4285-ad7c-be2dffbbcf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:07.692008 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d61e56-2272-4285-ad7c-be2dffbbcf3f admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:07.692354 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d61e56-2272-4285-ad7c-be2dffbbcf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:07.692737 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d61e56-2272-4285-ad7c-be2dffbbcf3f admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:07.693455 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d61e56-2272-4285-ad7c-be2dffbbcf3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:07.695743 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d61e56-2272-4285-ad7c-be2dffbbcf3f admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:07.718836 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:07.731445 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684f74f-b1d8-4b89-bffb-cf062e20f378 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:07.738195 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1112/2217] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:36:07 2022] POST /identity/v3/users => generated 300 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:36:07.745976 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684f74f-b1d8-4b89-bffb-cf062e20f378 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:07.758076 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab81531-8493-42d8-be4a-cc640f23fc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:07.758722 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab81531-8493-42d8-be4a-cc640f23fc5f admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:07.759009 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab81531-8493-42d8-be4a-cc640f23fc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:07.759288 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab81531-8493-42d8-be4a-cc640f23fc5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:07.759963 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab81531-8493-42d8-be4a-cc640f23fc5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:07.761824 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab81531-8493-42d8-be4a-cc640f23fc5f admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:07.776585 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1106/2218] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:36:07.779469 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d61e56-2272-4285-ad7c-be2dffbbcf3f admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:07.790710 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d61e56-2272-4285-ad7c-be2dffbbcf3f admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:07.815414 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33c172-1949-4bf1-a3ab-c8b43e85e31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:07.815957 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33c172-1949-4bf1-a3ab-c8b43e85e31a admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:07.816505 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33c172-1949-4bf1-a3ab-c8b43e85e31a admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:07.816755 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33c172-1949-4bf1-a3ab-c8b43e85e31a admin admin] PATH_INFO: `/v3/projects/37870b83f95940f09fd19984366a5322/users/d723cd9e448c47128b927f3458777d88/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:07.836821 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33c172-1949-4bf1-a3ab-c8b43e85e31a admin admin] RBAC: Authorizing `identity:create_grant(project_id=37870b83f95940f09fd19984366a5322, user_id=d723cd9e448c47128b927f3458777d88, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:07.840203 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33c172-1949-4bf1-a3ab-c8b43e85e31a admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:07.861926 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1113/2219] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:36:07 2022] PUT /identity/v3/projects/37870b83f95940f09fd19984366a5322/users/d723cd9e448c47128b927f3458777d88/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:36:07.866147 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab81531-8493-42d8-be4a-cc640f23fc5f admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:07.876987 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab81531-8493-42d8-be4a-cc640f23fc5f admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:07.939896 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02fecdd-7278-4ef0-aff0-7cc22ce6fad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:07.940574 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fecdd-7278-4ef0-aff0-7cc22ce6fad3 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:07.940874 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fecdd-7278-4ef0-aff0-7cc22ce6fad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:07.941153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fecdd-7278-4ef0-aff0-7cc22ce6fad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:07.941891 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02fecdd-7278-4ef0-aff0-7cc22ce6fad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:07.943579 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02fecdd-7278-4ef0-aff0-7cc22ce6fad3 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:07.955069 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1107/2220] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:36:07.959474 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33c172-1949-4bf1-a3ab-c8b43e85e31a admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:07.970965 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33c172-1949-4bf1-a3ab-c8b43e85e31a admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:07.976492 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0079d-f49d-4e88-833f-1b88d7b1829c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:07.977283 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0079d-f49d-4e88-833f-1b88d7b1829c admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:07.977635 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0079d-f49d-4e88-833f-1b88d7b1829c admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:07.977914 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0079d-f49d-4e88-833f-1b88d7b1829c admin admin] PATH_INFO: `/v3/projects/37870b83f95940f09fd19984366a5322/users/d723cd9e448c47128b927f3458777d88/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:07.980214 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0079d-f49d-4e88-833f-1b88d7b1829c admin admin] RBAC: Authorizing `identity:create_grant(project_id=37870b83f95940f09fd19984366a5322, user_id=d723cd9e448c47128b927f3458777d88, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:07.983182 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0079d-f49d-4e88-833f-1b88d7b1829c admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:07.994987 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1114/2221] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:36:07 2022] PUT /identity/v3/projects/37870b83f95940f09fd19984366a5322/users/d723cd9e448c47128b927f3458777d88/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:36:08.007083 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7d019-8b1b-42fe-aeb4-014b88ed5231 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:08.007376 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7d019-8b1b-42fe-aeb4-014b88ed5231 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:08.007658 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7d019-8b1b-42fe-aeb4-014b88ed5231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:08.037135 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-6ab7d019-8b1b-42fe-aeb4-014b88ed5231 None None] MFA Rules not processed for user `d723cd9e448c47128b927f3458777d88`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:36:08.038467 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-6ab7d019-8b1b-42fe-aeb4-014b88ed5231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:08.125052 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1108/2222] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:36:08 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:36:08.136922 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0079d-f49d-4e88-833f-1b88d7b1829c admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:08.138991 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-6be0079d-f49d-4e88-833f-1b88d7b1829c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:08.198575 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0079d-f49d-4e88-833f-1b88d7b1829c admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:08.202255 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf771e-9104-4079-b9d9-fb5e70900fd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:08.203417 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf771e-9104-4079-b9d9-fb5e70900fd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:08.203699 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf771e-9104-4079-b9d9-fb5e70900fd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:08.203970 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf771e-9104-4079-b9d9-fb5e70900fd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:08.213308 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf771e-9104-4079-b9d9-fb5e70900fd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:08.214732 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf771e-9104-4079-b9d9-fb5e70900fd2 service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:08.225696 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1115/2223] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:36:08 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:36:08.260592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7d019-8b1b-42fe-aeb4-014b88ed5231 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:08.317242 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:08.357765 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7d019-8b1b-42fe-aeb4-014b88ed5231 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:08.362586 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef469b-bc94-4900-a4f8-333449313347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:08.363225 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef469b-bc94-4900-a4f8-333449313347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:08.363523 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef469b-bc94-4900-a4f8-333449313347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:08.363776 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef469b-bc94-4900-a4f8-333449313347 admin admin] PATH_INFO: `/v3/users/6be01355620e48adae97fcb2c036b946` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:08.364937 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef469b-bc94-4900-a4f8-333449313347 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6be01355620e48adae97fcb2c036b946)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:08.366858 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef469b-bc94-4900-a4f8-333449313347 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:08.417839 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-6bef469b-bc94-4900-a4f8-333449313347 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6be01355620e48adae97fcb2c036b946'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:08.418773 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-6bef469b-bc94-4900-a4f8-333449313347 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6be01355620e48adae97fcb2c036b946'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:08.433324 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-6bef469b-bc94-4900-a4f8-333449313347 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6be01355620e48adae97fcb2c036b946'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:08.434073 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-6bef469b-bc94-4900-a4f8-333449313347 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6be01355620e48adae97fcb2c036b946'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:08.441069 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-6bef469b-bc94-4900-a4f8-333449313347 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6be01355620e48adae97fcb2c036b946'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:08.455111 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1109/2224] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:36:08 2022] DELETE /identity/v3/users/6be01355620e48adae97fcb2c036b946 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:36:08.459736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c14cf-57cd-42d9-94e3-861b68717146 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:08.460076 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c14cf-57cd-42d9-94e3-861b68717146 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:08.460388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c14cf-57cd-42d9-94e3-861b68717146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:08.481428 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-4a4c14cf-57cd-42d9-94e3-861b68717146 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:36:08.482702 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-4a4c14cf-57cd-42d9-94e3-861b68717146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:08.547784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1116/2225] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:36:08.557798 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef469b-bc94-4900-a4f8-333449313347 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:08.559215 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-6bef469b-bc94-4900-a4f8-333449313347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:08.623840 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef469b-bc94-4900-a4f8-333449313347 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:08.628080 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3266b-f760-4efa-83a0-5359ba1f6f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:08.628740 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3266b-f760-4efa-83a0-5359ba1f6f58 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:08.629025 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3266b-f760-4efa-83a0-5359ba1f6f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:08.629309 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3266b-f760-4efa-83a0-5359ba1f6f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:08.638738 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3266b-f760-4efa-83a0-5359ba1f6f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:08.640346 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3266b-f760-4efa-83a0-5359ba1f6f58 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:08.651254 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1110/2226] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:36:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 20:36:09.021242 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c14cf-57cd-42d9-94e3-861b68717146 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:09.023494 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-4a4c14cf-57cd-42d9-94e3-861b68717146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:09.039247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c14cf-57cd-42d9-94e3-861b68717146 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:09.061913 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb0274-b858-4843-b790-00598625648a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:09.062651 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb0274-b858-4843-b790-00598625648a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:09.062873 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb0274-b858-4843-b790-00598625648a admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:09.063173 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb0274-b858-4843-b790-00598625648a admin admin] PATH_INFO: `/v3/projects/fe08353b4e3641058ca125edd01ed961` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:09.077596 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb0274-b858-4843-b790-00598625648a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe08353b4e3641058ca125edd01ed961)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:09.080133 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb0274-b858-4843-b790-00598625648a admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:09.146874 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-e4cb0274-b858-4843-b790-00598625648a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe08353b4e3641058ca125edd01ed961', 'request_id': 'req-e4cb0274-b858-4843-b790-00598625648a'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:09.154140 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-e4cb0274-b858-4843-b790-00598625648a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe08353b4e3641058ca125edd01ed961', 'request_id': 'req-e4cb0274-b858-4843-b790-00598625648a'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:09.160027 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:09.164285 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-e4cb0274-b858-4843-b790-00598625648a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe08353b4e3641058ca125edd01ed961', 'request_id': 'req-e4cb0274-b858-4843-b790-00598625648a'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:09.178395 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-e4cb0274-b858-4843-b790-00598625648a admin admin] The token cache is being invalidate because project fe08353b4e3641058ca125edd01ed961 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:36:09.178831 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-e4cb0274-b858-4843-b790-00598625648a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:09.179578 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-e4cb0274-b858-4843-b790-00598625648a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:09.184427 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1117/2227] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:36:09 2022] DELETE /identity/v3/projects/fe08353b4e3641058ca125edd01ed961 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:36:09.185454 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3266b-f760-4efa-83a0-5359ba1f6f58 service neutron] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:09.196578 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3266b-f760-4efa-83a0-5359ba1f6f58 service neutron] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:09.246559 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:09.263977 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b56112-7522-4f44-8f45-73a725407224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:09.264846 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b56112-7522-4f44-8f45-73a725407224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:09.265797 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b56112-7522-4f44-8f45-73a725407224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:09.266086 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b56112-7522-4f44-8f45-73a725407224 admin admin] PATH_INFO: `/v3/users/d723cd9e448c47128b927f3458777d88` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:09.267636 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b56112-7522-4f44-8f45-73a725407224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d723cd9e448c47128b927f3458777d88)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:09.269746 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b56112-7522-4f44-8f45-73a725407224 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:09.329127 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-65b56112-7522-4f44-8f45-73a725407224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd723cd9e448c47128b927f3458777d88'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:09.329812 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-65b56112-7522-4f44-8f45-73a725407224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd723cd9e448c47128b927f3458777d88'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:09.344298 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-65b56112-7522-4f44-8f45-73a725407224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd723cd9e448c47128b927f3458777d88'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:09.345113 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-65b56112-7522-4f44-8f45-73a725407224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd723cd9e448c47128b927f3458777d88'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:09.352597 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-65b56112-7522-4f44-8f45-73a725407224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd723cd9e448c47128b927f3458777d88'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:09.367432 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1111/2228] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:36:09 2022] DELETE /identity/v3/users/d723cd9e448c47128b927f3458777d88 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:36:09.732586 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb0274-b858-4843-b790-00598625648a admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:09.734801 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-e4cb0274-b858-4843-b790-00598625648a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:09.761022 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb0274-b858-4843-b790-00598625648a admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:09.818625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60ab1c-473d-4ae0-8b3a-1b73d8f90498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:09.819253 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60ab1c-473d-4ae0-8b3a-1b73d8f90498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:09.819533 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60ab1c-473d-4ae0-8b3a-1b73d8f90498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:09.819805 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60ab1c-473d-4ae0-8b3a-1b73d8f90498 admin admin] PATH_INFO: `/v3/projects/37870b83f95940f09fd19984366a5322` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:09.820939 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60ab1c-473d-4ae0-8b3a-1b73d8f90498 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37870b83f95940f09fd19984366a5322)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:09.822854 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60ab1c-473d-4ae0-8b3a-1b73d8f90498 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:09.868839 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0b60ab1c-473d-4ae0-8b3a-1b73d8f90498 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37870b83f95940f09fd19984366a5322', 'request_id': 'req-0b60ab1c-473d-4ae0-8b3a-1b73d8f90498'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:09.874958 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0b60ab1c-473d-4ae0-8b3a-1b73d8f90498 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37870b83f95940f09fd19984366a5322', 'request_id': 'req-0b60ab1c-473d-4ae0-8b3a-1b73d8f90498'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:09.882695 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0b60ab1c-473d-4ae0-8b3a-1b73d8f90498 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37870b83f95940f09fd19984366a5322', 'request_id': 'req-0b60ab1c-473d-4ae0-8b3a-1b73d8f90498'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:09.893419 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0b60ab1c-473d-4ae0-8b3a-1b73d8f90498 admin admin] The token cache is being invalidate because project 37870b83f95940f09fd19984366a5322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:36:09.893705 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0b60ab1c-473d-4ae0-8b3a-1b73d8f90498 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:09.894319 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0b60ab1c-473d-4ae0-8b3a-1b73d8f90498 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:09.895851 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1118/2229] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:36:09 2022] DELETE /identity/v3/projects/37870b83f95940f09fd19984366a5322 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:36:09.900718 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048e92a-6102-4bab-baf5-13f4c18ccb36 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:09.901012 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048e92a-6102-4bab-baf5-13f4c18ccb36 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:09.901294 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048e92a-6102-4bab-baf5-13f4c18ccb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:09.921131 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-0048e92a-6102-4bab-baf5-13f4c18ccb36 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:36:09.922314 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-0048e92a-6102-4bab-baf5-13f4c18ccb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:09.980035 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1112/2230] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:36:09.987804 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06746e25-c037-4211-9021-6b83d0195edb None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:09.988114 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06746e25-c037-4211-9021-6b83d0195edb None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:09.988392 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06746e25-c037-4211-9021-6b83d0195edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:10.007806 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-06746e25-c037-4211-9021-6b83d0195edb None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:36:10.009034 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-06746e25-c037-4211-9021-6b83d0195edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:10.017393 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1119/2231] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:36:10.021617 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048e92a-6102-4bab-baf5-13f4c18ccb36 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:10.031593 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048e92a-6102-4bab-baf5-13f4c18ccb36 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:10.036224 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81b4e4-9fba-4823-ac92-fc669aa26070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:10.036855 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81b4e4-9fba-4823-ac92-fc669aa26070 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:10.037137 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81b4e4-9fba-4823-ac92-fc669aa26070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:10.037408 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81b4e4-9fba-4823-ac92-fc669aa26070 admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:10.038127 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81b4e4-9fba-4823-ac92-fc669aa26070 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:36:10.038431 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81b4e4-9fba-4823-ac92-fc669aa26070 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:10.040014 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81b4e4-9fba-4823-ac92-fc669aa26070 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:10.054994 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1113/2232] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:36:10.056960 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06746e25-c037-4211-9021-6b83d0195edb None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:10.066614 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06746e25-c037-4211-9021-6b83d0195edb None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:10.072226 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53789f27-f873-41fa-ab12-74775bf4c797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:10.072884 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53789f27-f873-41fa-ab12-74775bf4c797 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:10.073242 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53789f27-f873-41fa-ab12-74775bf4c797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:10.073410 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53789f27-f873-41fa-ab12-74775bf4c797 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:10.074043 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53789f27-f873-41fa-ab12-74775bf4c797 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:10.076107 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53789f27-f873-41fa-ab12-74775bf4c797 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:10.112717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1120/2233] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:36:10 2022] POST /identity/v3/projects => generated 409 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:36:10.114846 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81b4e4-9fba-4823-ac92-fc669aa26070 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:10.126565 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81b4e4-9fba-4823-ac92-fc669aa26070 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:10.176110 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:10.185205 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c94af-efb9-4686-bf9e-006f90f3ebd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:10.186115 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c94af-efb9-4686-bf9e-006f90f3ebd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:10.186644 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c94af-efb9-4686-bf9e-006f90f3ebd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:10.187033 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c94af-efb9-4686-bf9e-006f90f3ebd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:10.188380 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c94af-efb9-4686-bf9e-006f90f3ebd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:10.190632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c94af-efb9-4686-bf9e-006f90f3ebd8 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:10.213211 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1114/2234] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:36:10 2022] POST /identity/v3/users => generated 305 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:36:10.217336 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53789f27-f873-41fa-ab12-74775bf4c797 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:10.228746 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53789f27-f873-41fa-ab12-74775bf4c797 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:10.233447 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f247f11-24ce-4ddb-b5e8-4d99f785f86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:10.234088 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f247f11-24ce-4ddb-b5e8-4d99f785f86e admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:10.234364 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f247f11-24ce-4ddb-b5e8-4d99f785f86e admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:10.234648 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f247f11-24ce-4ddb-b5e8-4d99f785f86e admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:10.235286 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f247f11-24ce-4ddb-b5e8-4d99f785f86e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:10.236944 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f247f11-24ce-4ddb-b5e8-4d99f785f86e admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:10.247679 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1121/2235] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:36:10.252131 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c94af-efb9-4686-bf9e-006f90f3ebd8 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:10.264021 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c94af-efb9-4686-bf9e-006f90f3ebd8 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:10.269176 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd638e6b-e9ac-4a3b-aa5b-0a01083f5a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:10.269770 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd638e6b-e9ac-4a3b-aa5b-0a01083f5a18 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:10.270051 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd638e6b-e9ac-4a3b-aa5b-0a01083f5a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:10.270325 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd638e6b-e9ac-4a3b-aa5b-0a01083f5a18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:10.271083 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd638e6b-e9ac-4a3b-aa5b-0a01083f5a18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:10.272794 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd638e6b-e9ac-4a3b-aa5b-0a01083f5a18 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:10.283208 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1115/2236] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:36:10.287308 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f247f11-24ce-4ddb-b5e8-4d99f785f86e admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:10.297658 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f247f11-24ce-4ddb-b5e8-4d99f785f86e admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:10.302578 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f5d08-4260-4549-8434-687b5a005b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:10.303218 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f5d08-4260-4549-8434-687b5a005b41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:10.303497 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f5d08-4260-4549-8434-687b5a005b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:10.303766 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f5d08-4260-4549-8434-687b5a005b41 admin admin] PATH_INFO: `/v3/projects/372355c1aeea4f6fb93ba08c689b7158/users/0bf79cece6344a72b404fb9a5e33d220/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:10.319580 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f5d08-4260-4549-8434-687b5a005b41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=372355c1aeea4f6fb93ba08c689b7158, user_id=0bf79cece6344a72b404fb9a5e33d220, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:10.322298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f5d08-4260-4549-8434-687b5a005b41 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:10.334880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1122/2237] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:36:10 2022] PUT /identity/v3/projects/372355c1aeea4f6fb93ba08c689b7158/users/0bf79cece6344a72b404fb9a5e33d220/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:36:10.346522 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99f180-acea-4733-a90c-82f07d0c3c6e None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:10.346812 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99f180-acea-4733-a90c-82f07d0c3c6e None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:10.347090 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99f180-acea-4733-a90c-82f07d0c3c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:10.373869 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-7d99f180-acea-4733-a90c-82f07d0c3c6e None None] MFA Rules not processed for user `0bf79cece6344a72b404fb9a5e33d220`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:36:10.375515 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-7d99f180-acea-4733-a90c-82f07d0c3c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:10.438468 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1116/2238] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:36:10 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:36:10.443184 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f5d08-4260-4549-8434-687b5a005b41 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:10.458082 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:10.507318 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f5d08-4260-4549-8434-687b5a005b41 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:10.511979 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4b1d7-155c-4edf-8673-64a27f9e70db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:10.512608 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4b1d7-155c-4edf-8673-64a27f9e70db admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:10.512894 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4b1d7-155c-4edf-8673-64a27f9e70db admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:10.513170 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4b1d7-155c-4edf-8673-64a27f9e70db admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:10.513812 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4b1d7-155c-4edf-8673-64a27f9e70db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:10.516200 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4b1d7-155c-4edf-8673-64a27f9e70db admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:10.544479 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1123/2239] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:36:10 2022] POST /identity/v3/projects => generated 409 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:36:10.548506 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99f180-acea-4733-a90c-82f07d0c3c6e None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:10.558926 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99f180-acea-4733-a90c-82f07d0c3c6e None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:10.613473 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6993b46-7f6c-4192-b77b-024a11f32c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:10.614070 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6993b46-7f6c-4192-b77b-024a11f32c08 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:10.614347 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6993b46-7f6c-4192-b77b-024a11f32c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:10.614612 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6993b46-7f6c-4192-b77b-024a11f32c08 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:10.615232 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6993b46-7f6c-4192-b77b-024a11f32c08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:10.617185 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6993b46-7f6c-4192-b77b-024a11f32c08 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:10.637641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1117/2240] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:36:10 2022] POST /identity/v3/users => generated 311 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:36:10.641968 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4b1d7-155c-4edf-8673-64a27f9e70db admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:10.652083 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4b1d7-155c-4edf-8673-64a27f9e70db admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:10.657231 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3756e5-2a38-46e5-9bae-3313301006ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:10.657815 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3756e5-2a38-46e5-9bae-3313301006ad admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:10.658095 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3756e5-2a38-46e5-9bae-3313301006ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:10.658368 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3756e5-2a38-46e5-9bae-3313301006ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:10.659000 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3756e5-2a38-46e5-9bae-3313301006ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:10.660602 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3756e5-2a38-46e5-9bae-3313301006ad admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:10.671027 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1124/2241] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:36:10.674906 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6993b46-7f6c-4192-b77b-024a11f32c08 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:10.684858 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6993b46-7f6c-4192-b77b-024a11f32c08 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:10.689556 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc7933-9586-46e7-9ca6-a1d5d312cc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:10.690195 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc7933-9586-46e7-9ca6-a1d5d312cc26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:10.690479 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc7933-9586-46e7-9ca6-a1d5d312cc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:10.690755 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc7933-9586-46e7-9ca6-a1d5d312cc26 admin admin] PATH_INFO: `/v3/projects/5648685899c847ba9064c009781e15c7/users/47b5ef0544784dacbd3964d7099923dd/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:10.705669 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc7933-9586-46e7-9ca6-a1d5d312cc26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5648685899c847ba9064c009781e15c7, user_id=47b5ef0544784dacbd3964d7099923dd, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:10.708322 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc7933-9586-46e7-9ca6-a1d5d312cc26 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:10.721576 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1118/2242] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:36:10 2022] PUT /identity/v3/projects/5648685899c847ba9064c009781e15c7/users/47b5ef0544784dacbd3964d7099923dd/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:36:10.725657 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3756e5-2a38-46e5-9bae-3313301006ad admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:10.736137 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3756e5-2a38-46e5-9bae-3313301006ad admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:10.790788 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21230385-5517-4b73-bcc1-19f578760b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:10.791394 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21230385-5517-4b73-bcc1-19f578760b5d admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:10.791678 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21230385-5517-4b73-bcc1-19f578760b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:10.791955 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21230385-5517-4b73-bcc1-19f578760b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:10.792625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21230385-5517-4b73-bcc1-19f578760b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:10.794210 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21230385-5517-4b73-bcc1-19f578760b5d admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:10.804201 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1125/2243] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:36:10.808467 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc7933-9586-46e7-9ca6-a1d5d312cc26 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:10.819106 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc7933-9586-46e7-9ca6-a1d5d312cc26 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:10.823598 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbf045-dafc-4780-bc5e-c0b8b1f302c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:10.824234 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbf045-dafc-4780-bc5e-c0b8b1f302c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:10.824512 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbf045-dafc-4780-bc5e-c0b8b1f302c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:10.824825 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbf045-dafc-4780-bc5e-c0b8b1f302c2 admin admin] PATH_INFO: `/v3/projects/5648685899c847ba9064c009781e15c7/users/47b5ef0544784dacbd3964d7099923dd/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:10.826689 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbbf045-dafc-4780-bc5e-c0b8b1f302c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5648685899c847ba9064c009781e15c7, user_id=47b5ef0544784dacbd3964d7099923dd, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:10.829348 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbbf045-dafc-4780-bc5e-c0b8b1f302c2 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:10.839582 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1119/2244] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:36:10 2022] PUT /identity/v3/projects/5648685899c847ba9064c009781e15c7/users/47b5ef0544784dacbd3964d7099923dd/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:36:10.851442 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa733d0-d7be-4fcd-a988-b1cb4c253344 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:10.851727 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa733d0-d7be-4fcd-a988-b1cb4c253344 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:10.852002 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa733d0-d7be-4fcd-a988-b1cb4c253344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:10.879247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-0aa733d0-d7be-4fcd-a988-b1cb4c253344 None None] MFA Rules not processed for user `47b5ef0544784dacbd3964d7099923dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:36:10.880433 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-0aa733d0-d7be-4fcd-a988-b1cb4c253344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:10.948216 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1126/2245] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:36:10 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:36:10.960269 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbf045-dafc-4780-bc5e-c0b8b1f302c2 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:10.962140 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-ddbbf045-dafc-4780-bc5e-c0b8b1f302c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:10.984052 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:11.035623 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbf045-dafc-4780-bc5e-c0b8b1f302c2 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:11.039728 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce17ca-204a-4a8c-86f5-535d5ac51ed4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:11.040341 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce17ca-204a-4a8c-86f5-535d5ac51ed4 service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:11.040667 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce17ca-204a-4a8c-86f5-535d5ac51ed4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:11.040940 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce17ca-204a-4a8c-86f5-535d5ac51ed4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:11.054188 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce17ca-204a-4a8c-86f5-535d5ac51ed4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:11.055687 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce17ca-204a-4a8c-86f5-535d5ac51ed4 service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:11.067702 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1120/2246] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:36:10 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:36:11.260306 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa733d0-d7be-4fcd-a988-b1cb4c253344 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:11.270515 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa733d0-d7be-4fcd-a988-b1cb4c253344 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:11.274263 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209f637-6e0e-4d08-9d44-e1bdf09c2b0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:11.274912 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209f637-6e0e-4d08-9d44-e1bdf09c2b0a service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:11.275200 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209f637-6e0e-4d08-9d44-e1bdf09c2b0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:11.275480 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209f637-6e0e-4d08-9d44-e1bdf09c2b0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:11.281797 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:11.347246 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d209f637-6e0e-4d08-9d44-e1bdf09c2b0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:11.350080 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d209f637-6e0e-4d08-9d44-e1bdf09c2b0a service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:11.361064 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1127/2247] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:36:11 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:36:13.836510 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495cfec-5124-4292-86e5-0820799f5729 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:13.837071 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495cfec-5124-4292-86e5-0820799f5729 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:13.837272 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495cfec-5124-4292-86e5-0820799f5729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:13.858068 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-3495cfec-5124-4292-86e5-0820799f5729 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:36:13.859360 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-3495cfec-5124-4292-86e5-0820799f5729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:13.918883 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1121/2248] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Nov 2 20:36:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:36:13.935129 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209f637-6e0e-4d08-9d44-e1bdf09c2b0a service cinder] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:13.936642 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-d209f637-6e0e-4d08-9d44-e1bdf09c2b0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:14.016789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209f637-6e0e-4d08-9d44-e1bdf09c2b0a service cinder] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:14.022838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a93948-6f65-4694-88ae-87785f095dc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:14.023449 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a93948-6f65-4694-88ae-87785f095dc4 service nova] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:14.023785 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a93948-6f65-4694-88ae-87785f095dc4 service nova] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:14.024089 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a93948-6f65-4694-88ae-87785f095dc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:14.033667 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a93948-6f65-4694-88ae-87785f095dc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:14.035461 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a93948-6f65-4694-88ae-87785f095dc4 service nova] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:14.045908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1128/2249] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:36:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:36:15.101321 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495cfec-5124-4292-86e5-0820799f5729 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:15.117972 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495cfec-5124-4292-86e5-0820799f5729 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:15.123673 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a031fa-c3ba-4362-abf2-58490d82e26a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:15.124481 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a031fa-c3ba-4362-abf2-58490d82e26a service nova] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:15.125437 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a031fa-c3ba-4362-abf2-58490d82e26a service nova] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:15.125807 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a031fa-c3ba-4362-abf2-58490d82e26a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:15.128359 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-82a031fa-c3ba-4362-abf2-58490d82e26a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:15.144361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a031fa-c3ba-4362-abf2-58490d82e26a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:15.146126 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a031fa-c3ba-4362-abf2-58490d82e26a service nova] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:15.157336 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1122/2250] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:36:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:36:16.645153 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a93948-6f65-4694-88ae-87785f095dc4 service nova] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:16.654465 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a93948-6f65-4694-88ae-87785f095dc4 service nova] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:16.659120 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa0071-9d72-4de6-8a7a-561b6115a09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:16.659800 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa0071-9d72-4de6-8a7a-561b6115a09e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:16.660084 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa0071-9d72-4de6-8a7a-561b6115a09e admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:16.660361 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa0071-9d72-4de6-8a7a-561b6115a09e admin admin] PATH_INFO: `/v3/users/0bf79cece6344a72b404fb9a5e33d220` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:16.661502 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa0071-9d72-4de6-8a7a-561b6115a09e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bf79cece6344a72b404fb9a5e33d220)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:16.663388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa0071-9d72-4de6-8a7a-561b6115a09e admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:16.711830 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-75fa0071-9d72-4de6-8a7a-561b6115a09e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bf79cece6344a72b404fb9a5e33d220'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:16.712482 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-75fa0071-9d72-4de6-8a7a-561b6115a09e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bf79cece6344a72b404fb9a5e33d220'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:16.721002 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-75fa0071-9d72-4de6-8a7a-561b6115a09e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bf79cece6344a72b404fb9a5e33d220'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:16.721647 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-75fa0071-9d72-4de6-8a7a-561b6115a09e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bf79cece6344a72b404fb9a5e33d220'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:16.736189 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-75fa0071-9d72-4de6-8a7a-561b6115a09e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bf79cece6344a72b404fb9a5e33d220'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:16.754183 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1129/2251] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:36:16 2022] DELETE /identity/v3/users/0bf79cece6344a72b404fb9a5e33d220 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:36:16.758495 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5548f7-9ca7-4abf-a64e-0099e8cb33cc None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:16.758943 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5548f7-9ca7-4abf-a64e-0099e8cb33cc None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:16.759088 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5548f7-9ca7-4abf-a64e-0099e8cb33cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:16.781444 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-1b5548f7-9ca7-4abf-a64e-0099e8cb33cc None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:36:16.782653 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-1b5548f7-9ca7-4abf-a64e-0099e8cb33cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:16.840469 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1123/2252] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:36:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:36:16.851134 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa0071-9d72-4de6-8a7a-561b6115a09e admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:16.852751 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-75fa0071-9d72-4de6-8a7a-561b6115a09e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:16.860297 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:16.897320 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7140b6-7bfc-428a-b2c6-4434d4fdcb03 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:16.897611 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7140b6-7bfc-428a-b2c6-4434d4fdcb03 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:16.897893 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7140b6-7bfc-428a-b2c6-4434d4fdcb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:16.915954 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa0071-9d72-4de6-8a7a-561b6115a09e admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:16.919077 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-9d7140b6-7bfc-428a-b2c6-4434d4fdcb03 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:36:16.920448 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-9d7140b6-7bfc-428a-b2c6-4434d4fdcb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:16.923837 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311db04e-fcdf-4bde-9207-9e09207f0254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:16.924523 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311db04e-fcdf-4bde-9207-9e09207f0254 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:16.924826 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311db04e-fcdf-4bde-9207-9e09207f0254 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:16.925107 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311db04e-fcdf-4bde-9207-9e09207f0254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:16.929058 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1124/2253] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Nov 2 20:36:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:36:16.934927 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311db04e-fcdf-4bde-9207-9e09207f0254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:16.936461 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311db04e-fcdf-4bde-9207-9e09207f0254 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:16.944198 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7140b6-7bfc-428a-b2c6-4434d4fdcb03 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:16.945608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-9d7140b6-7bfc-428a-b2c6-4434d4fdcb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:16.946187 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1130/2254] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:36:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:36:16.990711 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:17.022947 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7140b6-7bfc-428a-b2c6-4434d4fdcb03 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:17.029009 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda07a8-d4f5-48f0-afa9-3b107796f61f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:17.029625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda07a8-d4f5-48f0-afa9-3b107796f61f service nova] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:17.029911 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda07a8-d4f5-48f0-afa9-3b107796f61f service nova] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:17.030195 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda07a8-d4f5-48f0-afa9-3b107796f61f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:17.039567 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda07a8-d4f5-48f0-afa9-3b107796f61f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:17.041289 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda07a8-d4f5-48f0-afa9-3b107796f61f service nova] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:17.051551 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1125/2255] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:36:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 20:36:17.216375 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311db04e-fcdf-4bde-9207-9e09207f0254 service neutron] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:17.217848 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-311db04e-fcdf-4bde-9207-9e09207f0254 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:17.231574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311db04e-fcdf-4bde-9207-9e09207f0254 service neutron] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:17.237371 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794139e5-66ed-4303-8402-981071cafbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:17.238047 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794139e5-66ed-4303-8402-981071cafbac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:17.238305 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794139e5-66ed-4303-8402-981071cafbac admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:17.238586 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794139e5-66ed-4303-8402-981071cafbac admin admin] PATH_INFO: `/v3/projects/372355c1aeea4f6fb93ba08c689b7158` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:17.239778 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794139e5-66ed-4303-8402-981071cafbac admin admin] RBAC: Authorizing `identity:delete_project(project_id=372355c1aeea4f6fb93ba08c689b7158)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:17.241859 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794139e5-66ed-4303-8402-981071cafbac admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:17.299526 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-794139e5-66ed-4303-8402-981071cafbac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '372355c1aeea4f6fb93ba08c689b7158', 'request_id': 'req-794139e5-66ed-4303-8402-981071cafbac'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:17.308585 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-794139e5-66ed-4303-8402-981071cafbac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '372355c1aeea4f6fb93ba08c689b7158', 'request_id': 'req-794139e5-66ed-4303-8402-981071cafbac'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:17.319016 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-794139e5-66ed-4303-8402-981071cafbac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '372355c1aeea4f6fb93ba08c689b7158', 'request_id': 'req-794139e5-66ed-4303-8402-981071cafbac'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:17.336144 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-794139e5-66ed-4303-8402-981071cafbac admin admin] The token cache is being invalidate because project 372355c1aeea4f6fb93ba08c689b7158 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:36:17.336628 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-794139e5-66ed-4303-8402-981071cafbac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:17.337512 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-794139e5-66ed-4303-8402-981071cafbac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:17.339691 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1131/2256] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:36:17 2022] DELETE /identity/v3/projects/372355c1aeea4f6fb93ba08c689b7158 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:36:17.344168 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda07a8-d4f5-48f0-afa9-3b107796f61f service nova] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:17.355385 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda07a8-d4f5-48f0-afa9-3b107796f61f service nova] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:17.420043 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53189d6-5bbe-4b68-918a-e00fcb135ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:17.420714 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53189d6-5bbe-4b68-918a-e00fcb135ac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:17.421022 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53189d6-5bbe-4b68-918a-e00fcb135ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:17.421302 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53189d6-5bbe-4b68-918a-e00fcb135ac6 admin admin] PATH_INFO: `/v3/users/47b5ef0544784dacbd3964d7099923dd` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:17.423102 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53189d6-5bbe-4b68-918a-e00fcb135ac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47b5ef0544784dacbd3964d7099923dd)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:17.424897 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53189d6-5bbe-4b68-918a-e00fcb135ac6 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:17.472290 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-e53189d6-5bbe-4b68-918a-e00fcb135ac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47b5ef0544784dacbd3964d7099923dd'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:17.472977 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-e53189d6-5bbe-4b68-918a-e00fcb135ac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47b5ef0544784dacbd3964d7099923dd'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:17.485572 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-e53189d6-5bbe-4b68-918a-e00fcb135ac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47b5ef0544784dacbd3964d7099923dd'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:17.486228 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-e53189d6-5bbe-4b68-918a-e00fcb135ac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47b5ef0544784dacbd3964d7099923dd'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:17.493231 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-e53189d6-5bbe-4b68-918a-e00fcb135ac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47b5ef0544784dacbd3964d7099923dd'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:17.507162 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1126/2257] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:36:17 2022] DELETE /identity/v3/users/47b5ef0544784dacbd3964d7099923dd => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:36:17.776715 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794139e5-66ed-4303-8402-981071cafbac admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:17.778589 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-794139e5-66ed-4303-8402-981071cafbac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:17.794141 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794139e5-66ed-4303-8402-981071cafbac admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:17.822768 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bd1e2-9612-42c5-bbd1-6e35c99605b0 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:17.823235 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bd1e2-9612-42c5-bbd1-6e35c99605b0 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:17.823235 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bd1e2-9612-42c5-bbd1-6e35c99605b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:17.843269 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-587bd1e2-9612-42c5-bbd1-6e35c99605b0 None None] MFA Rules not processed for user `66937804f65147f392f4ddfc3e961d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:36:17.845392 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-587bd1e2-9612-42c5-bbd1-6e35c99605b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:17.870833 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d84d72-d154-47a4-adce-98556a50ede3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:17.871661 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d84d72-d154-47a4-adce-98556a50ede3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:17.871940 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d84d72-d154-47a4-adce-98556a50ede3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:17.872219 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d84d72-d154-47a4-adce-98556a50ede3 admin admin] PATH_INFO: `/v3/projects/5648685899c847ba9064c009781e15c7` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:17.873368 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d84d72-d154-47a4-adce-98556a50ede3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5648685899c847ba9064c009781e15c7)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:17.875606 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d84d72-d154-47a4-adce-98556a50ede3 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:17.886750 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:17.903113 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1127/2258] 10.222.0.23 () {58 vars in 967 bytes} [Wed Nov 2 20:36:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:36:17.913465 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:17.918158 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587bd1e2-9612-42c5-bbd1-6e35c99605b0 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:17.919606 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-587bd1e2-9612-42c5-bbd1-6e35c99605b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:17.929870 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-61d84d72-d154-47a4-adce-98556a50ede3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5648685899c847ba9064c009781e15c7', 'request_id': 'req-61d84d72-d154-47a4-adce-98556a50ede3'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:17.937237 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-61d84d72-d154-47a4-adce-98556a50ede3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5648685899c847ba9064c009781e15c7', 'request_id': 'req-61d84d72-d154-47a4-adce-98556a50ede3'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:17.945067 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-61d84d72-d154-47a4-adce-98556a50ede3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5648685899c847ba9064c009781e15c7', 'request_id': 'req-61d84d72-d154-47a4-adce-98556a50ede3'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:17.956381 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-61d84d72-d154-47a4-adce-98556a50ede3 admin admin] The token cache is being invalidate because project 5648685899c847ba9064c009781e15c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:36:17.956734 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-61d84d72-d154-47a4-adce-98556a50ede3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:17.957373 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-61d84d72-d154-47a4-adce-98556a50ede3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:17.958870 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1132/2259] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:36:17 2022] DELETE /identity/v3/projects/5648685899c847ba9064c009781e15c7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:36:17.964143 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d9177-b1db-4540-8122-020641086fb1 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:17.964443 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d9177-b1db-4540-8122-020641086fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:17.964740 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d9177-b1db-4540-8122-020641086fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:17.986656 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-184d9177-b1db-4540-8122-020641086fb1 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:36:17.987840 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-184d9177-b1db-4540-8122-020641086fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:17.992637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587bd1e2-9612-42c5-bbd1-6e35c99605b0 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:18.047913 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1133/2260] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:36:18.055316 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d0d10-d0f5-4189-8558-07878c8ca996 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:18.055603 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d0d10-d0f5-4189-8558-07878c8ca996 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:18.055891 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d0d10-d0f5-4189-8558-07878c8ca996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:18.059700 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ded0d-8cb8-4ed9-879f-dfb40a92a081 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f22f80ac694e9888c132af1e58e292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:18.060664 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ded0d-8cb8-4ed9-879f-dfb40a92a081 service swift] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:18.060950 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ded0d-8cb8-4ed9-879f-dfb40a92a081 service swift] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:18.061225 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ded0d-8cb8-4ed9-879f-dfb40a92a081 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:18.063286 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-ae7ded0d-8cb8-4ed9-879f-dfb40a92a081 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:18.079618 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-c01d0d10-d0f5-4189-8558-07878c8ca996 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:36:18.080970 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-c01d0d10-d0f5-4189-8558-07878c8ca996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:18.089013 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1134/2261] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:36:18.093114 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d0d10-d0f5-4189-8558-07878c8ca996 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:18.103272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d0d10-d0f5-4189-8558-07878c8ca996 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:18.107936 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab4f17-71b3-4a86-85fc-fc702c542894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:18.108524 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab4f17-71b3-4a86-85fc-fc702c542894 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:18.108852 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab4f17-71b3-4a86-85fc-fc702c542894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:18.109149 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab4f17-71b3-4a86-85fc-fc702c542894 admin admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:18.109799 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab4f17-71b3-4a86-85fc-fc702c542894 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:36:18.110104 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab4f17-71b3-4a86-85fc-fc702c542894 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:18.111694 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab4f17-71b3-4a86-85fc-fc702c542894 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:18.123540 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1135/2262] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:36:18.127843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab4f17-71b3-4a86-85fc-fc702c542894 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:18.129369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ded0d-8cb8-4ed9-879f-dfb40a92a081 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:18.130963 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ded0d-8cb8-4ed9-879f-dfb40a92a081 service swift] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:18.137408 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab4f17-71b3-4a86-85fc-fc702c542894 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:18.139096 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1128/2263] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Nov 2 20:36:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 20:36:18.143128 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15ba8e-9af3-428e-ab6e-4d727052cbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:18.143727 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15ba8e-9af3-428e-ab6e-4d727052cbd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:18.144097 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15ba8e-9af3-428e-ab6e-4d727052cbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:18.144288 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15ba8e-9af3-428e-ab6e-4d727052cbd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:18.144921 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15ba8e-9af3-428e-ab6e-4d727052cbd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:18.146904 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15ba8e-9af3-428e-ab6e-4d727052cbd7 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:18.180740 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1136/2264] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:36:18 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:36:18.181544 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ded0d-8cb8-4ed9-879f-dfb40a92a081 service swift] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:18.194050 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ded0d-8cb8-4ed9-879f-dfb40a92a081 service swift] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:18.226755 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:18.255790 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3724a48-d244-48c0-99cd-fd10f05a5973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:18.256396 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3724a48-d244-48c0-99cd-fd10f05a5973 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:18.256716 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3724a48-d244-48c0-99cd-fd10f05a5973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:18.257083 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3724a48-d244-48c0-99cd-fd10f05a5973 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:18.257623 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3724a48-d244-48c0-99cd-fd10f05a5973 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:18.259558 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3724a48-d244-48c0-99cd-fd10f05a5973 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:18.281163 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1129/2265] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:36:18 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:36:18.285105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15ba8e-9af3-428e-ab6e-4d727052cbd7 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:18.296171 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15ba8e-9af3-428e-ab6e-4d727052cbd7 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:18.302025 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1f53a-efcc-44af-ab33-6af41d64bca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:18.302729 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1f53a-efcc-44af-ab33-6af41d64bca9 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:18.303007 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1f53a-efcc-44af-ab33-6af41d64bca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:18.303372 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1f53a-efcc-44af-ab33-6af41d64bca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:18.304172 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1f53a-efcc-44af-ab33-6af41d64bca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:18.305787 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1f53a-efcc-44af-ab33-6af41d64bca9 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:18.317294 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1137/2266] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:36:18.321291 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3724a48-d244-48c0-99cd-fd10f05a5973 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:18.332002 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3724a48-d244-48c0-99cd-fd10f05a5973 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:18.336950 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9cb8ca-2b38-45f7-a3e2-ed97e11aa635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:18.337652 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cb8ca-2b38-45f7-a3e2-ed97e11aa635 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:18.337951 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cb8ca-2b38-45f7-a3e2-ed97e11aa635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:18.338217 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cb8ca-2b38-45f7-a3e2-ed97e11aa635 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:18.338864 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9cb8ca-2b38-45f7-a3e2-ed97e11aa635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:18.340487 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9cb8ca-2b38-45f7-a3e2-ed97e11aa635 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:18.351170 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1130/2267] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:36:18.355666 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1f53a-efcc-44af-ab33-6af41d64bca9 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:18.367965 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1f53a-efcc-44af-ab33-6af41d64bca9 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:18.373362 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e81aa-e847-4560-bca6-a5bb73075e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:18.374200 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e81aa-e847-4560-bca6-a5bb73075e08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:18.374487 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e81aa-e847-4560-bca6-a5bb73075e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:18.374784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e81aa-e847-4560-bca6-a5bb73075e08 admin admin] PATH_INFO: `/v3/projects/29f9cabdb6d241258e257fc8c6b3d639/users/10c310f4bea74dbd833be3c97ac81632/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:18.391237 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e81aa-e847-4560-bca6-a5bb73075e08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29f9cabdb6d241258e257fc8c6b3d639, user_id=10c310f4bea74dbd833be3c97ac81632, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:18.393983 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e81aa-e847-4560-bca6-a5bb73075e08 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:18.407028 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1138/2268] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:36:18 2022] PUT /identity/v3/projects/29f9cabdb6d241258e257fc8c6b3d639/users/10c310f4bea74dbd833be3c97ac81632/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:36:18.418380 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81a550-3545-4229-8943-ce18e052a389 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:18.418670 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81a550-3545-4229-8943-ce18e052a389 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:18.418949 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81a550-3545-4229-8943-ce18e052a389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:18.448897 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-cb81a550-3545-4229-8943-ce18e052a389 None None] MFA Rules not processed for user `10c310f4bea74dbd833be3c97ac81632`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:36:18.450204 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-cb81a550-3545-4229-8943-ce18e052a389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:18.551098 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1131/2269] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:36:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:36:18.563882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e81aa-e847-4560-bca6-a5bb73075e08 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:18.566161 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-610e81aa-e847-4560-bca6-a5bb73075e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:18.617580 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:18.632068 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e81aa-e847-4560-bca6-a5bb73075e08 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:18.635962 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e278e-e6d6-459b-900d-15288d7f5708 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:18.636597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e278e-e6d6-459b-900d-15288d7f5708 service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:18.636928 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e278e-e6d6-459b-900d-15288d7f5708 service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:18.637238 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e278e-e6d6-459b-900d-15288d7f5708 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:18.646607 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e278e-e6d6-459b-900d-15288d7f5708 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:18.648018 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e278e-e6d6-459b-900d-15288d7f5708 service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:18.657434 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1139/2270] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:36:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:36:21.180781 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f699204-098b-44b0-a638-09d259871bd7 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:21.181301 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f699204-098b-44b0-a638-09d259871bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:21.181301 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f699204-098b-44b0-a638-09d259871bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:21.200569 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-9f699204-098b-44b0-a638-09d259871bd7 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:36:21.201766 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-9f699204-098b-44b0-a638-09d259871bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:21.262026 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1132/2271] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Nov 2 20:36:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:36:21.276508 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e278e-e6d6-459b-900d-15288d7f5708 service cinder] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:21.278032 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-ed6e278e-e6d6-459b-900d-15288d7f5708 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:21.352149 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e278e-e6d6-459b-900d-15288d7f5708 service cinder] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:21.357642 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f71fd7-64a6-4b02-b341-66b1e014b867 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:21.358250 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f71fd7-64a6-4b02-b341-66b1e014b867 service nova] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:21.358555 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f71fd7-64a6-4b02-b341-66b1e014b867 service nova] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:21.358835 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f71fd7-64a6-4b02-b341-66b1e014b867 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:21.366794 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f71fd7-64a6-4b02-b341-66b1e014b867 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:21.368372 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f71fd7-64a6-4b02-b341-66b1e014b867 service nova] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:21.378127 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1140/2272] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:36:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:36:24.342218 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f385647-2508-4436-9003-28e82d3f0143 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:24.342759 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f385647-2508-4436-9003-28e82d3f0143 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:24.342759 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f385647-2508-4436-9003-28e82d3f0143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:24.362959 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-1f385647-2508-4436-9003-28e82d3f0143 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:36:24.364175 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-1f385647-2508-4436-9003-28e82d3f0143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:24.373615 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1133/2273] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Nov 2 20:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:36:24.399066 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f71fd7-64a6-4b02-b341-66b1e014b867 service nova] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:24.400445 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-29f71fd7-64a6-4b02-b341-66b1e014b867 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:24.414842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f71fd7-64a6-4b02-b341-66b1e014b867 service nova] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:24.420670 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fb474-453b-4ef5-a11e-b088d59931d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:24.421272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fb474-453b-4ef5-a11e-b088d59931d5 service nova] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:24.421558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fb474-453b-4ef5-a11e-b088d59931d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:24.421841 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fb474-453b-4ef5-a11e-b088d59931d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:24.431253 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346fb474-453b-4ef5-a11e-b088d59931d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:24.432872 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346fb474-453b-4ef5-a11e-b088d59931d5 service nova] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:24.443600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1141/2274] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:36:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:36:27.426030 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85ffd2-ed87-40c9-89c9-738c7681fab7 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:27.426579 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85ffd2-ed87-40c9-89c9-738c7681fab7 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:27.426579 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85ffd2-ed87-40c9-89c9-738c7681fab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:27.447616 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-9f85ffd2-ed87-40c9-89c9-738c7681fab7 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:36:27.448855 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-9f85ffd2-ed87-40c9-89c9-738c7681fab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:27.457520 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1134/2275] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Nov 2 20:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:36:27.472645 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fb474-453b-4ef5-a11e-b088d59931d5 service nova] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:27.483931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fb474-453b-4ef5-a11e-b088d59931d5 service nova] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:27.489478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf180c42-ce58-43a0-a31a-97d8c2be38a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:27.490180 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf180c42-ce58-43a0-a31a-97d8c2be38a8 service nova] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:27.490351 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf180c42-ce58-43a0-a31a-97d8c2be38a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:27.490633 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf180c42-ce58-43a0-a31a-97d8c2be38a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:27.499009 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf180c42-ce58-43a0-a31a-97d8c2be38a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:27.501121 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf180c42-ce58-43a0-a31a-97d8c2be38a8 service nova] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:27.510474 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1142/2276] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:36:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:36:30.605222 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9ffdd-6446-497a-a953-893836c4eb5f None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:30.605668 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9ffdd-6446-497a-a953-893836c4eb5f None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:30.605787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9ffdd-6446-497a-a953-893836c4eb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:30.625945 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-7cd9ffdd-6446-497a-a953-893836c4eb5f None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:36:30.627203 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-7cd9ffdd-6446-497a-a953-893836c4eb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:30.635477 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1135/2277] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Nov 2 20:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:36:30.651893 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf180c42-ce58-43a0-a31a-97d8c2be38a8 service nova] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:30.663234 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf180c42-ce58-43a0-a31a-97d8c2be38a8 service nova] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:30.669275 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9cc6a2-b55b-42c3-9d6f-baf09991135a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:30.669869 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cc6a2-b55b-42c3-9d6f-baf09991135a service nova] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:30.670148 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cc6a2-b55b-42c3-9d6f-baf09991135a service nova] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:30.670426 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cc6a2-b55b-42c3-9d6f-baf09991135a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:30.679333 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9cc6a2-b55b-42c3-9d6f-baf09991135a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:30.680931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9cc6a2-b55b-42c3-9d6f-baf09991135a service nova] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:30.690789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1143/2278] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:36:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:36:40.619784 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=87,keystone:INSERT=3 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:40.686095 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=58 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:41.087733 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9ffdd-6446-497a-a953-893836c4eb5f None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:41.111791 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9ffdd-6446-497a-a953-893836c4eb5f None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:41.119285 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e3894-7db6-412f-99da-97129136876b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:41.120028 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e3894-7db6-412f-99da-97129136876b service nova] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:41.120384 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e3894-7db6-412f-99da-97129136876b service nova] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:41.123808 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e3894-7db6-412f-99da-97129136876b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:41.126322 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-8a2e3894-7db6-412f-99da-97129136876b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:41.140751 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e3894-7db6-412f-99da-97129136876b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:41.142470 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e3894-7db6-412f-99da-97129136876b service nova] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:41.160675 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1136/2279] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:36:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:36:45.928942 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32a7da-9ba7-40d3-accb-8f14ec667e0a None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:45.929456 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32a7da-9ba7-40d3-accb-8f14ec667e0a None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:45.929560 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32a7da-9ba7-40d3-accb-8f14ec667e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:45.949029 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-ed32a7da-9ba7-40d3-accb-8f14ec667e0a None None] MFA Rules not processed for user `7f4320aea5034770820eff966a4153fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:36:45.950230 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-ed32a7da-9ba7-40d3-accb-8f14ec667e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:46.005228 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1144/2280] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:36:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:36:46.429872 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e3894-7db6-412f-99da-97129136876b service nova] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:46.441288 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e3894-7db6-412f-99da-97129136876b service nova] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:46.447332 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b804bf-e433-4fce-b764-115050b2fc0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:46.448019 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b804bf-e433-4fce-b764-115050b2fc0b service nova] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:46.448393 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b804bf-e433-4fce-b764-115050b2fc0b service nova] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:46.448771 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b804bf-e433-4fce-b764-115050b2fc0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:46.450742 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-20b804bf-e433-4fce-b764-115050b2fc0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:46.517694 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b804bf-e433-4fce-b764-115050b2fc0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:46.520193 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b804bf-e433-4fce-b764-115050b2fc0b service nova] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:46.534632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1137/2281] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:36:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:36:49.695410 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32a7da-9ba7-40d3-accb-8f14ec667e0a None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:49.707699 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32a7da-9ba7-40d3-accb-8f14ec667e0a None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:49.713515 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa4fcf-8005-4b38-b59b-7374f442b202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:49.714359 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa4fcf-8005-4b38-b59b-7374f442b202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:49.714666 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa4fcf-8005-4b38-b59b-7374f442b202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:49.714944 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa4fcf-8005-4b38-b59b-7374f442b202 admin admin] PATH_INFO: `/v3/users/10c310f4bea74dbd833be3c97ac81632` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:49.716096 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa4fcf-8005-4b38-b59b-7374f442b202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10c310f4bea74dbd833be3c97ac81632)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:49.718410 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa4fcf-8005-4b38-b59b-7374f442b202 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:49.788495 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8eaa4fcf-8005-4b38-b59b-7374f442b202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10c310f4bea74dbd833be3c97ac81632'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:49.789409 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8eaa4fcf-8005-4b38-b59b-7374f442b202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10c310f4bea74dbd833be3c97ac81632'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:49.797162 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8eaa4fcf-8005-4b38-b59b-7374f442b202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10c310f4bea74dbd833be3c97ac81632'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:49.797911 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8eaa4fcf-8005-4b38-b59b-7374f442b202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10c310f4bea74dbd833be3c97ac81632'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:49.810634 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8eaa4fcf-8005-4b38-b59b-7374f442b202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10c310f4bea74dbd833be3c97ac81632'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:49.823456 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1145/2282] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:36:49 2022] DELETE /identity/v3/users/10c310f4bea74dbd833be3c97ac81632 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:36:49.827927 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bab474-3a39-41db-abf2-84822b0542a8 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:49.828400 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bab474-3a39-41db-abf2-84822b0542a8 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:49.828524 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bab474-3a39-41db-abf2-84822b0542a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:49.848067 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-33bab474-3a39-41db-abf2-84822b0542a8 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:36:49.849287 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-33bab474-3a39-41db-abf2-84822b0542a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:49.906023 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1138/2283] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:36:49.916308 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa4fcf-8005-4b38-b59b-7374f442b202 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:49.917678 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-8eaa4fcf-8005-4b38-b59b-7374f442b202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:49.979565 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa4fcf-8005-4b38-b59b-7374f442b202 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:49.983271 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0141cd9-49e5-4041-a080-7df6650ab4a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:49.983879 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0141cd9-49e5-4041-a080-7df6650ab4a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:49.984161 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0141cd9-49e5-4041-a080-7df6650ab4a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:49.984438 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0141cd9-49e5-4041-a080-7df6650ab4a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:49.994546 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0141cd9-49e5-4041-a080-7df6650ab4a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:49.995974 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0141cd9-49e5-4041-a080-7df6650ab4a9 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:50.005931 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1146/2284] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:36:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:36:50.385598 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bab474-3a39-41db-abf2-84822b0542a8 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:50.387034 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-33bab474-3a39-41db-abf2-84822b0542a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:50.399764 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bab474-3a39-41db-abf2-84822b0542a8 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:50.404408 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546a65a-f62e-42ab-9e7a-8189588b27ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:50.405088 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546a65a-f62e-42ab-9e7a-8189588b27ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:50.405371 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546a65a-f62e-42ab-9e7a-8189588b27ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:50.405649 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546a65a-f62e-42ab-9e7a-8189588b27ba admin admin] PATH_INFO: `/v3/projects/29f9cabdb6d241258e257fc8c6b3d639` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:50.406774 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546a65a-f62e-42ab-9e7a-8189588b27ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=29f9cabdb6d241258e257fc8c6b3d639)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:50.408744 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546a65a-f62e-42ab-9e7a-8189588b27ba admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:50.455171 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-0546a65a-f62e-42ab-9e7a-8189588b27ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29f9cabdb6d241258e257fc8c6b3d639', 'request_id': 'req-0546a65a-f62e-42ab-9e7a-8189588b27ba'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:50.461195 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-0546a65a-f62e-42ab-9e7a-8189588b27ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29f9cabdb6d241258e257fc8c6b3d639', 'request_id': 'req-0546a65a-f62e-42ab-9e7a-8189588b27ba'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:50.467667 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-0546a65a-f62e-42ab-9e7a-8189588b27ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29f9cabdb6d241258e257fc8c6b3d639', 'request_id': 'req-0546a65a-f62e-42ab-9e7a-8189588b27ba'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:50.480189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-0546a65a-f62e-42ab-9e7a-8189588b27ba admin admin] The token cache is being invalidate because project 29f9cabdb6d241258e257fc8c6b3d639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:36:50.480480 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-0546a65a-f62e-42ab-9e7a-8189588b27ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:50.481124 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-0546a65a-f62e-42ab-9e7a-8189588b27ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:36:50.482630 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1139/2285] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:36:50 2022] DELETE /identity/v3/projects/29f9cabdb6d241258e257fc8c6b3d639 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:36:50.487808 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a268d-1e78-473f-a901-5460a87e3927 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:50.488096 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a268d-1e78-473f-a901-5460a87e3927 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:50.488371 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a268d-1e78-473f-a901-5460a87e3927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:50.509669 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-333a268d-1e78-473f-a901-5460a87e3927 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:36:50.510859 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-333a268d-1e78-473f-a901-5460a87e3927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:50.524593 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:50.572288 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1147/2286] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:36:50.579992 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed38f4-7de0-44fc-bf12-da87e00735b3 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:50.580290 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed38f4-7de0-44fc-bf12-da87e00735b3 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:50.580596 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed38f4-7de0-44fc-bf12-da87e00735b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:50.600988 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-29ed38f4-7de0-44fc-bf12-da87e00735b3 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:36:50.602188 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-29ed38f4-7de0-44fc-bf12-da87e00735b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:50.610032 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1140/2287] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:36:50.619198 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a268d-1e78-473f-a901-5460a87e3927 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:50.629402 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a268d-1e78-473f-a901-5460a87e3927 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:50.634623 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084e297-a3b9-40fb-adec-e6697b0a596b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:50.635241 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084e297-a3b9-40fb-adec-e6697b0a596b admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:50.635504 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084e297-a3b9-40fb-adec-e6697b0a596b admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:50.635778 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084e297-a3b9-40fb-adec-e6697b0a596b admin admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:50.636428 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084e297-a3b9-40fb-adec-e6697b0a596b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:36:50.636769 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084e297-a3b9-40fb-adec-e6697b0a596b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:50.638363 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084e297-a3b9-40fb-adec-e6697b0a596b admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:50.650630 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1148/2288] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:36:50.654998 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed38f4-7de0-44fc-bf12-da87e00735b3 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:50.659751 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:50.665992 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed38f4-7de0-44fc-bf12-da87e00735b3 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:50.671694 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e6116-9dfe-42f7-a712-d9eebf228104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:50.672297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e6116-9dfe-42f7-a712-d9eebf228104 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:50.672598 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e6116-9dfe-42f7-a712-d9eebf228104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:50.672876 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e6116-9dfe-42f7-a712-d9eebf228104 admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:50.673525 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e6116-9dfe-42f7-a712-d9eebf228104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:50.675528 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e6116-9dfe-42f7-a712-d9eebf228104 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:50.703067 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1141/2289] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:36:50 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:36:50.707776 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084e297-a3b9-40fb-adec-e6697b0a596b admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:50.717762 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084e297-a3b9-40fb-adec-e6697b0a596b admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:50.774700 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026093b-c445-431c-b140-bc3fdc2fb471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:50.775342 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026093b-c445-431c-b140-bc3fdc2fb471 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:50.775630 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026093b-c445-431c-b140-bc3fdc2fb471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:50.775907 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026093b-c445-431c-b140-bc3fdc2fb471 admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:50.776596 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d026093b-c445-431c-b140-bc3fdc2fb471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:50.778501 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d026093b-c445-431c-b140-bc3fdc2fb471 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:50.801236 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1149/2290] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:36:50 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:36:50.805307 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e6116-9dfe-42f7-a712-d9eebf228104 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:50.817073 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e6116-9dfe-42f7-a712-d9eebf228104 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:50.821854 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de379917-8473-4ced-a3de-1fd32413f76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:50.822456 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de379917-8473-4ced-a3de-1fd32413f76b admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:50.822766 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de379917-8473-4ced-a3de-1fd32413f76b admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:50.823046 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de379917-8473-4ced-a3de-1fd32413f76b admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:50.823698 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de379917-8473-4ced-a3de-1fd32413f76b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:50.825388 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de379917-8473-4ced-a3de-1fd32413f76b admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:50.840533 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1142/2291] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:36:50.844401 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026093b-c445-431c-b140-bc3fdc2fb471 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:50.855296 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026093b-c445-431c-b140-bc3fdc2fb471 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:50.860278 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f0307-af58-4b19-a64b-b2b71c73eaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:50.860924 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f0307-af58-4b19-a64b-b2b71c73eaab admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:50.861204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f0307-af58-4b19-a64b-b2b71c73eaab admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:50.861481 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f0307-af58-4b19-a64b-b2b71c73eaab admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:50.862155 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f0307-af58-4b19-a64b-b2b71c73eaab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:50.864279 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f0307-af58-4b19-a64b-b2b71c73eaab admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:50.875099 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1150/2292] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:36:50.879887 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de379917-8473-4ced-a3de-1fd32413f76b admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:50.889875 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de379917-8473-4ced-a3de-1fd32413f76b admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:50.894524 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ff394-55c6-4758-8cc6-3e17207e2410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:50.895170 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ff394-55c6-4758-8cc6-3e17207e2410 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:50.895485 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ff394-55c6-4758-8cc6-3e17207e2410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:50.895768 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ff394-55c6-4758-8cc6-3e17207e2410 admin admin] PATH_INFO: `/v3/projects/ac3db4c9e3614a5f98475a38486f732f/users/f1d3b3576c174ad496c1163be57eb2be/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:50.910478 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ff394-55c6-4758-8cc6-3e17207e2410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac3db4c9e3614a5f98475a38486f732f, user_id=f1d3b3576c174ad496c1163be57eb2be, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:50.913167 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ff394-55c6-4758-8cc6-3e17207e2410 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:50.927654 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1143/2293] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:36:50 2022] PUT /identity/v3/projects/ac3db4c9e3614a5f98475a38486f732f/users/f1d3b3576c174ad496c1163be57eb2be/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:36:50.940007 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f7380-370a-4a2b-b592-7d1cfb8a231b None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:50.940388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f7380-370a-4a2b-b592-7d1cfb8a231b None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:50.940762 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f7380-370a-4a2b-b592-7d1cfb8a231b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:50.971896 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-9b2f7380-370a-4a2b-b592-7d1cfb8a231b None None] MFA Rules not processed for user `f1d3b3576c174ad496c1163be57eb2be`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:36:50.973423 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-9b2f7380-370a-4a2b-b592-7d1cfb8a231b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:51.038072 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1151/2294] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:36:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:36:51.048619 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ff394-55c6-4758-8cc6-3e17207e2410 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:51.050854 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-3f1ff394-55c6-4758-8cc6-3e17207e2410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:51.141055 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ff394-55c6-4758-8cc6-3e17207e2410 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:51.145285 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb66a00-d2c4-41f8-8c65-27e9007f0057 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:51.145940 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb66a00-d2c4-41f8-8c65-27e9007f0057 service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:51.146194 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb66a00-d2c4-41f8-8c65-27e9007f0057 service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:51.146476 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb66a00-d2c4-41f8-8c65-27e9007f0057 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:51.154942 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb66a00-d2c4-41f8-8c65-27e9007f0057 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:51.156377 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb66a00-d2c4-41f8-8c65-27e9007f0057 service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:51.165901 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1144/2295] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:36:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:36:56.820260 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee588288-b6b5-431f-88c9-ec334654bbbc None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:56.820981 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee588288-b6b5-431f-88c9-ec334654bbbc None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:56.821330 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee588288-b6b5-431f-88c9-ec334654bbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:56.842245 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-ee588288-b6b5-431f-88c9-ec334654bbbc None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:36:56.843447 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-ee588288-b6b5-431f-88c9-ec334654bbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:56.854634 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:36:56.907887 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1152/2296] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Nov 2 20:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:36:56.922482 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb66a00-d2c4-41f8-8c65-27e9007f0057 service cinder] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:36:56.924605 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-ccb66a00-d2c4-41f8-8c65-27e9007f0057 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:36:57.005818 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb66a00-d2c4-41f8-8c65-27e9007f0057 service cinder] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:36:57.011234 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1becf23d-2aaa-492a-85a1-f4d7b7191563 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:36:57.011836 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1becf23d-2aaa-492a-85a1-f4d7b7191563 service nova] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:36:57.012120 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1becf23d-2aaa-492a-85a1-f4d7b7191563 service nova] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:36:57.012396 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1becf23d-2aaa-492a-85a1-f4d7b7191563 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:36:57.020496 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1becf23d-2aaa-492a-85a1-f4d7b7191563 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:36:57.022222 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1becf23d-2aaa-492a-85a1-f4d7b7191563 service nova] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:36:57.031593 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1145/2297] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:36:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 20:37:00.093997 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee588288-b6b5-431f-88c9-ec334654bbbc None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:00.095665 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-ee588288-b6b5-431f-88c9-ec334654bbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:00.101516 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25951ae-6529-4bbe-9d18-42827ec949d9 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:00.101919 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25951ae-6529-4bbe-9d18-42827ec949d9 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:00.102096 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25951ae-6529-4bbe-9d18-42827ec949d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:00.122277 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-c25951ae-6529-4bbe-9d18-42827ec949d9 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:00.123470 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-c25951ae-6529-4bbe-9d18-42827ec949d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:00.132052 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1146/2298] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Nov 2 20:37:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:37:00.145314 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25951ae-6529-4bbe-9d18-42827ec949d9 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:00.146777 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-c25951ae-6529-4bbe-9d18-42827ec949d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:00.153958 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee588288-b6b5-431f-88c9-ec334654bbbc None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:00.158272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61bd73a-bf5e-4683-a367-4f0f9c240411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:00.158877 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bd73a-bf5e-4683-a367-4f0f9c240411 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:00.159161 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bd73a-bf5e-4683-a367-4f0f9c240411 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:00.159435 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bd73a-bf5e-4683-a367-4f0f9c240411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:00.161154 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-d61bd73a-bf5e-4683-a367-4f0f9c240411 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:00.162193 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25951ae-6529-4bbe-9d18-42827ec949d9 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:00.168036 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485ab55-a928-425b-98ea-efbb4d85dea8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:00.168747 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485ab55-a928-425b-98ea-efbb4d85dea8 service nova] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:00.169030 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485ab55-a928-425b-98ea-efbb4d85dea8 service nova] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:00.169308 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485ab55-a928-425b-98ea-efbb4d85dea8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:00.172995 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61bd73a-bf5e-4683-a367-4f0f9c240411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:00.174445 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61bd73a-bf5e-4683-a367-4f0f9c240411 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:00.177979 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485ab55-a928-425b-98ea-efbb4d85dea8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:00.179545 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485ab55-a928-425b-98ea-efbb4d85dea8 service nova] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:00.185207 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1153/2299] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:37:00.195586 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1147/2300] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:37:01.377477 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61bd73a-bf5e-4683-a367-4f0f9c240411 service neutron] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:01.390039 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61bd73a-bf5e-4683-a367-4f0f9c240411 service neutron] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:01.395599 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b27fc8-7359-4ab5-9868-c5bc9cb447b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:01.396586 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b27fc8-7359-4ab5-9868-c5bc9cb447b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:01.397021 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b27fc8-7359-4ab5-9868-c5bc9cb447b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:01.397848 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b27fc8-7359-4ab5-9868-c5bc9cb447b9 admin admin] PATH_INFO: `/v3/users/f1d3b3576c174ad496c1163be57eb2be` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:01.399178 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b27fc8-7359-4ab5-9868-c5bc9cb447b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1d3b3576c174ad496c1163be57eb2be)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:01.401480 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b27fc8-7359-4ab5-9868-c5bc9cb447b9 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:01.458169 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-65b27fc8-7359-4ab5-9868-c5bc9cb447b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1d3b3576c174ad496c1163be57eb2be'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:01.459149 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-65b27fc8-7359-4ab5-9868-c5bc9cb447b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1d3b3576c174ad496c1163be57eb2be'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:01.469423 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-65b27fc8-7359-4ab5-9868-c5bc9cb447b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1d3b3576c174ad496c1163be57eb2be'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:01.470786 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-65b27fc8-7359-4ab5-9868-c5bc9cb447b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1d3b3576c174ad496c1163be57eb2be'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:01.488665 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-65b27fc8-7359-4ab5-9868-c5bc9cb447b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1d3b3576c174ad496c1163be57eb2be'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:01.508593 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1154/2301] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:37:01 2022] DELETE /identity/v3/users/f1d3b3576c174ad496c1163be57eb2be => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:01.512220 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fcce34-37bd-40db-86b7-7314d3d94b1d None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:01.513434 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fcce34-37bd-40db-86b7-7314d3d94b1d None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:01.514400 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fcce34-37bd-40db-86b7-7314d3d94b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:01.547166 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-65fcce34-37bd-40db-86b7-7314d3d94b1d None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:01.548768 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-65fcce34-37bd-40db-86b7-7314d3d94b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:01.559902 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:01.645746 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1148/2302] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:01.658643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b27fc8-7359-4ab5-9868-c5bc9cb447b9 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:01.660618 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-65b27fc8-7359-4ab5-9868-c5bc9cb447b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:01.702277 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:01.735380 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b27fc8-7359-4ab5-9868-c5bc9cb447b9 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:01.739709 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b5b49-80db-4b03-a7c3-80022c2b506f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:01.740247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b5b49-80db-4b03-a7c3-80022c2b506f service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:01.740527 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b5b49-80db-4b03-a7c3-80022c2b506f service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:01.740892 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b5b49-80db-4b03-a7c3-80022c2b506f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:01.751362 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b5b49-80db-4b03-a7c3-80022c2b506f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:01.754293 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b5b49-80db-4b03-a7c3-80022c2b506f service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:01.764670 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1155/2303] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:37:02.169347 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fcce34-37bd-40db-86b7-7314d3d94b1d None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:02.172377 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-65fcce34-37bd-40db-86b7-7314d3d94b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:02.192189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fcce34-37bd-40db-86b7-7314d3d94b1d None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:02.198623 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b499347-aca5-43d0-ac4a-f325e8e902d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:02.201509 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b499347-aca5-43d0-ac4a-f325e8e902d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:02.202004 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b499347-aca5-43d0-ac4a-f325e8e902d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:02.204087 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b499347-aca5-43d0-ac4a-f325e8e902d0 admin admin] PATH_INFO: `/v3/projects/ac3db4c9e3614a5f98475a38486f732f` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:02.206125 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b499347-aca5-43d0-ac4a-f325e8e902d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac3db4c9e3614a5f98475a38486f732f)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:02.209460 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b499347-aca5-43d0-ac4a-f325e8e902d0 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:02.301303 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4b499347-aca5-43d0-ac4a-f325e8e902d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac3db4c9e3614a5f98475a38486f732f', 'request_id': 'req-4b499347-aca5-43d0-ac4a-f325e8e902d0'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:02.312529 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4b499347-aca5-43d0-ac4a-f325e8e902d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac3db4c9e3614a5f98475a38486f732f', 'request_id': 'req-4b499347-aca5-43d0-ac4a-f325e8e902d0'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:02.334304 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4b499347-aca5-43d0-ac4a-f325e8e902d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac3db4c9e3614a5f98475a38486f732f', 'request_id': 'req-4b499347-aca5-43d0-ac4a-f325e8e902d0'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:02.362886 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4b499347-aca5-43d0-ac4a-f325e8e902d0 admin admin] The token cache is being invalidate because project ac3db4c9e3614a5f98475a38486f732f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:37:02.366186 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4b499347-aca5-43d0-ac4a-f325e8e902d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:02.368954 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-4b499347-aca5-43d0-ac4a-f325e8e902d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:02.389150 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1149/2304] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:37:02 2022] DELETE /identity/v3/projects/ac3db4c9e3614a5f98475a38486f732f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:03.239287 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c4268-503e-4e36-9f43-b46d9348e473 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:03.239825 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c4268-503e-4e36-9f43-b46d9348e473 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:03.239911 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c4268-503e-4e36-9f43-b46d9348e473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:03.262303 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-308c4268-503e-4e36-9f43-b46d9348e473 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:03.263915 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-308c4268-503e-4e36-9f43-b46d9348e473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:03.343366 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1156/2305] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Nov 2 20:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:03.376131 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b499347-aca5-43d0-ac4a-f325e8e902d0 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:03.379557 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-4b499347-aca5-43d0-ac4a-f325e8e902d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:03.467309 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b499347-aca5-43d0-ac4a-f325e8e902d0 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:03.475212 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf477f-cfb9-43e0-8d72-c6209c2a98c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:03.475819 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf477f-cfb9-43e0-8d72-c6209c2a98c5 service nova] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:03.476100 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf477f-cfb9-43e0-8d72-c6209c2a98c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:03.476373 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf477f-cfb9-43e0-8d72-c6209c2a98c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:03.487616 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf477f-cfb9-43e0-8d72-c6209c2a98c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:03.489368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf477f-cfb9-43e0-8d72-c6209c2a98c5 service nova] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:03.513763 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1150/2306] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:37:03.750059 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c4268-503e-4e36-9f43-b46d9348e473 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:03.752283 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-308c4268-503e-4e36-9f43-b46d9348e473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:03.822000 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf477f-cfb9-43e0-8d72-c6209c2a98c5 service nova] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:03.823404 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-fcaf477f-cfb9-43e0-8d72-c6209c2a98c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:03.833808 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c4268-503e-4e36-9f43-b46d9348e473 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:03.838894 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd5202-fec0-492f-8d75-1e925fb5688d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603a9f31ae814003a2cbd02f964f4ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:03.839539 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd5202-fec0-492f-8d75-1e925fb5688d service placement] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:03.839822 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd5202-fec0-492f-8d75-1e925fb5688d service placement] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:03.840096 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd5202-fec0-492f-8d75-1e925fb5688d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:03.841976 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-98dd5202-fec0-492f-8d75-1e925fb5688d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:03.843259 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf477f-cfb9-43e0-8d72-c6209c2a98c5 service nova] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:03.850853 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa29570-9e5f-4b55-a53f-f7925850a526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:03.851698 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa29570-9e5f-4b55-a53f-f7925850a526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:03.853025 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa29570-9e5f-4b55-a53f-f7925850a526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:03.853431 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa29570-9e5f-4b55-a53f-f7925850a526 admin admin] PATH_INFO: `/v3/users/13d6d307bd3b436f9f18be0e762038fd` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:03.854750 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd5202-fec0-492f-8d75-1e925fb5688d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:03.855038 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa29570-9e5f-4b55-a53f-f7925850a526 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13d6d307bd3b436f9f18be0e762038fd)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:03.856719 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd5202-fec0-492f-8d75-1e925fb5688d service placement] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:03.857081 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa29570-9e5f-4b55-a53f-f7925850a526 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:03.873857 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1157/2307] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:37:03.877685 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:03.932199 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-dfa29570-9e5f-4b55-a53f-f7925850a526 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13d6d307bd3b436f9f18be0e762038fd'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:03.932923 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-dfa29570-9e5f-4b55-a53f-f7925850a526 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13d6d307bd3b436f9f18be0e762038fd'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:03.946951 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-dfa29570-9e5f-4b55-a53f-f7925850a526 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13d6d307bd3b436f9f18be0e762038fd'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:03.947685 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-dfa29570-9e5f-4b55-a53f-f7925850a526 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13d6d307bd3b436f9f18be0e762038fd'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:03.955078 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-dfa29570-9e5f-4b55-a53f-f7925850a526 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13d6d307bd3b436f9f18be0e762038fd'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:03.968224 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1151/2308] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:37:03 2022] DELETE /identity/v3/users/13d6d307bd3b436f9f18be0e762038fd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:37:04.140195 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd5202-fec0-492f-8d75-1e925fb5688d service placement] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:04.154851 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd5202-fec0-492f-8d75-1e925fb5688d service placement] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:04.213374 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4d650-a4ec-4696-82ed-97416a9abe6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:04.214157 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4d650-a4ec-4696-82ed-97416a9abe6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:04.214450 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4d650-a4ec-4696-82ed-97416a9abe6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:04.214734 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4d650-a4ec-4696-82ed-97416a9abe6d admin admin] PATH_INFO: `/v3/projects/913a0bf1570e4f328034a0aa7ae59d74` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:04.215860 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4d650-a4ec-4696-82ed-97416a9abe6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=913a0bf1570e4f328034a0aa7ae59d74)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:04.217790 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4d650-a4ec-4696-82ed-97416a9abe6d admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:04.225270 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:04.266099 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-c7a4d650-a4ec-4696-82ed-97416a9abe6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '913a0bf1570e4f328034a0aa7ae59d74', 'request_id': 'req-c7a4d650-a4ec-4696-82ed-97416a9abe6d'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:04.272394 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-c7a4d650-a4ec-4696-82ed-97416a9abe6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '913a0bf1570e4f328034a0aa7ae59d74', 'request_id': 'req-c7a4d650-a4ec-4696-82ed-97416a9abe6d'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:04.279055 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-c7a4d650-a4ec-4696-82ed-97416a9abe6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '913a0bf1570e4f328034a0aa7ae59d74', 'request_id': 'req-c7a4d650-a4ec-4696-82ed-97416a9abe6d'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:04.290590 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-c7a4d650-a4ec-4696-82ed-97416a9abe6d admin admin] The token cache is being invalidate because project 913a0bf1570e4f328034a0aa7ae59d74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:37:04.290884 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-c7a4d650-a4ec-4696-82ed-97416a9abe6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:04.291530 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-c7a4d650-a4ec-4696-82ed-97416a9abe6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:04.293043 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1158/2309] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:37:04 2022] DELETE /identity/v3/projects/913a0bf1570e4f328034a0aa7ae59d74 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:04.298828 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776f787-a518-4e98-886f-f33fbfea8200 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:04.299123 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776f787-a518-4e98-886f-f33fbfea8200 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:04.299406 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776f787-a518-4e98-886f-f33fbfea8200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:04.319951 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-b776f787-a518-4e98-886f-f33fbfea8200 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:04.321308 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-b776f787-a518-4e98-886f-f33fbfea8200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:04.380891 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1152/2310] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:04.388672 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2518e2-f35d-4310-97a5-a08b71fa334d None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:04.388897 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2518e2-f35d-4310-97a5-a08b71fa334d None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:04.389176 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2518e2-f35d-4310-97a5-a08b71fa334d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:04.409022 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-2a2518e2-f35d-4310-97a5-a08b71fa334d None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:04.410853 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-2a2518e2-f35d-4310-97a5-a08b71fa334d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:04.418609 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1159/2311] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:04.422812 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776f787-a518-4e98-886f-f33fbfea8200 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:04.432384 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776f787-a518-4e98-886f-f33fbfea8200 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:04.436923 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fbb36-c4bd-4a9f-8d88-9f593a8d1770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:04.437549 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fbb36-c4bd-4a9f-8d88-9f593a8d1770 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:04.437806 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fbb36-c4bd-4a9f-8d88-9f593a8d1770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:04.438091 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fbb36-c4bd-4a9f-8d88-9f593a8d1770 admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:04.438735 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fbb36-c4bd-4a9f-8d88-9f593a8d1770 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:37:04.439046 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fbb36-c4bd-4a9f-8d88-9f593a8d1770 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:04.440673 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fbb36-c4bd-4a9f-8d88-9f593a8d1770 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:04.452292 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1153/2312] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:37:04.456410 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2518e2-f35d-4310-97a5-a08b71fa334d None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:04.466085 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2518e2-f35d-4310-97a5-a08b71fa334d None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:04.470977 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c858c4e-5367-403a-bae9-b9e1812909ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:04.471548 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c858c4e-5367-403a-bae9-b9e1812909ac admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:04.471830 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c858c4e-5367-403a-bae9-b9e1812909ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:04.472106 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c858c4e-5367-403a-bae9-b9e1812909ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:04.473330 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c858c4e-5367-403a-bae9-b9e1812909ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:04.475212 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c858c4e-5367-403a-bae9-b9e1812909ac admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:04.502293 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1160/2313] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:37:04 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:37:04.506333 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fbb36-c4bd-4a9f-8d88-9f593a8d1770 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:04.516121 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fbb36-c4bd-4a9f-8d88-9f593a8d1770 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:04.572468 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16326777-5dab-4e95-9298-ebe2519ad1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:04.573100 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16326777-5dab-4e95-9298-ebe2519ad1c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:04.573383 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16326777-5dab-4e95-9298-ebe2519ad1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:04.573661 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16326777-5dab-4e95-9298-ebe2519ad1c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:04.574283 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16326777-5dab-4e95-9298-ebe2519ad1c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:04.576198 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16326777-5dab-4e95-9298-ebe2519ad1c5 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:04.600163 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1154/2314] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:37:04 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:37:04.603454 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c858c4e-5367-403a-bae9-b9e1812909ac admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:04.614529 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c858c4e-5367-403a-bae9-b9e1812909ac admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:04.619856 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a31846-e6d3-4b59-ab0f-097fa5310a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:04.620830 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a31846-e6d3-4b59-ab0f-097fa5310a96 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:04.621120 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a31846-e6d3-4b59-ab0f-097fa5310a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:04.621400 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a31846-e6d3-4b59-ab0f-097fa5310a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:04.622049 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a31846-e6d3-4b59-ab0f-097fa5310a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:04.623651 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a31846-e6d3-4b59-ab0f-097fa5310a96 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:04.637296 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1161/2315] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:37:04.638500 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16326777-5dab-4e95-9298-ebe2519ad1c5 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:04.667338 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16326777-5dab-4e95-9298-ebe2519ad1c5 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:04.673644 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13444eb7-1f62-4adb-8d39-5aeffda9045c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:04.674258 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13444eb7-1f62-4adb-8d39-5aeffda9045c admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:04.674537 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13444eb7-1f62-4adb-8d39-5aeffda9045c admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:04.674816 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13444eb7-1f62-4adb-8d39-5aeffda9045c admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:04.675464 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13444eb7-1f62-4adb-8d39-5aeffda9045c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:04.677204 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13444eb7-1f62-4adb-8d39-5aeffda9045c admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:04.682868 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:04.689428 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1155/2316] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:37:04.694167 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a31846-e6d3-4b59-ab0f-097fa5310a96 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:04.704962 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a31846-e6d3-4b59-ab0f-097fa5310a96 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:04.710686 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36735c-5e10-4a74-aaf6-a6d25fa3d8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:04.711347 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36735c-5e10-4a74-aaf6-a6d25fa3d8dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:04.711652 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36735c-5e10-4a74-aaf6-a6d25fa3d8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:04.711933 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36735c-5e10-4a74-aaf6-a6d25fa3d8dd admin admin] PATH_INFO: `/v3/projects/4426700b0e184b86bad0b64faa6102a4/users/c281552b4424475db617c2ff20c6bd84/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:04.726748 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36735c-5e10-4a74-aaf6-a6d25fa3d8dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4426700b0e184b86bad0b64faa6102a4, user_id=c281552b4424475db617c2ff20c6bd84, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:04.729437 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36735c-5e10-4a74-aaf6-a6d25fa3d8dd admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:04.742789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1162/2317] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:37:04 2022] PUT /identity/v3/projects/4426700b0e184b86bad0b64faa6102a4/users/c281552b4424475db617c2ff20c6bd84/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:04.753176 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa24fff-5512-4f7a-ac81-bf28105b836f None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:04.754059 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa24fff-5512-4f7a-ac81-bf28105b836f None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:04.754346 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa24fff-5512-4f7a-ac81-bf28105b836f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:04.781394 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-cfa24fff-5512-4f7a-ac81-bf28105b836f None None] MFA Rules not processed for user `c281552b4424475db617c2ff20c6bd84`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:04.782610 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-cfa24fff-5512-4f7a-ac81-bf28105b836f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:04.846544 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1156/2318] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:04.851530 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36735c-5e10-4a74-aaf6-a6d25fa3d8dd admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:04.912510 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36735c-5e10-4a74-aaf6-a6d25fa3d8dd admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:04.917114 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8b052-7639-4082-af63-ea4921d072b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:04.917715 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8b052-7639-4082-af63-ea4921d072b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:04.918001 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8b052-7639-4082-af63-ea4921d072b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:04.918286 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8b052-7639-4082-af63-ea4921d072b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:04.918928 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c8b052-7639-4082-af63-ea4921d072b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:04.920851 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c8b052-7639-4082-af63-ea4921d072b3 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:04.947148 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1163/2319] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:37:04 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:37:04.950831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa24fff-5512-4f7a-ac81-bf28105b836f None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:04.961678 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa24fff-5512-4f7a-ac81-bf28105b836f None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:05.021195 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6e3eb-7c12-4a4b-9d47-48e9746cb10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:05.021816 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6e3eb-7c12-4a4b-9d47-48e9746cb10c admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:05.022102 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6e3eb-7c12-4a4b-9d47-48e9746cb10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:05.022383 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6e3eb-7c12-4a4b-9d47-48e9746cb10c admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:05.023020 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6e3eb-7c12-4a4b-9d47-48e9746cb10c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:05.025015 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6e3eb-7c12-4a4b-9d47-48e9746cb10c admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:05.052172 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1157/2320] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:37:04 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:37:05.053477 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8b052-7639-4082-af63-ea4921d072b3 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:05.064960 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8b052-7639-4082-af63-ea4921d072b3 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:05.071129 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc07cd0-c955-4c46-bc0e-8418970a3e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:05.072526 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc07cd0-c955-4c46-bc0e-8418970a3e3d admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:05.072908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc07cd0-c955-4c46-bc0e-8418970a3e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:05.073422 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc07cd0-c955-4c46-bc0e-8418970a3e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:05.074258 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc07cd0-c955-4c46-bc0e-8418970a3e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:05.076053 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc07cd0-c955-4c46-bc0e-8418970a3e3d admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:05.087382 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1164/2321] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:37:05.091418 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6e3eb-7c12-4a4b-9d47-48e9746cb10c admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:05.105196 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6e3eb-7c12-4a4b-9d47-48e9746cb10c admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:05.110811 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ac64f-9b9d-4558-8516-969a10b80845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:05.111535 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ac64f-9b9d-4558-8516-969a10b80845 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:05.111769 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ac64f-9b9d-4558-8516-969a10b80845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:05.112062 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ac64f-9b9d-4558-8516-969a10b80845 admin admin] PATH_INFO: `/v3/projects/b84768f5ebdc42289c07827e76e77158/users/3c7d095b63704ef18d28fd5c9140f399/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:05.129152 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ac64f-9b9d-4558-8516-969a10b80845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b84768f5ebdc42289c07827e76e77158, user_id=3c7d095b63704ef18d28fd5c9140f399, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:05.131821 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ac64f-9b9d-4558-8516-969a10b80845 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:05.146754 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1158/2322] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:37:05 2022] PUT /identity/v3/projects/b84768f5ebdc42289c07827e76e77158/users/3c7d095b63704ef18d28fd5c9140f399/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:05.150946 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc07cd0-c955-4c46-bc0e-8418970a3e3d admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:05.157426 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:05.162371 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc07cd0-c955-4c46-bc0e-8418970a3e3d admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:05.224198 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6fd40-6e3e-4829-ba53-42ce8b14842b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:05.224846 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6fd40-6e3e-4829-ba53-42ce8b14842b admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:05.225122 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6fd40-6e3e-4829-ba53-42ce8b14842b admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:05.225395 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6fd40-6e3e-4829-ba53-42ce8b14842b admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:05.226745 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6fd40-6e3e-4829-ba53-42ce8b14842b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:05.227790 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6fd40-6e3e-4829-ba53-42ce8b14842b admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:05.247603 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1165/2323] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:37:05.251707 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ac64f-9b9d-4558-8516-969a10b80845 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:05.273042 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ac64f-9b9d-4558-8516-969a10b80845 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:05.279108 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caeeecd-e99c-4480-a2f6-2434d744eb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:05.279865 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caeeecd-e99c-4480-a2f6-2434d744eb6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:05.280220 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caeeecd-e99c-4480-a2f6-2434d744eb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:05.280656 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caeeecd-e99c-4480-a2f6-2434d744eb6a admin admin] PATH_INFO: `/v3/projects/b84768f5ebdc42289c07827e76e77158/users/3c7d095b63704ef18d28fd5c9140f399/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:05.282680 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caeeecd-e99c-4480-a2f6-2434d744eb6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b84768f5ebdc42289c07827e76e77158, user_id=3c7d095b63704ef18d28fd5c9140f399, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:05.285948 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caeeecd-e99c-4480-a2f6-2434d744eb6a admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:05.296731 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1159/2324] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:37:05 2022] PUT /identity/v3/projects/b84768f5ebdc42289c07827e76e77158/users/3c7d095b63704ef18d28fd5c9140f399/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:05.308691 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a58c9-0936-4187-93d2-7f9e006bfe21 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:05.309303 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a58c9-0936-4187-93d2-7f9e006bfe21 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:05.309303 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a58c9-0936-4187-93d2-7f9e006bfe21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:05.338051 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-158a58c9-0936-4187-93d2-7f9e006bfe21 None None] MFA Rules not processed for user `3c7d095b63704ef18d28fd5c9140f399`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:05.339270 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-158a58c9-0936-4187-93d2-7f9e006bfe21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:05.408541 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1166/2325] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:05 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:05.420931 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caeeecd-e99c-4480-a2f6-2434d744eb6a admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:05.422920 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-4caeeecd-e99c-4480-a2f6-2434d744eb6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:05.471905 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:05.485934 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caeeecd-e99c-4480-a2f6-2434d744eb6a admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:05.489792 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e5993-86bd-4638-a0e1-ad79093aa270 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:05.490397 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e5993-86bd-4638-a0e1-ad79093aa270 service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:05.490681 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e5993-86bd-4638-a0e1-ad79093aa270 service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:05.490961 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e5993-86bd-4638-a0e1-ad79093aa270 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:05.562887 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e5993-86bd-4638-a0e1-ad79093aa270 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:05.564320 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e5993-86bd-4638-a0e1-ad79093aa270 service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:05.573742 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1160/2326] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:37:06.413767 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef36a0-76f0-4508-8e32-b7f3b9701dd9 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:06.414265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef36a0-76f0-4508-8e32-b7f3b9701dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:06.414351 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef36a0-76f0-4508-8e32-b7f3b9701dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:06.435238 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-b2ef36a0-76f0-4508-8e32-b7f3b9701dd9 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:06.436437 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-b2ef36a0-76f0-4508-8e32-b7f3b9701dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:06.508281 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1167/2327] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Nov 2 20:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:06.530909 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e5993-86bd-4638-a0e1-ad79093aa270 service cinder] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:06.532525 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-f39e5993-86bd-4638-a0e1-ad79093aa270 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:06.613342 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e5993-86bd-4638-a0e1-ad79093aa270 service cinder] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:06.620465 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51260bfc-6b08-4f46-b661-65309e2baf4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:06.621120 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51260bfc-6b08-4f46-b661-65309e2baf4d service nova] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:06.621405 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51260bfc-6b08-4f46-b661-65309e2baf4d service nova] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:06.621679 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51260bfc-6b08-4f46-b661-65309e2baf4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:06.631753 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51260bfc-6b08-4f46-b661-65309e2baf4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:06.633690 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51260bfc-6b08-4f46-b661-65309e2baf4d service nova] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:06.643631 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1161/2328] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:37:06.975316 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef36a0-76f0-4508-8e32-b7f3b9701dd9 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:06.985497 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef36a0-76f0-4508-8e32-b7f3b9701dd9 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:06.990231 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eace503-947a-4b85-bd08-0346cac8e878 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:06.990924 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eace503-947a-4b85-bd08-0346cac8e878 service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:06.991276 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eace503-947a-4b85-bd08-0346cac8e878 service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:06.991623 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eace503-947a-4b85-bd08-0346cac8e878 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:07.001123 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eace503-947a-4b85-bd08-0346cac8e878 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:07.002574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eace503-947a-4b85-bd08-0346cac8e878 service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:07.012584 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1168/2329] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:06 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:37:09.593386 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c560ed8-0d5d-4acb-9e60-4a43744a79f2 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:09.594189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c560ed8-0d5d-4acb-9e60-4a43744a79f2 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:09.594473 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c560ed8-0d5d-4acb-9e60-4a43744a79f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:09.615614 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-8c560ed8-0d5d-4acb-9e60-4a43744a79f2 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:09.616864 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-8c560ed8-0d5d-4acb-9e60-4a43744a79f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:09.624816 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1162/2330] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Nov 2 20:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:09.640457 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eace503-947a-4b85-bd08-0346cac8e878 service cinder] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:09.645428 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-8eace503-947a-4b85-bd08-0346cac8e878 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:09.663845 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eace503-947a-4b85-bd08-0346cac8e878 service cinder] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:09.669672 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e51c9c-a9e4-4c42-a312-9b3a709fce35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f906fd11db004026a78eb3d69fa5b298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:09.670285 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e51c9c-a9e4-4c42-a312-9b3a709fce35 service nova] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:09.670567 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e51c9c-a9e4-4c42-a312-9b3a709fce35 service nova] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:09.670847 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e51c9c-a9e4-4c42-a312-9b3a709fce35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:09.679677 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e51c9c-a9e4-4c42-a312-9b3a709fce35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:09.681306 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e51c9c-a9e4-4c42-a312-9b3a709fce35 service nova] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:09.686298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:09.692438 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1169/2331] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:37:10.474957 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c560ed8-0d5d-4acb-9e60-4a43744a79f2 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:10.476451 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-8c560ed8-0d5d-4acb-9e60-4a43744a79f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:10.537428 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c560ed8-0d5d-4acb-9e60-4a43744a79f2 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:10.541055 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250d1bd-66fd-45e3-9aa4-7f616c69c6af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:10.541707 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250d1bd-66fd-45e3-9aa4-7f616c69c6af service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:10.541987 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250d1bd-66fd-45e3-9aa4-7f616c69c6af service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:10.542264 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250d1bd-66fd-45e3-9aa4-7f616c69c6af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:10.543947 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-7250d1bd-66fd-45e3-9aa4-7f616c69c6af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:10.555853 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250d1bd-66fd-45e3-9aa4-7f616c69c6af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:10.557305 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250d1bd-66fd-45e3-9aa4-7f616c69c6af service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:10.567646 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1163/2332] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:37:10.814120 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e51c9c-a9e4-4c42-a312-9b3a709fce35 service nova] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:10.823859 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e51c9c-a9e4-4c42-a312-9b3a709fce35 service nova] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:10.828904 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725b68a-a1fb-401d-9da7-cbe6e7d2ea24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:10.829599 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725b68a-a1fb-401d-9da7-cbe6e7d2ea24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:10.829948 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725b68a-a1fb-401d-9da7-cbe6e7d2ea24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:10.830231 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725b68a-a1fb-401d-9da7-cbe6e7d2ea24 admin admin] PATH_INFO: `/v3/users/c281552b4424475db617c2ff20c6bd84` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:10.831386 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725b68a-a1fb-401d-9da7-cbe6e7d2ea24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c281552b4424475db617c2ff20c6bd84)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:10.833331 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725b68a-a1fb-401d-9da7-cbe6e7d2ea24 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:10.881140 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-2725b68a-a1fb-401d-9da7-cbe6e7d2ea24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c281552b4424475db617c2ff20c6bd84'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:10.881806 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-2725b68a-a1fb-401d-9da7-cbe6e7d2ea24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c281552b4424475db617c2ff20c6bd84'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:10.888736 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-2725b68a-a1fb-401d-9da7-cbe6e7d2ea24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c281552b4424475db617c2ff20c6bd84'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:10.889391 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-2725b68a-a1fb-401d-9da7-cbe6e7d2ea24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c281552b4424475db617c2ff20c6bd84'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:10.902442 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-2725b68a-a1fb-401d-9da7-cbe6e7d2ea24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c281552b4424475db617c2ff20c6bd84'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:10.916131 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1170/2333] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:37:10 2022] DELETE /identity/v3/users/c281552b4424475db617c2ff20c6bd84 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:10.921028 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a1705-0744-4bbb-9959-b9b22daa8c25 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:10.921529 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a1705-0744-4bbb-9959-b9b22daa8c25 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:10.921777 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a1705-0744-4bbb-9959-b9b22daa8c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:10.941777 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-416a1705-0744-4bbb-9959-b9b22daa8c25 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:10.942971 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-416a1705-0744-4bbb-9959-b9b22daa8c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:10.954770 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:11.004845 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1164/2334] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:11.015117 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725b68a-a1fb-401d-9da7-cbe6e7d2ea24 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:11.016511 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-2725b68a-a1fb-401d-9da7-cbe6e7d2ea24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:11.080478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725b68a-a1fb-401d-9da7-cbe6e7d2ea24 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:11.084465 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cbed5-9430-4e86-87db-22708c4e43cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:11.085209 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cbed5-9430-4e86-87db-22708c4e43cb service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:11.085560 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cbed5-9430-4e86-87db-22708c4e43cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:11.086021 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cbed5-9430-4e86-87db-22708c4e43cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:11.096710 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159cbed5-9430-4e86-87db-22708c4e43cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:11.098938 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159cbed5-9430-4e86-87db-22708c4e43cb service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:11.110566 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1171/2335] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:37:11.405552 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a1705-0744-4bbb-9959-b9b22daa8c25 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:11.407145 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-416a1705-0744-4bbb-9959-b9b22daa8c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:11.420438 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a1705-0744-4bbb-9959-b9b22daa8c25 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:11.426223 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92d29c-9fa9-40b1-a65b-a9791fbf2527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:11.426965 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92d29c-9fa9-40b1-a65b-a9791fbf2527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:11.427348 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92d29c-9fa9-40b1-a65b-a9791fbf2527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:11.427727 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92d29c-9fa9-40b1-a65b-a9791fbf2527 admin admin] PATH_INFO: `/v3/projects/4426700b0e184b86bad0b64faa6102a4` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:11.429133 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92d29c-9fa9-40b1-a65b-a9791fbf2527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4426700b0e184b86bad0b64faa6102a4)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:11.431323 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92d29c-9fa9-40b1-a65b-a9791fbf2527 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:11.481637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-cd92d29c-9fa9-40b1-a65b-a9791fbf2527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4426700b0e184b86bad0b64faa6102a4', 'request_id': 'req-cd92d29c-9fa9-40b1-a65b-a9791fbf2527'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:11.487185 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-cd92d29c-9fa9-40b1-a65b-a9791fbf2527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4426700b0e184b86bad0b64faa6102a4', 'request_id': 'req-cd92d29c-9fa9-40b1-a65b-a9791fbf2527'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:11.494046 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-cd92d29c-9fa9-40b1-a65b-a9791fbf2527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4426700b0e184b86bad0b64faa6102a4', 'request_id': 'req-cd92d29c-9fa9-40b1-a65b-a9791fbf2527'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:11.507006 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-cd92d29c-9fa9-40b1-a65b-a9791fbf2527 admin admin] The token cache is being invalidate because project 4426700b0e184b86bad0b64faa6102a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:37:11.507301 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-cd92d29c-9fa9-40b1-a65b-a9791fbf2527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:11.507937 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-cd92d29c-9fa9-40b1-a65b-a9791fbf2527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:11.509475 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1165/2336] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:37:11 2022] DELETE /identity/v3/projects/4426700b0e184b86bad0b64faa6102a4 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:11.513639 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cbed5-9430-4e86-87db-22708c4e43cb service neutron] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:11.524214 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cbed5-9430-4e86-87db-22708c4e43cb service neutron] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:11.582317 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d73b2-bd68-4dc6-92b4-7f8d50d71c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:11.582954 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d73b2-bd68-4dc6-92b4-7f8d50d71c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:11.583234 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d73b2-bd68-4dc6-92b4-7f8d50d71c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:11.583511 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d73b2-bd68-4dc6-92b4-7f8d50d71c4d admin admin] PATH_INFO: `/v3/users/3c7d095b63704ef18d28fd5c9140f399` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:11.584664 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d73b2-bd68-4dc6-92b4-7f8d50d71c4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c7d095b63704ef18d28fd5c9140f399)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:11.586594 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d73b2-bd68-4dc6-92b4-7f8d50d71c4d admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:11.604183 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:11.640007 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-382d73b2-bd68-4dc6-92b4-7f8d50d71c4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c7d095b63704ef18d28fd5c9140f399'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:11.646402 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-382d73b2-bd68-4dc6-92b4-7f8d50d71c4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c7d095b63704ef18d28fd5c9140f399'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:11.653820 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-382d73b2-bd68-4dc6-92b4-7f8d50d71c4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c7d095b63704ef18d28fd5c9140f399'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:11.654511 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-382d73b2-bd68-4dc6-92b4-7f8d50d71c4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c7d095b63704ef18d28fd5c9140f399'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:11.667812 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-382d73b2-bd68-4dc6-92b4-7f8d50d71c4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c7d095b63704ef18d28fd5c9140f399'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:11.682827 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1172/2337] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:37:11 2022] DELETE /identity/v3/users/3c7d095b63704ef18d28fd5c9140f399 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:12.001332 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92d29c-9fa9-40b1-a65b-a9791fbf2527 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:12.002817 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-cd92d29c-9fa9-40b1-a65b-a9791fbf2527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:12.020244 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92d29c-9fa9-40b1-a65b-a9791fbf2527 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:12.101194 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c7b6f-da76-4892-8750-e812f875feeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:12.102391 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c7b6f-da76-4892-8750-e812f875feeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:12.102798 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c7b6f-da76-4892-8750-e812f875feeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:12.103440 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c7b6f-da76-4892-8750-e812f875feeb admin admin] PATH_INFO: `/v3/projects/b84768f5ebdc42289c07827e76e77158` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:12.104804 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c7b6f-da76-4892-8750-e812f875feeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b84768f5ebdc42289c07827e76e77158)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:12.107739 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c7b6f-da76-4892-8750-e812f875feeb admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:12.164335 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:12.168645 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-8d2c7b6f-da76-4892-8750-e812f875feeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b84768f5ebdc42289c07827e76e77158', 'request_id': 'req-8d2c7b6f-da76-4892-8750-e812f875feeb'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:12.178327 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-8d2c7b6f-da76-4892-8750-e812f875feeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b84768f5ebdc42289c07827e76e77158', 'request_id': 'req-8d2c7b6f-da76-4892-8750-e812f875feeb'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:12.185814 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-8d2c7b6f-da76-4892-8750-e812f875feeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b84768f5ebdc42289c07827e76e77158', 'request_id': 'req-8d2c7b6f-da76-4892-8750-e812f875feeb'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:12.203424 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-8d2c7b6f-da76-4892-8750-e812f875feeb admin admin] The token cache is being invalidate because project b84768f5ebdc42289c07827e76e77158 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:37:12.203795 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-8d2c7b6f-da76-4892-8750-e812f875feeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:12.204449 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-8d2c7b6f-da76-4892-8750-e812f875feeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:12.206656 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1166/2338] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:37:12 2022] DELETE /identity/v3/projects/b84768f5ebdc42289c07827e76e77158 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:37:12.212805 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08821491-4bb7-43f2-a39a-f53fe533ade8 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:12.213259 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08821491-4bb7-43f2-a39a-f53fe533ade8 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:12.213551 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08821491-4bb7-43f2-a39a-f53fe533ade8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:12.235322 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-08821491-4bb7-43f2-a39a-f53fe533ade8 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:12.237129 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-08821491-4bb7-43f2-a39a-f53fe533ade8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:12.329180 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1173/2339] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:12.332392 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25d52e-83d1-487e-a373-f4ea047fd8a5 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:12.332754 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25d52e-83d1-487e-a373-f4ea047fd8a5 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:12.333133 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25d52e-83d1-487e-a373-f4ea047fd8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:12.366258 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-6e25d52e-83d1-487e-a373-f4ea047fd8a5 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:12.369048 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-6e25d52e-83d1-487e-a373-f4ea047fd8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:12.384216 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1167/2340] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:12.387379 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08821491-4bb7-43f2-a39a-f53fe533ade8 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:12.398320 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08821491-4bb7-43f2-a39a-f53fe533ade8 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:12.403305 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2afdd-f3a1-44dc-9337-2ad4bc01663d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:12.403937 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2afdd-f3a1-44dc-9337-2ad4bc01663d admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:12.404221 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2afdd-f3a1-44dc-9337-2ad4bc01663d admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:12.404502 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2afdd-f3a1-44dc-9337-2ad4bc01663d admin admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:12.405204 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2afdd-f3a1-44dc-9337-2ad4bc01663d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:37:12.405515 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2afdd-f3a1-44dc-9337-2ad4bc01663d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:12.407136 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2afdd-f3a1-44dc-9337-2ad4bc01663d admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:12.426972 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1174/2341] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:37:12.428090 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25d52e-83d1-487e-a373-f4ea047fd8a5 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:12.440971 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25d52e-83d1-487e-a373-f4ea047fd8a5 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:12.446717 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d24bffd-4f96-44f4-8024-ace9e80b8ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:12.447471 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24bffd-4f96-44f4-8024-ace9e80b8ed8 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:12.447754 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24bffd-4f96-44f4-8024-ace9e80b8ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:12.448030 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24bffd-4f96-44f4-8024-ace9e80b8ed8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:12.448724 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d24bffd-4f96-44f4-8024-ace9e80b8ed8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:12.450652 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d24bffd-4f96-44f4-8024-ace9e80b8ed8 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:12.494372 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2afdd-f3a1-44dc-9337-2ad4bc01663d admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:12.500920 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1168/2342] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:37:12 2022] POST /identity/v3/projects => generated 381 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:37:12.507754 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2afdd-f3a1-44dc-9337-2ad4bc01663d admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:12.595643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61d2d0-2f0e-4f4b-ba8c-e9a958b4b8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:12.596286 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61d2d0-2f0e-4f4b-ba8c-e9a958b4b8c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:12.596590 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61d2d0-2f0e-4f4b-ba8c-e9a958b4b8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:12.596889 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61d2d0-2f0e-4f4b-ba8c-e9a958b4b8c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:12.599525 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61d2d0-2f0e-4f4b-ba8c-e9a958b4b8c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:12.599988 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61d2d0-2f0e-4f4b-ba8c-e9a958b4b8c7 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:12.632015 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1175/2343] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:37:12 2022] POST /identity/v3/users => generated 291 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:37:12.633368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d24bffd-4f96-44f4-8024-ace9e80b8ed8 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:12.649247 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d24bffd-4f96-44f4-8024-ace9e80b8ed8 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:12.662139 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23774063-ecbe-419c-aa3e-ed5831799e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:12.665966 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23774063-ecbe-419c-aa3e-ed5831799e24 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:12.666890 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23774063-ecbe-419c-aa3e-ed5831799e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:12.666890 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23774063-ecbe-419c-aa3e-ed5831799e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:12.667629 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23774063-ecbe-419c-aa3e-ed5831799e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:12.669391 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23774063-ecbe-419c-aa3e-ed5831799e24 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:12.704022 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1169/2344] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:37:12.708397 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61d2d0-2f0e-4f4b-ba8c-e9a958b4b8c7 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:12.724750 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61d2d0-2f0e-4f4b-ba8c-e9a958b4b8c7 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:12.736780 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c46f7-01f8-47fc-b7bc-7a97484aec17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:12.737509 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c46f7-01f8-47fc-b7bc-7a97484aec17 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:12.737828 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c46f7-01f8-47fc-b7bc-7a97484aec17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:12.738155 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c46f7-01f8-47fc-b7bc-7a97484aec17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:12.738844 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c46f7-01f8-47fc-b7bc-7a97484aec17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:12.740627 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c46f7-01f8-47fc-b7bc-7a97484aec17 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:12.749335 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:12.771761 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1176/2345] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:37:12.775972 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23774063-ecbe-419c-aa3e-ed5831799e24 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:12.794093 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23774063-ecbe-419c-aa3e-ed5831799e24 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:12.803568 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c61d6-6c76-454c-9efa-a50a247b4409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:12.804522 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c61d6-6c76-454c-9efa-a50a247b4409 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:12.805083 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c61d6-6c76-454c-9efa-a50a247b4409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:12.806765 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c61d6-6c76-454c-9efa-a50a247b4409 admin admin] PATH_INFO: `/v3/projects/23de0549329d4b54ab2db3367f2a04fd/users/fc2683d378cc47c8a85ec33713b00e0b/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:12.830375 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120c61d6-6c76-454c-9efa-a50a247b4409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23de0549329d4b54ab2db3367f2a04fd, user_id=fc2683d378cc47c8a85ec33713b00e0b, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:12.834528 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120c61d6-6c76-454c-9efa-a50a247b4409 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:12.859733 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1170/2346] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:37:12 2022] PUT /identity/v3/projects/23de0549329d4b54ab2db3367f2a04fd/users/fc2683d378cc47c8a85ec33713b00e0b/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:12.874846 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052dc57a-36d6-4be0-8606-d78ddf90f245 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:12.875507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052dc57a-36d6-4be0-8606-d78ddf90f245 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:12.875819 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052dc57a-36d6-4be0-8606-d78ddf90f245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:12.934841 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-052dc57a-36d6-4be0-8606-d78ddf90f245 None None] MFA Rules not processed for user `fc2683d378cc47c8a85ec33713b00e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:12.936089 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-052dc57a-36d6-4be0-8606-d78ddf90f245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:13.041851 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1177/2347] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:13.046222 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c61d6-6c76-454c-9efa-a50a247b4409 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:13.130575 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c61d6-6c76-454c-9efa-a50a247b4409 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:13.136000 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfe936-f589-4569-8747-a1bd0761577e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:13.136724 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfe936-f589-4569-8747-a1bd0761577e admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:13.137082 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfe936-f589-4569-8747-a1bd0761577e admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:13.137500 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfe936-f589-4569-8747-a1bd0761577e admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:13.138246 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bfe936-f589-4569-8747-a1bd0761577e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:13.140413 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bfe936-f589-4569-8747-a1bd0761577e admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:13.168608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1171/2348] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:37:13 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:37:13.173534 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052dc57a-36d6-4be0-8606-d78ddf90f245 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:13.185606 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052dc57a-36d6-4be0-8606-d78ddf90f245 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:13.248351 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d847d-6fb1-48f5-8f5d-c10188f17336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:13.249249 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d847d-6fb1-48f5-8f5d-c10188f17336 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:13.249640 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d847d-6fb1-48f5-8f5d-c10188f17336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:13.249924 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d847d-6fb1-48f5-8f5d-c10188f17336 admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:13.250573 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d847d-6fb1-48f5-8f5d-c10188f17336 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:13.254597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d847d-6fb1-48f5-8f5d-c10188f17336 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:13.282584 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1178/2349] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:37:13 2022] POST /identity/v3/users => generated 297 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:37:13.287447 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfe936-f589-4569-8747-a1bd0761577e admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:13.301528 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfe936-f589-4569-8747-a1bd0761577e admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:13.306582 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4fd81-2f23-4165-8fbb-9456e6177028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:13.307531 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4fd81-2f23-4165-8fbb-9456e6177028 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:13.307911 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4fd81-2f23-4165-8fbb-9456e6177028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:13.308596 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4fd81-2f23-4165-8fbb-9456e6177028 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:13.309298 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4fd81-2f23-4165-8fbb-9456e6177028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:13.311015 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4fd81-2f23-4165-8fbb-9456e6177028 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:13.329199 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d847d-6fb1-48f5-8f5d-c10188f17336 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:13.334544 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1172/2350] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:37:13.342004 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d847d-6fb1-48f5-8f5d-c10188f17336 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:13.347896 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f64e1-e699-4480-ade6-404f80556bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:13.348599 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f64e1-e699-4480-ade6-404f80556bab admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:13.348888 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f64e1-e699-4480-ade6-404f80556bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:13.349169 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f64e1-e699-4480-ade6-404f80556bab admin admin] PATH_INFO: `/v3/projects/48ae1ce7f1df4d63a364b192412002ba/users/39d442010c19419dbbdb94b47cdb93b7/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:13.366921 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f64e1-e699-4480-ade6-404f80556bab admin admin] RBAC: Authorizing `identity:create_grant(project_id=48ae1ce7f1df4d63a364b192412002ba, user_id=39d442010c19419dbbdb94b47cdb93b7, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:13.370248 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f64e1-e699-4480-ade6-404f80556bab admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:13.391607 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1179/2351] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:37:13 2022] PUT /identity/v3/projects/48ae1ce7f1df4d63a364b192412002ba/users/39d442010c19419dbbdb94b47cdb93b7/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:13.396606 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4fd81-2f23-4165-8fbb-9456e6177028 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:13.408280 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4fd81-2f23-4165-8fbb-9456e6177028 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:13.455347 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:13.479845 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f836b-6b6f-4a26-8b47-83d8dad4610a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:13.480752 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f836b-6b6f-4a26-8b47-83d8dad4610a admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:13.481039 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f836b-6b6f-4a26-8b47-83d8dad4610a admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:13.481319 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f836b-6b6f-4a26-8b47-83d8dad4610a admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:13.481995 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f836b-6b6f-4a26-8b47-83d8dad4610a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:13.483603 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f836b-6b6f-4a26-8b47-83d8dad4610a admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:13.495532 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1173/2352] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:37:13.500148 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f64e1-e699-4480-ade6-404f80556bab admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:13.514373 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f64e1-e699-4480-ade6-404f80556bab admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:13.530624 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546005b0-691e-4997-bfc7-9f62dd3938df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:13.532767 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546005b0-691e-4997-bfc7-9f62dd3938df admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:13.533555 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546005b0-691e-4997-bfc7-9f62dd3938df admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:13.534039 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546005b0-691e-4997-bfc7-9f62dd3938df admin admin] PATH_INFO: `/v3/projects/48ae1ce7f1df4d63a364b192412002ba/users/39d442010c19419dbbdb94b47cdb93b7/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:13.536881 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546005b0-691e-4997-bfc7-9f62dd3938df admin admin] RBAC: Authorizing `identity:create_grant(project_id=48ae1ce7f1df4d63a364b192412002ba, user_id=39d442010c19419dbbdb94b47cdb93b7, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:13.541406 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546005b0-691e-4997-bfc7-9f62dd3938df admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:13.558116 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1180/2353] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:37:13 2022] PUT /identity/v3/projects/48ae1ce7f1df4d63a364b192412002ba/users/39d442010c19419dbbdb94b47cdb93b7/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:37:13.568600 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97932a2d-8265-43e1-b3f9-48a56ba08c2b None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:13.569076 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97932a2d-8265-43e1-b3f9-48a56ba08c2b None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:13.569361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97932a2d-8265-43e1-b3f9-48a56ba08c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:13.619478 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-97932a2d-8265-43e1-b3f9-48a56ba08c2b None None] MFA Rules not processed for user `39d442010c19419dbbdb94b47cdb93b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:13.620904 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-97932a2d-8265-43e1-b3f9-48a56ba08c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:13.716823 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1174/2354] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:13 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:13.731882 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546005b0-691e-4997-bfc7-9f62dd3938df admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:13.735209 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-546005b0-691e-4997-bfc7-9f62dd3938df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:13.801491 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:13.814689 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546005b0-691e-4997-bfc7-9f62dd3938df admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:13.819632 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd279b4-3aee-4d42-91ff-7d11d00b506f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:13.820324 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd279b4-3aee-4d42-91ff-7d11d00b506f service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:13.820767 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd279b4-3aee-4d42-91ff-7d11d00b506f service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:13.821242 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd279b4-3aee-4d42-91ff-7d11d00b506f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:13.831572 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd279b4-3aee-4d42-91ff-7d11d00b506f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:13.833620 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd279b4-3aee-4d42-91ff-7d11d00b506f service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:13.844466 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1181/2355] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:37:14.208254 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97932a2d-8265-43e1-b3f9-48a56ba08c2b None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:14.210202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-97932a2d-8265-43e1-b3f9-48a56ba08c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:14.308933 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97932a2d-8265-43e1-b3f9-48a56ba08c2b None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:14.314071 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb465bd9-65f1-432e-85fe-b7a4f7fe9695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:14.314876 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb465bd9-65f1-432e-85fe-b7a4f7fe9695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:14.315358 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb465bd9-65f1-432e-85fe-b7a4f7fe9695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:14.315693 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb465bd9-65f1-432e-85fe-b7a4f7fe9695 admin admin] PATH_INFO: `/v3/users/469b5cd3abf74c7984dd02faa1abfcd8` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:14.317557 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb465bd9-65f1-432e-85fe-b7a4f7fe9695 admin admin] RBAC: Authorizing `identity:delete_user(user_id=469b5cd3abf74c7984dd02faa1abfcd8)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:14.319828 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb465bd9-65f1-432e-85fe-b7a4f7fe9695 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:14.342509 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd279b4-3aee-4d42-91ff-7d11d00b506f service cinder] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:14.357881 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd279b4-3aee-4d42-91ff-7d11d00b506f service cinder] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:14.365090 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ce7cd-14d1-498e-a4ce-6915cebdd30d tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d442010c19419dbbdb94b47cdb93b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48ae1ce7f1df4d63a364b192412002ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:14.366069 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ce7cd-14d1-498e-a4ce-6915cebdd30d tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:14.366360 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ce7cd-14d1-498e-a4ce-6915cebdd30d tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:14.366666 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ce7cd-14d1-498e-a4ce-6915cebdd30d tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:14.367310 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ce7cd-14d1-498e-a4ce-6915cebdd30d tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:37:14.367625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ce7cd-14d1-498e-a4ce-6915cebdd30d tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:14.369320 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ce7cd-14d1-498e-a4ce-6915cebdd30d tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:14.380793 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-fb465bd9-65f1-432e-85fe-b7a4f7fe9695 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '469b5cd3abf74c7984dd02faa1abfcd8'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:14.381907 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-fb465bd9-65f1-432e-85fe-b7a4f7fe9695 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '469b5cd3abf74c7984dd02faa1abfcd8'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:14.382647 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1182/2356] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:37:14.386922 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ce7cd-14d1-498e-a4ce-6915cebdd30d tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:14.398104 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-fb465bd9-65f1-432e-85fe-b7a4f7fe9695 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '469b5cd3abf74c7984dd02faa1abfcd8'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:14.398430 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ce7cd-14d1-498e-a4ce-6915cebdd30d tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:14.398854 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-fb465bd9-65f1-432e-85fe-b7a4f7fe9695 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '469b5cd3abf74c7984dd02faa1abfcd8'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:14.400515 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:14.403897 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144707a-a5ff-4c3a-8e58-d2d799fac907 tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d442010c19419dbbdb94b47cdb93b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48ae1ce7f1df4d63a364b192412002ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:14.404638 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144707a-a5ff-4c3a-8e58-d2d799fac907 tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:14.404995 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144707a-a5ff-4c3a-8e58-d2d799fac907 tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:14.405358 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144707a-a5ff-4c3a-8e58-d2d799fac907 tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:14.406074 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144707a-a5ff-4c3a-8e58-d2d799fac907 tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:14.408091 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144707a-a5ff-4c3a-8e58-d2d799fac907 tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:14.409737 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-fb465bd9-65f1-432e-85fe-b7a4f7fe9695 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '469b5cd3abf74c7984dd02faa1abfcd8'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:14.440584 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1183/2357] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:37:14 2022] POST /identity/v3/projects => generated 355 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:37:14.443086 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1175/2358] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:37:14 2022] DELETE /identity/v3/users/469b5cd3abf74c7984dd02faa1abfcd8 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:14.447255 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144707a-a5ff-4c3a-8e58-d2d799fac907 tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:14.449187 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-4144707a-a5ff-4c3a-8e58-d2d799fac907 tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:14.533531 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144707a-a5ff-4c3a-8e58-d2d799fac907 tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:14.593684 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f2b17-1747-418b-968d-abb7736012a5 tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d442010c19419dbbdb94b47cdb93b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48ae1ce7f1df4d63a364b192412002ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:14.594316 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f2b17-1747-418b-968d-abb7736012a5 tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:14.594602 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f2b17-1747-418b-968d-abb7736012a5 tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:14.594881 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f2b17-1747-418b-968d-abb7736012a5 tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:14.595796 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f2b17-1747-418b-968d-abb7736012a5 tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:37:14.596107 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f2b17-1747-418b-968d-abb7736012a5 tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:14.598534 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f2b17-1747-418b-968d-abb7736012a5 tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:14.610714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1184/2359] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:37:14.649667 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb465bd9-65f1-432e-85fe-b7a4f7fe9695 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:14.662408 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb465bd9-65f1-432e-85fe-b7a4f7fe9695 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:14.667052 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec290a-b6f5-4207-8b52-221115f13486 tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d442010c19419dbbdb94b47cdb93b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48ae1ce7f1df4d63a364b192412002ba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:14.667776 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec290a-b6f5-4207-8b52-221115f13486 tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:14.668062 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec290a-b6f5-4207-8b52-221115f13486 tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:14.668339 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec290a-b6f5-4207-8b52-221115f13486 tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] PATH_INFO: `/v3/projects/1357b69349a24f82b2e0b22d9a3edfd2` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:14.669505 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec290a-b6f5-4207-8b52-221115f13486 tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1357b69349a24f82b2e0b22d9a3edfd2)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:14.671417 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec290a-b6f5-4207-8b52-221115f13486 tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:14.719971 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f2b17-1747-418b-968d-abb7736012a5 tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:14.723035 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-d70f2b17-1747-418b-968d-abb7736012a5 tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:14.731862 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-53ec290a-b6f5-4207-8b52-221115f13486 tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1357b69349a24f82b2e0b22d9a3edfd2', 'request_id': 'req-53ec290a-b6f5-4207-8b52-221115f13486'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:14.740041 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-53ec290a-b6f5-4207-8b52-221115f13486 tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1357b69349a24f82b2e0b22d9a3edfd2', 'request_id': 'req-53ec290a-b6f5-4207-8b52-221115f13486'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:14.746939 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-53ec290a-b6f5-4207-8b52-221115f13486 tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1357b69349a24f82b2e0b22d9a3edfd2', 'request_id': 'req-53ec290a-b6f5-4207-8b52-221115f13486'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:14.763917 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-53ec290a-b6f5-4207-8b52-221115f13486 tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] The token cache is being invalidate because project 1357b69349a24f82b2e0b22d9a3edfd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:37:14.764211 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-53ec290a-b6f5-4207-8b52-221115f13486 tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:14.764873 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-53ec290a-b6f5-4207-8b52-221115f13486 tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:14.766373 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1176/2360] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:37:14 2022] DELETE /identity/v3/projects/1357b69349a24f82b2e0b22d9a3edfd2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:14.777633 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:14.795314 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f2b17-1747-418b-968d-abb7736012a5 tempest-VolumeQuotaClassesTest-1970799797 tempest-VolumeQuotaClassesTest-1970799797-project-admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:14.857975 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57510a-52f0-4e32-8bca-34f9c8b217cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:14.858654 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57510a-52f0-4e32-8bca-34f9c8b217cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:14.859014 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57510a-52f0-4e32-8bca-34f9c8b217cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:14.859304 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57510a-52f0-4e32-8bca-34f9c8b217cb admin admin] PATH_INFO: `/v3/projects/75583f05294e4e5d87ac76c0352d290c` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:14.860541 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57510a-52f0-4e32-8bca-34f9c8b217cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=75583f05294e4e5d87ac76c0352d290c)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:14.862810 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57510a-52f0-4e32-8bca-34f9c8b217cb admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:14.913353 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-4d57510a-52f0-4e32-8bca-34f9c8b217cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75583f05294e4e5d87ac76c0352d290c', 'request_id': 'req-4d57510a-52f0-4e32-8bca-34f9c8b217cb'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:14.919832 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-4d57510a-52f0-4e32-8bca-34f9c8b217cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75583f05294e4e5d87ac76c0352d290c', 'request_id': 'req-4d57510a-52f0-4e32-8bca-34f9c8b217cb'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:14.927866 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-4d57510a-52f0-4e32-8bca-34f9c8b217cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75583f05294e4e5d87ac76c0352d290c', 'request_id': 'req-4d57510a-52f0-4e32-8bca-34f9c8b217cb'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:14.938922 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-4d57510a-52f0-4e32-8bca-34f9c8b217cb admin admin] The token cache is being invalidate because project 75583f05294e4e5d87ac76c0352d290c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:37:14.939209 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-4d57510a-52f0-4e32-8bca-34f9c8b217cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:14.939849 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-4d57510a-52f0-4e32-8bca-34f9c8b217cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:14.941652 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1185/2361] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:37:14 2022] DELETE /identity/v3/projects/75583f05294e4e5d87ac76c0352d290c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:37:14.946483 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5599e-f008-4e31-b3a8-c51f69bde598 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:14.946828 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5599e-f008-4e31-b3a8-c51f69bde598 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:14.947105 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5599e-f008-4e31-b3a8-c51f69bde598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:14.968284 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-55b5599e-f008-4e31-b3a8-c51f69bde598 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:14.969518 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-55b5599e-f008-4e31-b3a8-c51f69bde598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:14.977601 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57510a-52f0-4e32-8bca-34f9c8b217cb admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:14.979045 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-4d57510a-52f0-4e32-8bca-34f9c8b217cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:15.032737 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1177/2362] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:15.041601 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584159ba-e74d-48ef-af19-183806d2463a None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:15.041893 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584159ba-e74d-48ef-af19-183806d2463a None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:15.042172 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584159ba-e74d-48ef-af19-183806d2463a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:15.048212 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57510a-52f0-4e32-8bca-34f9c8b217cb admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:15.052869 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b839d2-78cd-4d7a-8083-ca2f4855a708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:15.053493 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b839d2-78cd-4d7a-8083-ca2f4855a708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:15.053840 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b839d2-78cd-4d7a-8083-ca2f4855a708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:15.054042 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b839d2-78cd-4d7a-8083-ca2f4855a708 admin admin] PATH_INFO: `/v3/users/fc2683d378cc47c8a85ec33713b00e0b` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:15.055140 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b839d2-78cd-4d7a-8083-ca2f4855a708 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc2683d378cc47c8a85ec33713b00e0b)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:15.057076 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b839d2-78cd-4d7a-8083-ca2f4855a708 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:15.062032 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-584159ba-e74d-48ef-af19-183806d2463a None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:15.063221 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-584159ba-e74d-48ef-af19-183806d2463a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:15.071207 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1178/2363] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:37:15.075526 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584159ba-e74d-48ef-af19-183806d2463a None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:15.085928 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584159ba-e74d-48ef-af19-183806d2463a None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:15.091298 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33f2d8-76b7-437a-bddd-e3a94bbcf72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:15.091984 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33f2d8-76b7-437a-bddd-e3a94bbcf72c admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:15.092263 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33f2d8-76b7-437a-bddd-e3a94bbcf72c admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:15.092539 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33f2d8-76b7-437a-bddd-e3a94bbcf72c admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:15.093245 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33f2d8-76b7-437a-bddd-e3a94bbcf72c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:37:15.093598 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33f2d8-76b7-437a-bddd-e3a94bbcf72c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:15.094086 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:15.095591 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33f2d8-76b7-437a-bddd-e3a94bbcf72c admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:15.112059 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1179/2364] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:37:15.113077 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33f2d8-76b7-437a-bddd-e3a94bbcf72c admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:15.114027 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-f8b839d2-78cd-4d7a-8083-ca2f4855a708 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc2683d378cc47c8a85ec33713b00e0b'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:15.114729 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-f8b839d2-78cd-4d7a-8083-ca2f4855a708 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc2683d378cc47c8a85ec33713b00e0b'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:15.121860 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-f8b839d2-78cd-4d7a-8083-ca2f4855a708 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc2683d378cc47c8a85ec33713b00e0b'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:15.122528 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-f8b839d2-78cd-4d7a-8083-ca2f4855a708 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc2683d378cc47c8a85ec33713b00e0b'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:15.122896 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33f2d8-76b7-437a-bddd-e3a94bbcf72c admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:15.127729 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10db07-6107-4741-909e-1206b89bb1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:15.128298 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10db07-6107-4741-909e-1206b89bb1b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:15.128595 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10db07-6107-4741-909e-1206b89bb1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:15.128902 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10db07-6107-4741-909e-1206b89bb1b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:15.129519 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10db07-6107-4741-909e-1206b89bb1b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:15.131432 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10db07-6107-4741-909e-1206b89bb1b6 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:15.134335 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-f8b839d2-78cd-4d7a-8083-ca2f4855a708 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc2683d378cc47c8a85ec33713b00e0b'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:15.148027 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1186/2365] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:37:14 2022] DELETE /identity/v3/users/fc2683d378cc47c8a85ec33713b00e0b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:37:15.152777 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505a7f4-782a-4bd7-8a4d-84cc7f4e0a14 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:15.153075 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505a7f4-782a-4bd7-8a4d-84cc7f4e0a14 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:15.153355 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505a7f4-782a-4bd7-8a4d-84cc7f4e0a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:15.160826 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1180/2366] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:37:15 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:37:15.165097 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10db07-6107-4741-909e-1206b89bb1b6 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:15.166674 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-bd10db07-6107-4741-909e-1206b89bb1b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:15.174574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-3505a7f4-782a-4bd7-8a4d-84cc7f4e0a14 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:15.175798 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-3505a7f4-782a-4bd7-8a4d-84cc7f4e0a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:15.193796 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:15.233651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10db07-6107-4741-909e-1206b89bb1b6 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:15.235826 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1187/2367] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:37:15.238544 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03316b-87a7-4cd7-9a3a-9a095c6de654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:15.239153 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03316b-87a7-4cd7-9a3a-9a095c6de654 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:15.239437 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03316b-87a7-4cd7-9a3a-9a095c6de654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:15.239719 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03316b-87a7-4cd7-9a3a-9a095c6de654 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:15.240338 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03316b-87a7-4cd7-9a3a-9a095c6de654 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:15.242353 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03316b-87a7-4cd7-9a3a-9a095c6de654 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:15.245796 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505a7f4-782a-4bd7-8a4d-84cc7f4e0a14 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:15.247144 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-3505a7f4-782a-4bd7-8a4d-84cc7f4e0a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:15.266361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1181/2368] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:37:15 2022] POST /identity/v3/users => generated 284 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:37:15.271444 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03316b-87a7-4cd7-9a3a-9a095c6de654 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:15.281361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03316b-87a7-4cd7-9a3a-9a095c6de654 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:15.285984 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9a8dd-1673-47a1-b1ad-a28a44e32c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:15.286561 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9a8dd-1673-47a1-b1ad-a28a44e32c1f admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:15.286841 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9a8dd-1673-47a1-b1ad-a28a44e32c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:15.287236 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9a8dd-1673-47a1-b1ad-a28a44e32c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:15.287870 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9a8dd-1673-47a1-b1ad-a28a44e32c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:15.289485 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9a8dd-1673-47a1-b1ad-a28a44e32c1f admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:15.299390 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1182/2369] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:37:15.303302 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9a8dd-1673-47a1-b1ad-a28a44e32c1f admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:15.309661 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505a7f4-782a-4bd7-8a4d-84cc7f4e0a14 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:15.312860 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9a8dd-1673-47a1-b1ad-a28a44e32c1f admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:15.313632 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4781842-5b00-42af-ad9c-280e7aa9542b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:15.314324 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4781842-5b00-42af-ad9c-280e7aa9542b service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:15.314609 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4781842-5b00-42af-ad9c-280e7aa9542b service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:15.314879 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4781842-5b00-42af-ad9c-280e7aa9542b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:15.318465 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0dd10-4bfa-4e9d-8de3-3a2dd891f4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:15.319226 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0dd10-4bfa-4e9d-8de3-3a2dd891f4eb admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:15.319557 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0dd10-4bfa-4e9d-8de3-3a2dd891f4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:15.320045 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0dd10-4bfa-4e9d-8de3-3a2dd891f4eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:15.320869 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0dd10-4bfa-4e9d-8de3-3a2dd891f4eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:15.322794 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0dd10-4bfa-4e9d-8de3-3a2dd891f4eb admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:15.326571 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4781842-5b00-42af-ad9c-280e7aa9542b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:15.328095 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4781842-5b00-42af-ad9c-280e7aa9542b service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:15.337376 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1183/2370] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:37:15.337917 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1188/2371] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:37:15.338655 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0dd10-4bfa-4e9d-8de3-3a2dd891f4eb admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:15.349417 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0dd10-4bfa-4e9d-8de3-3a2dd891f4eb admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:15.354217 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed5c4a-7732-41f9-94d5-14ca33212a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:15.354867 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed5c4a-7732-41f9-94d5-14ca33212a37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:15.355156 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed5c4a-7732-41f9-94d5-14ca33212a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:15.355435 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed5c4a-7732-41f9-94d5-14ca33212a37 admin admin] PATH_INFO: `/v3/projects/b869b4d2cc9c49919c2d9611ecff9d64/users/5a17ee7865bc4323836069d5677e4477/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:15.370823 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed5c4a-7732-41f9-94d5-14ca33212a37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b869b4d2cc9c49919c2d9611ecff9d64, user_id=5a17ee7865bc4323836069d5677e4477, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:15.373459 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed5c4a-7732-41f9-94d5-14ca33212a37 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:15.387950 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1184/2372] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:37:15 2022] PUT /identity/v3/projects/b869b4d2cc9c49919c2d9611ecff9d64/users/5a17ee7865bc4323836069d5677e4477/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:15.399118 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa06424-707d-4cdf-99fd-e0b7f8ed4e93 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:15.399681 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa06424-707d-4cdf-99fd-e0b7f8ed4e93 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:15.399926 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa06424-707d-4cdf-99fd-e0b7f8ed4e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:15.430331 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-2aa06424-707d-4cdf-99fd-e0b7f8ed4e93 None None] MFA Rules not processed for user `5a17ee7865bc4323836069d5677e4477`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:15.431552 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-2aa06424-707d-4cdf-99fd-e0b7f8ed4e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:15.475273 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:15.505620 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1189/2373] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:37:15.517687 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed5c4a-7732-41f9-94d5-14ca33212a37 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:15.519516 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-7bed5c4a-7732-41f9-94d5-14ca33212a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:15.585719 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed5c4a-7732-41f9-94d5-14ca33212a37 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:15.590729 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6b1b3-df3d-461a-b560-e368ccad06a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:15.591196 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6b1b3-df3d-461a-b560-e368ccad06a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:15.591483 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6b1b3-df3d-461a-b560-e368ccad06a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:15.591760 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6b1b3-df3d-461a-b560-e368ccad06a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:15.602597 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6b1b3-df3d-461a-b560-e368ccad06a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:15.604117 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6b1b3-df3d-461a-b560-e368ccad06a7 service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:15.614983 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1185/2374] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:37:15.646301 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa06424-707d-4cdf-99fd-e0b7f8ed4e93 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:15.648170 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-2aa06424-707d-4cdf-99fd-e0b7f8ed4e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:15.724403 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa06424-707d-4cdf-99fd-e0b7f8ed4e93 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:15.729769 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be293a-3ace-45c7-a04e-972df3c13965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:15.730479 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be293a-3ace-45c7-a04e-972df3c13965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:15.730834 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be293a-3ace-45c7-a04e-972df3c13965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:15.731181 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be293a-3ace-45c7-a04e-972df3c13965 admin admin] PATH_INFO: `/v3/projects/23de0549329d4b54ab2db3367f2a04fd` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:15.732415 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be293a-3ace-45c7-a04e-972df3c13965 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23de0549329d4b54ab2db3367f2a04fd)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:15.735218 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be293a-3ace-45c7-a04e-972df3c13965 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:15.799448 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-f3be293a-3ace-45c7-a04e-972df3c13965 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23de0549329d4b54ab2db3367f2a04fd', 'request_id': 'req-f3be293a-3ace-45c7-a04e-972df3c13965'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:15.808371 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-f3be293a-3ace-45c7-a04e-972df3c13965 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23de0549329d4b54ab2db3367f2a04fd', 'request_id': 'req-f3be293a-3ace-45c7-a04e-972df3c13965'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:15.818300 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-f3be293a-3ace-45c7-a04e-972df3c13965 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23de0549329d4b54ab2db3367f2a04fd', 'request_id': 'req-f3be293a-3ace-45c7-a04e-972df3c13965'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:15.831162 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-f3be293a-3ace-45c7-a04e-972df3c13965 admin admin] The token cache is being invalidate because project 23de0549329d4b54ab2db3367f2a04fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:37:15.831671 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-f3be293a-3ace-45c7-a04e-972df3c13965 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:15.833104 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-f3be293a-3ace-45c7-a04e-972df3c13965 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:15.835101 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1190/2375] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:37:15 2022] DELETE /identity/v3/projects/23de0549329d4b54ab2db3367f2a04fd => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:15.839140 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6b1b3-df3d-461a-b560-e368ccad06a7 service cinder] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:15.854730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6b1b3-df3d-461a-b560-e368ccad06a7 service cinder] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:15.923963 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48daa552-7b5b-4b2f-9525-1718f8a259d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:15.924722 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48daa552-7b5b-4b2f-9525-1718f8a259d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:15.925072 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48daa552-7b5b-4b2f-9525-1718f8a259d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:15.925417 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48daa552-7b5b-4b2f-9525-1718f8a259d9 admin admin] PATH_INFO: `/v3/users/39d442010c19419dbbdb94b47cdb93b7` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:15.926620 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48daa552-7b5b-4b2f-9525-1718f8a259d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39d442010c19419dbbdb94b47cdb93b7)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:15.930172 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48daa552-7b5b-4b2f-9525-1718f8a259d9 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:15.944107 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:15.983157 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-48daa552-7b5b-4b2f-9525-1718f8a259d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39d442010c19419dbbdb94b47cdb93b7'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:15.983815 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-48daa552-7b5b-4b2f-9525-1718f8a259d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39d442010c19419dbbdb94b47cdb93b7'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:15.996693 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-48daa552-7b5b-4b2f-9525-1718f8a259d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39d442010c19419dbbdb94b47cdb93b7'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:15.997483 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-48daa552-7b5b-4b2f-9525-1718f8a259d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39d442010c19419dbbdb94b47cdb93b7'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:16.006216 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-48daa552-7b5b-4b2f-9525-1718f8a259d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39d442010c19419dbbdb94b47cdb93b7'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:16.019298 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1186/2376] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:37:15 2022] DELETE /identity/v3/users/39d442010c19419dbbdb94b47cdb93b7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:16.283222 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be293a-3ace-45c7-a04e-972df3c13965 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:16.284703 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-f3be293a-3ace-45c7-a04e-972df3c13965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:16.298222 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be293a-3ace-45c7-a04e-972df3c13965 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:16.359478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f455b-e9df-4a80-89b3-c3647d46cc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:16.360122 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f455b-e9df-4a80-89b3-c3647d46cc7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:16.360407 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f455b-e9df-4a80-89b3-c3647d46cc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:16.360732 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f455b-e9df-4a80-89b3-c3647d46cc7e admin admin] PATH_INFO: `/v3/projects/48ae1ce7f1df4d63a364b192412002ba` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:16.364673 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f455b-e9df-4a80-89b3-c3647d46cc7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=48ae1ce7f1df4d63a364b192412002ba)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:16.366700 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f455b-e9df-4a80-89b3-c3647d46cc7e admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:16.378185 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:16.417689 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0c6f455b-e9df-4a80-89b3-c3647d46cc7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48ae1ce7f1df4d63a364b192412002ba', 'request_id': 'req-0c6f455b-e9df-4a80-89b3-c3647d46cc7e'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:16.424067 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0c6f455b-e9df-4a80-89b3-c3647d46cc7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48ae1ce7f1df4d63a364b192412002ba', 'request_id': 'req-0c6f455b-e9df-4a80-89b3-c3647d46cc7e'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:16.433470 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0c6f455b-e9df-4a80-89b3-c3647d46cc7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48ae1ce7f1df4d63a364b192412002ba', 'request_id': 'req-0c6f455b-e9df-4a80-89b3-c3647d46cc7e'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:16.446321 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0c6f455b-e9df-4a80-89b3-c3647d46cc7e admin admin] The token cache is being invalidate because project 48ae1ce7f1df4d63a364b192412002ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:37:16.446727 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0c6f455b-e9df-4a80-89b3-c3647d46cc7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:16.447520 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0c6f455b-e9df-4a80-89b3-c3647d46cc7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:16.449169 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1191/2377] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:37:16 2022] DELETE /identity/v3/projects/48ae1ce7f1df4d63a364b192412002ba => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:16.454433 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27980924-8966-42c8-b3e7-8176010d09c9 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:16.454893 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27980924-8966-42c8-b3e7-8176010d09c9 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:16.455146 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27980924-8966-42c8-b3e7-8176010d09c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:16.477224 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-27980924-8966-42c8-b3e7-8176010d09c9 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:16.478638 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-27980924-8966-42c8-b3e7-8176010d09c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:16.540672 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1187/2378] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:16.548505 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d14c1a-7889-464b-ac32-ec017bbc320d None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:16.548900 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d14c1a-7889-464b-ac32-ec017bbc320d None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:16.549286 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d14c1a-7889-464b-ac32-ec017bbc320d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:16.570971 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-22d14c1a-7889-464b-ac32-ec017bbc320d None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:16.572437 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-22d14c1a-7889-464b-ac32-ec017bbc320d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:16.580603 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1192/2379] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:16.584899 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27980924-8966-42c8-b3e7-8176010d09c9 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:16.594733 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27980924-8966-42c8-b3e7-8176010d09c9 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:16.599700 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda1534-bdef-46ed-bd8b-fd986059e6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:16.600389 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda1534-bdef-46ed-bd8b-fd986059e6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:16.600713 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda1534-bdef-46ed-bd8b-fd986059e6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:16.600997 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda1534-bdef-46ed-bd8b-fd986059e6a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:16.601653 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda1534-bdef-46ed-bd8b-fd986059e6a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:37:16.602024 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda1534-bdef-46ed-bd8b-fd986059e6a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:16.603635 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda1534-bdef-46ed-bd8b-fd986059e6a4 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:16.617012 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1188/2380] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:37:16.621313 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d14c1a-7889-464b-ac32-ec017bbc320d None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:16.631374 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d14c1a-7889-464b-ac32-ec017bbc320d None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:16.636128 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa305ec-08e5-4151-a738-273e5d40c3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:16.636769 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa305ec-08e5-4151-a738-273e5d40c3e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:16.637057 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa305ec-08e5-4151-a738-273e5d40c3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:16.637337 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa305ec-08e5-4151-a738-273e5d40c3e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:16.637973 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa305ec-08e5-4151-a738-273e5d40c3e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:16.639866 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa305ec-08e5-4151-a738-273e5d40c3e9 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:16.667369 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1193/2381] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:37:16 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:37:16.671491 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda1534-bdef-46ed-bd8b-fd986059e6a4 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:16.681809 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda1534-bdef-46ed-bd8b-fd986059e6a4 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:16.737806 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2fac5d-7f0b-428d-b2c8-abd98937408c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:16.739143 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fac5d-7f0b-428d-b2c8-abd98937408c admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:16.739426 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fac5d-7f0b-428d-b2c8-abd98937408c admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:16.739699 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fac5d-7f0b-428d-b2c8-abd98937408c admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:16.740317 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2fac5d-7f0b-428d-b2c8-abd98937408c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:16.742282 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2fac5d-7f0b-428d-b2c8-abd98937408c admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:16.763160 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1189/2382] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:37:16 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:37:16.767228 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa305ec-08e5-4151-a738-273e5d40c3e9 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:16.777892 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa305ec-08e5-4151-a738-273e5d40c3e9 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:16.782527 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399b6f1-a71f-44b3-b454-9a468ad69d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:16.783147 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399b6f1-a71f-44b3-b454-9a468ad69d3e admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:16.783426 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399b6f1-a71f-44b3-b454-9a468ad69d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:16.783697 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399b6f1-a71f-44b3-b454-9a468ad69d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:16.784338 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399b6f1-a71f-44b3-b454-9a468ad69d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:16.786439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399b6f1-a71f-44b3-b454-9a468ad69d3e admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:16.796140 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1194/2383] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:37:16.799822 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2fac5d-7f0b-428d-b2c8-abd98937408c admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:16.809568 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2fac5d-7f0b-428d-b2c8-abd98937408c admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:16.814236 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930012a2-312a-4dea-9851-6d76519dcd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:16.814815 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930012a2-312a-4dea-9851-6d76519dcd75 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:16.815093 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930012a2-312a-4dea-9851-6d76519dcd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:16.815366 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930012a2-312a-4dea-9851-6d76519dcd75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:16.816000 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930012a2-312a-4dea-9851-6d76519dcd75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:16.818108 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930012a2-312a-4dea-9851-6d76519dcd75 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:16.819350 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:16.831558 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1190/2384] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:37:16.835661 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399b6f1-a71f-44b3-b454-9a468ad69d3e admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:16.845721 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399b6f1-a71f-44b3-b454-9a468ad69d3e admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:16.850378 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a3344-d04d-4837-a0c2-d38ab86dcdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:16.851018 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a3344-d04d-4837-a0c2-d38ab86dcdb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:16.851301 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a3344-d04d-4837-a0c2-d38ab86dcdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:16.851585 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a3344-d04d-4837-a0c2-d38ab86dcdb3 admin admin] PATH_INFO: `/v3/projects/9d07388b49f7435a9c310a21c63dfa37/users/4040fb3a1f00407198db61d174ae6c5f/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:16.865969 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a3344-d04d-4837-a0c2-d38ab86dcdb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d07388b49f7435a9c310a21c63dfa37, user_id=4040fb3a1f00407198db61d174ae6c5f, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:16.868630 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a3344-d04d-4837-a0c2-d38ab86dcdb3 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:16.881470 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1195/2385] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:37:16 2022] PUT /identity/v3/projects/9d07388b49f7435a9c310a21c63dfa37/users/4040fb3a1f00407198db61d174ae6c5f/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:16.892949 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa00e6-88e6-4f33-b002-5f3819a59023 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:16.893241 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa00e6-88e6-4f33-b002-5f3819a59023 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:16.893522 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa00e6-88e6-4f33-b002-5f3819a59023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:16.923167 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-96aa00e6-88e6-4f33-b002-5f3819a59023 None None] MFA Rules not processed for user `4040fb3a1f00407198db61d174ae6c5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:16.924583 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-96aa00e6-88e6-4f33-b002-5f3819a59023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:17.004580 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1191/2386] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:17.004788 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a3344-d04d-4837-a0c2-d38ab86dcdb3 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:17.083301 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a3344-d04d-4837-a0c2-d38ab86dcdb3 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:17.088216 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a03df-9c23-476b-8bb6-6d51f1f070d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:17.088890 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a03df-9c23-476b-8bb6-6d51f1f070d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:17.089177 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a03df-9c23-476b-8bb6-6d51f1f070d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:17.089706 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a03df-9c23-476b-8bb6-6d51f1f070d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:17.090274 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a03df-9c23-476b-8bb6-6d51f1f070d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:17.092187 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a03df-9c23-476b-8bb6-6d51f1f070d5 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:17.122760 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1196/2387] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:37:17 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:37:17.127078 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa00e6-88e6-4f33-b002-5f3819a59023 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:17.138062 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa00e6-88e6-4f33-b002-5f3819a59023 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:17.195174 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be167d-67a8-4ac6-8360-9ed88ac28fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:17.195787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be167d-67a8-4ac6-8360-9ed88ac28fce admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:17.196070 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be167d-67a8-4ac6-8360-9ed88ac28fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:17.196347 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be167d-67a8-4ac6-8360-9ed88ac28fce admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:17.197026 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be167d-67a8-4ac6-8360-9ed88ac28fce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:17.198960 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be167d-67a8-4ac6-8360-9ed88ac28fce admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:17.224504 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1192/2388] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:37:17 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:37:17.225948 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a03df-9c23-476b-8bb6-6d51f1f070d5 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:17.236778 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a03df-9c23-476b-8bb6-6d51f1f070d5 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:17.241754 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb848b9-34b0-4fd2-9bbe-f679777dcdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:17.242358 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb848b9-34b0-4fd2-9bbe-f679777dcdeb admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:17.242646 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb848b9-34b0-4fd2-9bbe-f679777dcdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:17.242929 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb848b9-34b0-4fd2-9bbe-f679777dcdeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:17.243577 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb848b9-34b0-4fd2-9bbe-f679777dcdeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:17.245221 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb848b9-34b0-4fd2-9bbe-f679777dcdeb admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:17.259094 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1197/2389] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:37:17.260444 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be167d-67a8-4ac6-8360-9ed88ac28fce admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:17.271986 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be167d-67a8-4ac6-8360-9ed88ac28fce admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:17.277312 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279de8b-9ba0-4317-96dd-51b0b610e742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:17.277941 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279de8b-9ba0-4317-96dd-51b0b610e742 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:17.278222 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279de8b-9ba0-4317-96dd-51b0b610e742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:17.278496 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279de8b-9ba0-4317-96dd-51b0b610e742 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:17.279141 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279de8b-9ba0-4317-96dd-51b0b610e742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:17.280771 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279de8b-9ba0-4317-96dd-51b0b610e742 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:17.301206 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1193/2390] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:37:17.301319 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb848b9-34b0-4fd2-9bbe-f679777dcdeb admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:17.310668 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb848b9-34b0-4fd2-9bbe-f679777dcdeb admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:17.317214 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab5c53-cdc6-445a-a5c7-4208cf90c076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:17.317982 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab5c53-cdc6-445a-a5c7-4208cf90c076 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:17.318384 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab5c53-cdc6-445a-a5c7-4208cf90c076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:17.318784 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab5c53-cdc6-445a-a5c7-4208cf90c076 admin admin] PATH_INFO: `/v3/projects/60a2c61e380f40afbed41889a6c37642/users/aaaf17d7678340c3b73c7281eaa1ddb5/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:17.329570 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:17.339433 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab5c53-cdc6-445a-a5c7-4208cf90c076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60a2c61e380f40afbed41889a6c37642, user_id=aaaf17d7678340c3b73c7281eaa1ddb5, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:17.343516 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab5c53-cdc6-445a-a5c7-4208cf90c076 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:17.361055 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1198/2391] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:37:17 2022] PUT /identity/v3/projects/60a2c61e380f40afbed41889a6c37642/users/aaaf17d7678340c3b73c7281eaa1ddb5/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:37:17.371751 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe1863-efa4-4a21-bbd7-429b31a552f9 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:17.372130 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe1863-efa4-4a21-bbd7-429b31a552f9 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:17.372410 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe1863-efa4-4a21-bbd7-429b31a552f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:17.403592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-bdfe1863-efa4-4a21-bbd7-429b31a552f9 None None] MFA Rules not processed for user `aaaf17d7678340c3b73c7281eaa1ddb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:17.404915 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-bdfe1863-efa4-4a21-bbd7-429b31a552f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:17.459431 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:17.471149 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1194/2392] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:17.475664 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab5c53-cdc6-445a-a5c7-4208cf90c076 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:17.539821 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab5c53-cdc6-445a-a5c7-4208cf90c076 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:17.544816 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28969d3b-c132-4a0a-91e2-92b57ce70dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:17.545429 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28969d3b-c132-4a0a-91e2-92b57ce70dac admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:17.545713 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28969d3b-c132-4a0a-91e2-92b57ce70dac admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:17.545993 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28969d3b-c132-4a0a-91e2-92b57ce70dac admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:17.546639 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28969d3b-c132-4a0a-91e2-92b57ce70dac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:17.548626 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28969d3b-c132-4a0a-91e2-92b57ce70dac admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:17.579028 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1199/2393] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:37:17 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:37:17.580506 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe1863-efa4-4a21-bbd7-429b31a552f9 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:17.591302 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe1863-efa4-4a21-bbd7-429b31a552f9 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:17.649123 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdcb79-8a56-4327-a55e-6224c25e9da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:17.649733 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdcb79-8a56-4327-a55e-6224c25e9da4 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:17.650018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdcb79-8a56-4327-a55e-6224c25e9da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:17.650297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdcb79-8a56-4327-a55e-6224c25e9da4 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:17.650946 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bdcb79-8a56-4327-a55e-6224c25e9da4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:17.652910 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bdcb79-8a56-4327-a55e-6224c25e9da4 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:17.674189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1195/2394] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:37:17 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:37:17.678731 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28969d3b-c132-4a0a-91e2-92b57ce70dac admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:17.688884 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28969d3b-c132-4a0a-91e2-92b57ce70dac admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:17.693464 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97978b2d-f59b-45d4-8a1c-e2081cb4feaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:17.694062 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97978b2d-f59b-45d4-8a1c-e2081cb4feaf admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:17.694339 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97978b2d-f59b-45d4-8a1c-e2081cb4feaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:17.694612 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97978b2d-f59b-45d4-8a1c-e2081cb4feaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:17.695251 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97978b2d-f59b-45d4-8a1c-e2081cb4feaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:17.696921 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97978b2d-f59b-45d4-8a1c-e2081cb4feaf admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:17.707518 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1200/2395] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:37:17.711710 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdcb79-8a56-4327-a55e-6224c25e9da4 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:17.722041 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdcb79-8a56-4327-a55e-6224c25e9da4 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:17.727182 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74155cee-cbde-4486-8bf5-1b0218657d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:17.727826 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74155cee-cbde-4486-8bf5-1b0218657d67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:17.728105 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74155cee-cbde-4486-8bf5-1b0218657d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:17.728381 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74155cee-cbde-4486-8bf5-1b0218657d67 admin admin] PATH_INFO: `/v3/projects/f51fa68184cd4807a95d48f6bb1b413c/users/030a2402f1c44a79aa5a5cc739364fa8/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:17.743317 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74155cee-cbde-4486-8bf5-1b0218657d67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f51fa68184cd4807a95d48f6bb1b413c, user_id=030a2402f1c44a79aa5a5cc739364fa8, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:17.746029 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74155cee-cbde-4486-8bf5-1b0218657d67 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:17.758578 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1196/2396] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:37:17 2022] PUT /identity/v3/projects/f51fa68184cd4807a95d48f6bb1b413c/users/030a2402f1c44a79aa5a5cc739364fa8/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:17.762449 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97978b2d-f59b-45d4-8a1c-e2081cb4feaf admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:17.772249 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97978b2d-f59b-45d4-8a1c-e2081cb4feaf admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:17.827756 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e572c0-c92a-4e8d-9ee1-cb8eafe2c703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:17.828360 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e572c0-c92a-4e8d-9ee1-cb8eafe2c703 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:17.828675 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e572c0-c92a-4e8d-9ee1-cb8eafe2c703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:17.828954 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e572c0-c92a-4e8d-9ee1-cb8eafe2c703 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:17.829600 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e572c0-c92a-4e8d-9ee1-cb8eafe2c703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:17.831186 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e572c0-c92a-4e8d-9ee1-cb8eafe2c703 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:17.840737 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1201/2397] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:37:17.844831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74155cee-cbde-4486-8bf5-1b0218657d67 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:17.856031 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74155cee-cbde-4486-8bf5-1b0218657d67 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:17.860798 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fce02e-7b5e-4dad-aa48-5659166d096d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:17.861466 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fce02e-7b5e-4dad-aa48-5659166d096d admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:17.861750 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fce02e-7b5e-4dad-aa48-5659166d096d admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:17.862029 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fce02e-7b5e-4dad-aa48-5659166d096d admin admin] PATH_INFO: `/v3/projects/f51fa68184cd4807a95d48f6bb1b413c/users/030a2402f1c44a79aa5a5cc739364fa8/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:17.864488 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fce02e-7b5e-4dad-aa48-5659166d096d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f51fa68184cd4807a95d48f6bb1b413c, user_id=030a2402f1c44a79aa5a5cc739364fa8, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:17.867215 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fce02e-7b5e-4dad-aa48-5659166d096d admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:17.877561 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1197/2398] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:37:17 2022] PUT /identity/v3/projects/f51fa68184cd4807a95d48f6bb1b413c/users/030a2402f1c44a79aa5a5cc739364fa8/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:17.887609 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fb67e-2f32-4ea6-af70-1a3a52bf6ab4 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:17.887901 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fb67e-2f32-4ea6-af70-1a3a52bf6ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:17.888181 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fb67e-2f32-4ea6-af70-1a3a52bf6ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:17.916191 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-611fb67e-2f32-4ea6-af70-1a3a52bf6ab4 None None] MFA Rules not processed for user `030a2402f1c44a79aa5a5cc739364fa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:17.917423 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-611fb67e-2f32-4ea6-af70-1a3a52bf6ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:17.962258 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:17.986533 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1202/2399] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:17 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:17.999354 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fce02e-7b5e-4dad-aa48-5659166d096d admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:18.001069 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-45fce02e-7b5e-4dad-aa48-5659166d096d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:18.058095 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fce02e-7b5e-4dad-aa48-5659166d096d admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:18.061770 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df7295-1e28-4c6f-a862-89c37d5c3dd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:18.062366 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df7295-1e28-4c6f-a862-89c37d5c3dd0 service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:18.062647 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df7295-1e28-4c6f-a862-89c37d5c3dd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:18.062924 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df7295-1e28-4c6f-a862-89c37d5c3dd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:18.071865 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df7295-1e28-4c6f-a862-89c37d5c3dd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:18.073340 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df7295-1e28-4c6f-a862-89c37d5c3dd0 service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:18.083344 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1198/2400] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:17 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:37:18.601059 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611fb67e-2f32-4ea6-af70-1a3a52bf6ab4 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:18.610632 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611fb67e-2f32-4ea6-af70-1a3a52bf6ab4 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:18.615060 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a247fc8-ea94-4365-9827-89e8d1f1d6cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:18.615819 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a247fc8-ea94-4365-9827-89e8d1f1d6cc service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:18.616180 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a247fc8-ea94-4365-9827-89e8d1f1d6cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:18.616461 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a247fc8-ea94-4365-9827-89e8d1f1d6cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:18.678860 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a247fc8-ea94-4365-9827-89e8d1f1d6cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:18.680426 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a247fc8-ea94-4365-9827-89e8d1f1d6cc service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:18.690691 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1203/2401] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:18 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:37:22.761954 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df7295-1e28-4c6f-a862-89c37d5c3dd0 service cinder] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:22.771380 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df7295-1e28-4c6f-a862-89c37d5c3dd0 service cinder] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:22.775102 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9826766-cf42-4baf-bee9-95754e6aa795 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:22.775631 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9826766-cf42-4baf-bee9-95754e6aa795 service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:22.775914 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9826766-cf42-4baf-bee9-95754e6aa795 service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:22.776193 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9826766-cf42-4baf-bee9-95754e6aa795 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:22.819519 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:22.832580 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9826766-cf42-4baf-bee9-95754e6aa795 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:22.834022 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9826766-cf42-4baf-bee9-95754e6aa795 service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:22.842800 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1199/2402] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:22 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:37:24.153260 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a247fc8-ea94-4365-9827-89e8d1f1d6cc service cinder] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:24.154693 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-8a247fc8-ea94-4365-9827-89e8d1f1d6cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:24.218987 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a247fc8-ea94-4365-9827-89e8d1f1d6cc service cinder] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:24.224926 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4ebb5-dc1c-4007-a2df-6aedc65e632e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:24.225544 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4ebb5-dc1c-4007-a2df-6aedc65e632e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:24.225825 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4ebb5-dc1c-4007-a2df-6aedc65e632e admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:24.226100 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4ebb5-dc1c-4007-a2df-6aedc65e632e admin admin] PATH_INFO: `/v3/users/5a17ee7865bc4323836069d5677e4477` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:24.227221 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e4ebb5-dc1c-4007-a2df-6aedc65e632e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a17ee7865bc4323836069d5677e4477)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:24.229170 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e4ebb5-dc1c-4007-a2df-6aedc65e632e admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:24.275227 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-96e4ebb5-dc1c-4007-a2df-6aedc65e632e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a17ee7865bc4323836069d5677e4477'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:24.275877 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-96e4ebb5-dc1c-4007-a2df-6aedc65e632e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a17ee7865bc4323836069d5677e4477'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:24.283888 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-96e4ebb5-dc1c-4007-a2df-6aedc65e632e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a17ee7865bc4323836069d5677e4477'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:24.284299 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-96e4ebb5-dc1c-4007-a2df-6aedc65e632e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a17ee7865bc4323836069d5677e4477'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:24.297001 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-96e4ebb5-dc1c-4007-a2df-6aedc65e632e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a17ee7865bc4323836069d5677e4477'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:24.306702 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:24.312843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1204/2403] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:37:24 2022] DELETE /identity/v3/users/5a17ee7865bc4323836069d5677e4477 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:24.317893 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746331f-cd1c-47d1-9eba-eb7bb2b5f48d None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:24.318525 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746331f-cd1c-47d1-9eba-eb7bb2b5f48d None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:24.318525 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746331f-cd1c-47d1-9eba-eb7bb2b5f48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:24.341948 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-4746331f-cd1c-47d1-9eba-eb7bb2b5f48d None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:24.343132 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-4746331f-cd1c-47d1-9eba-eb7bb2b5f48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:24.403411 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1200/2404] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:24.414139 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4ebb5-dc1c-4007-a2df-6aedc65e632e admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:24.415658 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-96e4ebb5-dc1c-4007-a2df-6aedc65e632e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:24.477671 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4ebb5-dc1c-4007-a2df-6aedc65e632e admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:24.481381 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4952b2-bdc7-4202-9f1f-8c60d2db0b02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:24.481986 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4952b2-bdc7-4202-9f1f-8c60d2db0b02 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:24.482265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4952b2-bdc7-4202-9f1f-8c60d2db0b02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:24.482547 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4952b2-bdc7-4202-9f1f-8c60d2db0b02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:24.491899 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4952b2-bdc7-4202-9f1f-8c60d2db0b02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:24.493372 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4952b2-bdc7-4202-9f1f-8c60d2db0b02 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:24.502908 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1205/2405] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:37:24.827311 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746331f-cd1c-47d1-9eba-eb7bb2b5f48d None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:24.829192 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-4746331f-cd1c-47d1-9eba-eb7bb2b5f48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:24.854604 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746331f-cd1c-47d1-9eba-eb7bb2b5f48d None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:24.860962 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8d70d-9e7e-4708-b83b-78404e780e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:24.861685 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8d70d-9e7e-4708-b83b-78404e780e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:24.861976 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8d70d-9e7e-4708-b83b-78404e780e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:24.862218 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8d70d-9e7e-4708-b83b-78404e780e0d admin admin] PATH_INFO: `/v3/projects/b869b4d2cc9c49919c2d9611ecff9d64` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:24.863756 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8d70d-9e7e-4708-b83b-78404e780e0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b869b4d2cc9c49919c2d9611ecff9d64)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:24.865702 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8d70d-9e7e-4708-b83b-78404e780e0d admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:24.915039 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-e6e8d70d-9e7e-4708-b83b-78404e780e0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b869b4d2cc9c49919c2d9611ecff9d64', 'request_id': 'req-e6e8d70d-9e7e-4708-b83b-78404e780e0d'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:24.920784 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-e6e8d70d-9e7e-4708-b83b-78404e780e0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b869b4d2cc9c49919c2d9611ecff9d64', 'request_id': 'req-e6e8d70d-9e7e-4708-b83b-78404e780e0d'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:24.928260 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-e6e8d70d-9e7e-4708-b83b-78404e780e0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b869b4d2cc9c49919c2d9611ecff9d64', 'request_id': 'req-e6e8d70d-9e7e-4708-b83b-78404e780e0d'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:24.942552 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-e6e8d70d-9e7e-4708-b83b-78404e780e0d admin admin] The token cache is being invalidate because project b869b4d2cc9c49919c2d9611ecff9d64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:37:24.942846 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-e6e8d70d-9e7e-4708-b83b-78404e780e0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:24.943489 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-e6e8d70d-9e7e-4708-b83b-78404e780e0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:24.945037 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1201/2406] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:37:24 2022] DELETE /identity/v3/projects/b869b4d2cc9c49919c2d9611ecff9d64 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:24.949937 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55930048-aab6-4c08-852a-1fdc24af418c None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:24.950226 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55930048-aab6-4c08-852a-1fdc24af418c None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:24.950510 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55930048-aab6-4c08-852a-1fdc24af418c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:24.972794 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-55930048-aab6-4c08-852a-1fdc24af418c None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:24.974116 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-55930048-aab6-4c08-852a-1fdc24af418c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:25.014001 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8d70d-9e7e-4708-b83b-78404e780e0d admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:25.015430 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-e6e8d70d-9e7e-4708-b83b-78404e780e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:25.042506 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1206/2407] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:25.053658 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde4eef-5a16-444d-a7b9-4ba800573d39 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:25.053951 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde4eef-5a16-444d-a7b9-4ba800573d39 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:25.054225 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde4eef-5a16-444d-a7b9-4ba800573d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:25.074869 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-5bde4eef-5a16-444d-a7b9-4ba800573d39 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:25.076129 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-5bde4eef-5a16-444d-a7b9-4ba800573d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:25.084666 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1207/2408] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:37:25.087977 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8d70d-9e7e-4708-b83b-78404e780e0d admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:25.088775 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde4eef-5a16-444d-a7b9-4ba800573d39 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:25.091498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0efc1-9d67-447f-9de3-0938caeb646f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:25.092133 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0efc1-9d67-447f-9de3-0938caeb646f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:25.092415 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0efc1-9d67-447f-9de3-0938caeb646f admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:25.092731 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0efc1-9d67-447f-9de3-0938caeb646f admin admin] PATH_INFO: `/v3/users/4040fb3a1f00407198db61d174ae6c5f` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:25.093877 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0efc1-9d67-447f-9de3-0938caeb646f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4040fb3a1f00407198db61d174ae6c5f)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:25.096090 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0efc1-9d67-447f-9de3-0938caeb646f admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:25.099371 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde4eef-5a16-444d-a7b9-4ba800573d39 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:25.104898 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f6579-e278-44ed-8d4e-783f4b609f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:25.105489 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f6579-e278-44ed-8d4e-783f4b609f49 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:25.105766 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f6579-e278-44ed-8d4e-783f4b609f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:25.106037 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f6579-e278-44ed-8d4e-783f4b609f49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:25.106681 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f6579-e278-44ed-8d4e-783f4b609f49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:37:25.106988 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f6579-e278-44ed-8d4e-783f4b609f49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:25.108783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f6579-e278-44ed-8d4e-783f4b609f49 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:25.109684 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:25.122890 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1208/2409] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:37:25.127091 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f6579-e278-44ed-8d4e-783f4b609f49 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:25.138373 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f6579-e278-44ed-8d4e-783f4b609f49 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:25.143610 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd8a14-872c-4169-a84f-beee9c615930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:25.144470 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd8a14-872c-4169-a84f-beee9c615930 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:25.144799 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd8a14-872c-4169-a84f-beee9c615930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:25.145079 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd8a14-872c-4169-a84f-beee9c615930 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:25.145383 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-c6c0efc1-9d67-447f-9de3-0938caeb646f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4040fb3a1f00407198db61d174ae6c5f'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:25.145795 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd8a14-872c-4169-a84f-beee9c615930 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:25.146099 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-c6c0efc1-9d67-447f-9de3-0938caeb646f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4040fb3a1f00407198db61d174ae6c5f'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:25.147636 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd8a14-872c-4169-a84f-beee9c615930 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:25.158216 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-c6c0efc1-9d67-447f-9de3-0938caeb646f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4040fb3a1f00407198db61d174ae6c5f'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:25.158893 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-c6c0efc1-9d67-447f-9de3-0938caeb646f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4040fb3a1f00407198db61d174ae6c5f'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:25.166599 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-c6c0efc1-9d67-447f-9de3-0938caeb646f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4040fb3a1f00407198db61d174ae6c5f'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:25.176416 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1209/2410] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:37:25 2022] POST /identity/v3/projects => generated 403 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:37:25.180437 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd8a14-872c-4169-a84f-beee9c615930 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:25.182123 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-8cbd8a14-872c-4169-a84f-beee9c615930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:25.185204 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1202/2411] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:37:25 2022] DELETE /identity/v3/users/4040fb3a1f00407198db61d174ae6c5f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:37:25.186498 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400fcfc-a9b0-4020-871a-9afa4c08d4ed None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:25.186791 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400fcfc-a9b0-4020-871a-9afa4c08d4ed None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:25.187045 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400fcfc-a9b0-4020-871a-9afa4c08d4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:25.206434 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-3400fcfc-a9b0-4020-871a-9afa4c08d4ed None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:25.208189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-3400fcfc-a9b0-4020-871a-9afa4c08d4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:25.245445 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd8a14-872c-4169-a84f-beee9c615930 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:25.250457 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:25.266962 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1203/2412] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:37:25.277193 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400fcfc-a9b0-4020-871a-9afa4c08d4ed None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:25.278548 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-3400fcfc-a9b0-4020-871a-9afa4c08d4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:25.304132 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a27fe-eb80-4747-a452-dd17fd1d245b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:25.304775 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a27fe-eb80-4747-a452-dd17fd1d245b admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:25.305059 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a27fe-eb80-4747-a452-dd17fd1d245b admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:25.305340 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a27fe-eb80-4747-a452-dd17fd1d245b admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:25.305977 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a27fe-eb80-4747-a452-dd17fd1d245b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:25.307879 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a27fe-eb80-4747-a452-dd17fd1d245b admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:25.334292 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1210/2413] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:37:25 2022] POST /identity/v3/users => generated 302 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:37:25.335437 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a27fe-eb80-4747-a452-dd17fd1d245b admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:25.338054 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400fcfc-a9b0-4020-871a-9afa4c08d4ed None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:25.342183 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047da76-44ef-4bcc-a757-dc6b5d452ba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:25.342795 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047da76-44ef-4bcc-a757-dc6b5d452ba6 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:25.343080 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047da76-44ef-4bcc-a757-dc6b5d452ba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:25.343357 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047da76-44ef-4bcc-a757-dc6b5d452ba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:25.345347 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a27fe-eb80-4747-a452-dd17fd1d245b admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:25.350420 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0e321-35df-47e9-a117-ce7fee871eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:25.351008 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0e321-35df-47e9-a117-ce7fee871eed admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:25.351292 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0e321-35df-47e9-a117-ce7fee871eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:25.351564 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0e321-35df-47e9-a117-ce7fee871eed admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:25.352193 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0e321-35df-47e9-a117-ce7fee871eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:25.352936 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047da76-44ef-4bcc-a757-dc6b5d452ba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:25.353807 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0e321-35df-47e9-a117-ce7fee871eed admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:25.354375 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047da76-44ef-4bcc-a757-dc6b5d452ba6 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:25.364314 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1211/2414] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:37:25.364905 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1204/2415] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 20:37:25.368154 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0e321-35df-47e9-a117-ce7fee871eed admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:25.377954 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0e321-35df-47e9-a117-ce7fee871eed admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:25.383326 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f2917-76f7-4c22-b828-cc54c8af9b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:25.383926 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f2917-76f7-4c22-b828-cc54c8af9b0a admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:25.384212 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f2917-76f7-4c22-b828-cc54c8af9b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:25.384494 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f2917-76f7-4c22-b828-cc54c8af9b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:25.385178 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f2917-76f7-4c22-b828-cc54c8af9b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:25.386746 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f2917-76f7-4c22-b828-cc54c8af9b0a admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:25.397635 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1212/2416] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:37:25.401960 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047da76-44ef-4bcc-a757-dc6b5d452ba6 service neutron] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:25.412238 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047da76-44ef-4bcc-a757-dc6b5d452ba6 service neutron] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:25.417502 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48e05b-236c-45b8-b142-4802d4ffdead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:25.418080 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48e05b-236c-45b8-b142-4802d4ffdead admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:25.418369 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48e05b-236c-45b8-b142-4802d4ffdead admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:25.418682 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48e05b-236c-45b8-b142-4802d4ffdead admin admin] PATH_INFO: `/v3/projects/6e8f24e1b6924b69a2258ab0b93429d9/users/219367083bd041eeb4f10e6dd70e4cfc/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:25.435527 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48e05b-236c-45b8-b142-4802d4ffdead admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e8f24e1b6924b69a2258ab0b93429d9, user_id=219367083bd041eeb4f10e6dd70e4cfc, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:25.438311 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48e05b-236c-45b8-b142-4802d4ffdead admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:25.453301 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1205/2417] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:37:25 2022] PUT /identity/v3/projects/6e8f24e1b6924b69a2258ab0b93429d9/users/219367083bd041eeb4f10e6dd70e4cfc/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:25.458597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72561df4-6b97-4639-8225-0a5cffa1a374 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:25.458985 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72561df4-6b97-4639-8225-0a5cffa1a374 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:25.459337 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72561df4-6b97-4639-8225-0a5cffa1a374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:25.479233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-72561df4-6b97-4639-8225-0a5cffa1a374 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:25.480456 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-72561df4-6b97-4639-8225-0a5cffa1a374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:25.545713 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1213/2418] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:25.556181 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48e05b-236c-45b8-b142-4802d4ffdead admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:25.557982 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-3e48e05b-236c-45b8-b142-4802d4ffdead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:25.569670 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:25.625377 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48e05b-236c-45b8-b142-4802d4ffdead admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:25.630239 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbde4a-5109-4d3f-9902-c85212c13a2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:25.630901 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbde4a-5109-4d3f-9902-c85212c13a2e service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:25.631189 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbde4a-5109-4d3f-9902-c85212c13a2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:25.631467 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbde4a-5109-4d3f-9902-c85212c13a2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:25.639217 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72561df4-6b97-4639-8225-0a5cffa1a374 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:25.640696 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-72561df4-6b97-4639-8225-0a5cffa1a374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:25.642214 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfbde4a-5109-4d3f-9902-c85212c13a2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:25.643890 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfbde4a-5109-4d3f-9902-c85212c13a2e service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:25.654111 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72561df4-6b97-4639-8225-0a5cffa1a374 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:25.658972 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ba34b-b5de-47d6-96bb-0eb4565f2a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:25.659713 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ba34b-b5de-47d6-96bb-0eb4565f2a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:25.660191 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ba34b-b5de-47d6-96bb-0eb4565f2a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:25.660620 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ba34b-b5de-47d6-96bb-0eb4565f2a96 admin admin] PATH_INFO: `/v3/projects/9d07388b49f7435a9c310a21c63dfa37` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:25.661392 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1206/2419] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:37:25.661977 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ba34b-b5de-47d6-96bb-0eb4565f2a96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d07388b49f7435a9c310a21c63dfa37)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:25.664306 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ba34b-b5de-47d6-96bb-0eb4565f2a96 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:25.720962 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0c9ba34b-b5de-47d6-96bb-0eb4565f2a96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d07388b49f7435a9c310a21c63dfa37', 'request_id': 'req-0c9ba34b-b5de-47d6-96bb-0eb4565f2a96'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:25.728202 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0c9ba34b-b5de-47d6-96bb-0eb4565f2a96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d07388b49f7435a9c310a21c63dfa37', 'request_id': 'req-0c9ba34b-b5de-47d6-96bb-0eb4565f2a96'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:25.739683 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0c9ba34b-b5de-47d6-96bb-0eb4565f2a96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d07388b49f7435a9c310a21c63dfa37', 'request_id': 'req-0c9ba34b-b5de-47d6-96bb-0eb4565f2a96'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:25.747705 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:25.752393 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0c9ba34b-b5de-47d6-96bb-0eb4565f2a96 admin admin] The token cache is being invalidate because project 9d07388b49f7435a9c310a21c63dfa37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:37:25.755756 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0c9ba34b-b5de-47d6-96bb-0eb4565f2a96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:25.756706 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0c9ba34b-b5de-47d6-96bb-0eb4565f2a96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:25.762019 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1214/2420] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:37:25 2022] DELETE /identity/v3/projects/9d07388b49f7435a9c310a21c63dfa37 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:37:25.763158 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbde4a-5109-4d3f-9902-c85212c13a2e service neutron] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:25.774067 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbde4a-5109-4d3f-9902-c85212c13a2e service neutron] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:25.850736 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8067e-7d5e-4dbd-a4c6-050e77600c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:25.851661 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8067e-7d5e-4dbd-a4c6-050e77600c91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:25.852161 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8067e-7d5e-4dbd-a4c6-050e77600c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:25.852685 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8067e-7d5e-4dbd-a4c6-050e77600c91 admin admin] PATH_INFO: `/v3/users/aaaf17d7678340c3b73c7281eaa1ddb5` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:25.855128 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8067e-7d5e-4dbd-a4c6-050e77600c91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaaf17d7678340c3b73c7281eaa1ddb5)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:25.857542 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8067e-7d5e-4dbd-a4c6-050e77600c91 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:25.913697 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-d8d8067e-7d5e-4dbd-a4c6-050e77600c91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaaf17d7678340c3b73c7281eaa1ddb5'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:25.914387 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-d8d8067e-7d5e-4dbd-a4c6-050e77600c91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaaf17d7678340c3b73c7281eaa1ddb5'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:25.928692 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-d8d8067e-7d5e-4dbd-a4c6-050e77600c91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaaf17d7678340c3b73c7281eaa1ddb5'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:25.929339 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-d8d8067e-7d5e-4dbd-a4c6-050e77600c91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaaf17d7678340c3b73c7281eaa1ddb5'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:25.936820 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-d8d8067e-7d5e-4dbd-a4c6-050e77600c91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaaf17d7678340c3b73c7281eaa1ddb5'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:25.950116 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1207/2421] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:37:25 2022] DELETE /identity/v3/users/aaaf17d7678340c3b73c7281eaa1ddb5 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:37:26.388685 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ba34b-b5de-47d6-96bb-0eb4565f2a96 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:26.390205 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-0c9ba34b-b5de-47d6-96bb-0eb4565f2a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:26.403704 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ba34b-b5de-47d6-96bb-0eb4565f2a96 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:26.463029 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c5b5e-36a6-45c6-aca0-9100a52bbfb4 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:26.463604 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c5b5e-36a6-45c6-aca0-9100a52bbfb4 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:26.463737 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c5b5e-36a6-45c6-aca0-9100a52bbfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:26.480828 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4aa0c-4f8f-41dd-a81d-9cbbd83e0953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:26.481502 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4aa0c-4f8f-41dd-a81d-9cbbd83e0953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:26.481790 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4aa0c-4f8f-41dd-a81d-9cbbd83e0953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:26.482073 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4aa0c-4f8f-41dd-a81d-9cbbd83e0953 admin admin] PATH_INFO: `/v3/projects/60a2c61e380f40afbed41889a6c37642` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:26.483345 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4aa0c-4f8f-41dd-a81d-9cbbd83e0953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60a2c61e380f40afbed41889a6c37642)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:26.485310 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4aa0c-4f8f-41dd-a81d-9cbbd83e0953 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:26.493046 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-7d6c5b5e-36a6-45c6-aca0-9100a52bbfb4 None None] MFA Rules not processed for user `219367083bd041eeb4f10e6dd70e4cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:26.494252 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-7d6c5b5e-36a6-45c6-aca0-9100a52bbfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:26.513984 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:26.551327 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-bdd4aa0c-4f8f-41dd-a81d-9cbbd83e0953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60a2c61e380f40afbed41889a6c37642', 'request_id': 'req-bdd4aa0c-4f8f-41dd-a81d-9cbbd83e0953'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:26.561079 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-bdd4aa0c-4f8f-41dd-a81d-9cbbd83e0953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60a2c61e380f40afbed41889a6c37642', 'request_id': 'req-bdd4aa0c-4f8f-41dd-a81d-9cbbd83e0953'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:26.570221 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-bdd4aa0c-4f8f-41dd-a81d-9cbbd83e0953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60a2c61e380f40afbed41889a6c37642', 'request_id': 'req-bdd4aa0c-4f8f-41dd-a81d-9cbbd83e0953'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:26.579801 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1208/2422] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:26 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:37:26.583934 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c5b5e-36a6-45c6-aca0-9100a52bbfb4 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:26.585852 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-7d6c5b5e-36a6-45c6-aca0-9100a52bbfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:26.586987 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-bdd4aa0c-4f8f-41dd-a81d-9cbbd83e0953 admin admin] The token cache is being invalidate because project 60a2c61e380f40afbed41889a6c37642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:37:26.586987 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-bdd4aa0c-4f8f-41dd-a81d-9cbbd83e0953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:26.587476 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-bdd4aa0c-4f8f-41dd-a81d-9cbbd83e0953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:26.589463 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1215/2423] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:37:26 2022] DELETE /identity/v3/projects/60a2c61e380f40afbed41889a6c37642 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:26.593017 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4aa0c-4f8f-41dd-a81d-9cbbd83e0953 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:26.594503 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-bdd4aa0c-4f8f-41dd-a81d-9cbbd83e0953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:26.604801 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c5b5e-36a6-45c6-aca0-9100a52bbfb4 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:26.670184 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4aa0c-4f8f-41dd-a81d-9cbbd83e0953 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:26.670372 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebf63c-d380-4f46-8c8b-61a731082be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:26.670840 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebf63c-d380-4f46-8c8b-61a731082be1 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:26.671120 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebf63c-d380-4f46-8c8b-61a731082be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:26.671394 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebf63c-d380-4f46-8c8b-61a731082be1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:26.672060 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cebf63c-d380-4f46-8c8b-61a731082be1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:26.674002 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cebf63c-d380-4f46-8c8b-61a731082be1 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:26.674889 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b962c5e-d54b-4cf4-80a5-af391e08809a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:26.675521 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b962c5e-d54b-4cf4-80a5-af391e08809a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:26.676398 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b962c5e-d54b-4cf4-80a5-af391e08809a admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:26.676707 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b962c5e-d54b-4cf4-80a5-af391e08809a admin admin] PATH_INFO: `/v3/users/030a2402f1c44a79aa5a5cc739364fa8` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:26.677840 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b962c5e-d54b-4cf4-80a5-af391e08809a admin admin] RBAC: Authorizing `identity:delete_user(user_id=030a2402f1c44a79aa5a5cc739364fa8)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:26.679758 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b962c5e-d54b-4cf4-80a5-af391e08809a admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:26.701617 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1209/2424] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:37:26 2022] POST /identity/v3/projects => generated 405 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:37:26.705554 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebf63c-d380-4f46-8c8b-61a731082be1 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:26.707506 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-3cebf63c-d380-4f46-8c8b-61a731082be1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:26.720136 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:26.736858 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8b962c5e-d54b-4cf4-80a5-af391e08809a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '030a2402f1c44a79aa5a5cc739364fa8'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:26.737532 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8b962c5e-d54b-4cf4-80a5-af391e08809a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '030a2402f1c44a79aa5a5cc739364fa8'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:26.745127 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8b962c5e-d54b-4cf4-80a5-af391e08809a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '030a2402f1c44a79aa5a5cc739364fa8'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:26.745880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8b962c5e-d54b-4cf4-80a5-af391e08809a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '030a2402f1c44a79aa5a5cc739364fa8'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:26.758222 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8b962c5e-d54b-4cf4-80a5-af391e08809a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '030a2402f1c44a79aa5a5cc739364fa8'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:26.771966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1216/2425] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:37:26 2022] DELETE /identity/v3/users/030a2402f1c44a79aa5a5cc739364fa8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:37:26.775775 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebf63c-d380-4f46-8c8b-61a731082be1 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:26.824967 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:26.836830 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8c8d3-b43a-48cd-8a4f-5ddf821463a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:26.837572 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8c8d3-b43a-48cd-8a4f-5ddf821463a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:26.837960 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8c8d3-b43a-48cd-8a4f-5ddf821463a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:26.838459 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8c8d3-b43a-48cd-8a4f-5ddf821463a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:26.839263 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca8c8d3-b43a-48cd-8a4f-5ddf821463a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:26.841582 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca8c8d3-b43a-48cd-8a4f-5ddf821463a6 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:26.865351 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1210/2426] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:37:26 2022] POST /identity/v3/users => generated 309 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:37:26.869316 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b962c5e-d54b-4cf4-80a5-af391e08809a admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:26.870789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-8b962c5e-d54b-4cf4-80a5-af391e08809a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:26.884157 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b962c5e-d54b-4cf4-80a5-af391e08809a admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:26.888828 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54799020-917e-422e-ad32-5c11f702ad3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:26.889436 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54799020-917e-422e-ad32-5c11f702ad3d admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:26.889722 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54799020-917e-422e-ad32-5c11f702ad3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:26.890001 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54799020-917e-422e-ad32-5c11f702ad3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:26.890649 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54799020-917e-422e-ad32-5c11f702ad3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:26.892245 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54799020-917e-422e-ad32-5c11f702ad3d admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:26.906024 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1217/2427] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:37:26.907244 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8c8d3-b43a-48cd-8a4f-5ddf821463a6 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:26.930008 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8c8d3-b43a-48cd-8a4f-5ddf821463a6 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:26.936945 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbdd77-fac3-4cae-a081-881821eefcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:26.937888 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbdd77-fac3-4cae-a081-881821eefcba admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:26.938192 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbdd77-fac3-4cae-a081-881821eefcba admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:26.938451 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbdd77-fac3-4cae-a081-881821eefcba admin admin] PATH_INFO: `/v3/projects/6a5b8886fdae48368c6124d82c9b78f1/users/400b9e78ed3445f884992d3a5a379e44/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:26.955607 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbbdd77-fac3-4cae-a081-881821eefcba admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a5b8886fdae48368c6124d82c9b78f1, user_id=400b9e78ed3445f884992d3a5a379e44, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:26.958879 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbbdd77-fac3-4cae-a081-881821eefcba admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:26.974722 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1211/2428] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:37:26 2022] PUT /identity/v3/projects/6a5b8886fdae48368c6124d82c9b78f1/users/400b9e78ed3445f884992d3a5a379e44/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:26.978457 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54799020-917e-422e-ad32-5c11f702ad3d admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:26.989344 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54799020-917e-422e-ad32-5c11f702ad3d admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:27.061023 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1577f6-22ab-45f7-96d9-f011da18f400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:27.061641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1577f6-22ab-45f7-96d9-f011da18f400 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:27.061920 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1577f6-22ab-45f7-96d9-f011da18f400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:27.062235 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1577f6-22ab-45f7-96d9-f011da18f400 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:27.062926 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1577f6-22ab-45f7-96d9-f011da18f400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:27.064643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1577f6-22ab-45f7-96d9-f011da18f400 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:27.075695 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbdd77-fac3-4cae-a081-881821eefcba admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:27.077391 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1218/2429] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:37:27.081186 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1577f6-22ab-45f7-96d9-f011da18f400 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:27.081708 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-bbbbdd77-fac3-4cae-a081-881821eefcba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:27.094266 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1577f6-22ab-45f7-96d9-f011da18f400 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:27.101011 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa1965-5916-44eb-a280-fb4c2c02bb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:27.101869 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbdd77-fac3-4cae-a081-881821eefcba admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:27.102114 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa1965-5916-44eb-a280-fb4c2c02bb61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:27.102578 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa1965-5916-44eb-a280-fb4c2c02bb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:27.103248 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa1965-5916-44eb-a280-fb4c2c02bb61 admin admin] PATH_INFO: `/v3/projects/6a5b8886fdae48368c6124d82c9b78f1/users/400b9e78ed3445f884992d3a5a379e44/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:27.105156 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa1965-5916-44eb-a280-fb4c2c02bb61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a5b8886fdae48368c6124d82c9b78f1, user_id=400b9e78ed3445f884992d3a5a379e44, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:27.109163 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa1965-5916-44eb-a280-fb4c2c02bb61 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:27.114827 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557255a1-e55e-4479-8aae-bccff4cf3fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:27.115501 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557255a1-e55e-4479-8aae-bccff4cf3fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:27.115784 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557255a1-e55e-4479-8aae-bccff4cf3fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:27.116240 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557255a1-e55e-4479-8aae-bccff4cf3fb1 admin admin] PATH_INFO: `/v3/projects/f51fa68184cd4807a95d48f6bb1b413c` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:27.117760 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557255a1-e55e-4479-8aae-bccff4cf3fb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f51fa68184cd4807a95d48f6bb1b413c)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:27.119718 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557255a1-e55e-4479-8aae-bccff4cf3fb1 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:27.123129 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1219/2430] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:37:27 2022] PUT /identity/v3/projects/6a5b8886fdae48368c6124d82c9b78f1/users/400b9e78ed3445f884992d3a5a379e44/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:37:27.178257 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-557255a1-e55e-4479-8aae-bccff4cf3fb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f51fa68184cd4807a95d48f6bb1b413c', 'request_id': 'req-557255a1-e55e-4479-8aae-bccff4cf3fb1'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:27.191853 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-557255a1-e55e-4479-8aae-bccff4cf3fb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f51fa68184cd4807a95d48f6bb1b413c', 'request_id': 'req-557255a1-e55e-4479-8aae-bccff4cf3fb1'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:27.199409 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-557255a1-e55e-4479-8aae-bccff4cf3fb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f51fa68184cd4807a95d48f6bb1b413c', 'request_id': 'req-557255a1-e55e-4479-8aae-bccff4cf3fb1'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:27.222236 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-557255a1-e55e-4479-8aae-bccff4cf3fb1 admin admin] The token cache is being invalidate because project f51fa68184cd4807a95d48f6bb1b413c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:37:27.222458 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-557255a1-e55e-4479-8aae-bccff4cf3fb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:27.229346 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-557255a1-e55e-4479-8aae-bccff4cf3fb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:27.232963 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1212/2431] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:37:27 2022] DELETE /identity/v3/projects/f51fa68184cd4807a95d48f6bb1b413c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:27.238516 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0062da-4fed-4e37-860f-a53d42252bfd None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:27.238809 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0062da-4fed-4e37-860f-a53d42252bfd None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:27.239089 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0062da-4fed-4e37-860f-a53d42252bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:27.279247 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-1f0062da-4fed-4e37-860f-a53d42252bfd None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:27.280483 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-1f0062da-4fed-4e37-860f-a53d42252bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:27.347822 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1220/2432] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:27.356865 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2397170-6e1f-4068-b2c3-6b9113e33b0b None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:27.357265 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2397170-6e1f-4068-b2c3-6b9113e33b0b None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:27.357690 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2397170-6e1f-4068-b2c3-6b9113e33b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:27.379472 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-a2397170-6e1f-4068-b2c3-6b9113e33b0b None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:27.380735 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-a2397170-6e1f-4068-b2c3-6b9113e33b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:27.389328 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1213/2433] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:27.393777 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0062da-4fed-4e37-860f-a53d42252bfd None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:27.404700 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0062da-4fed-4e37-860f-a53d42252bfd None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:27.410676 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff115dd-a3f5-4423-8758-d7154f6dfebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:27.411298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff115dd-a3f5-4423-8758-d7154f6dfebd admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:27.411583 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff115dd-a3f5-4423-8758-d7154f6dfebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:27.411869 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff115dd-a3f5-4423-8758-d7154f6dfebd admin admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:27.412677 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff115dd-a3f5-4423-8758-d7154f6dfebd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:37:27.412989 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff115dd-a3f5-4423-8758-d7154f6dfebd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:27.414597 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff115dd-a3f5-4423-8758-d7154f6dfebd admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:27.430180 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1221/2434] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:37:27.431267 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2397170-6e1f-4068-b2c3-6b9113e33b0b None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:27.440611 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2397170-6e1f-4068-b2c3-6b9113e33b0b None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:27.445774 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114422e1-79bc-421f-abdb-a9113aad9661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:27.446393 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114422e1-79bc-421f-abdb-a9113aad9661 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:27.446676 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114422e1-79bc-421f-abdb-a9113aad9661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:27.446956 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114422e1-79bc-421f-abdb-a9113aad9661 admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:27.447599 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114422e1-79bc-421f-abdb-a9113aad9661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:27.449563 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114422e1-79bc-421f-abdb-a9113aad9661 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:27.483941 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1214/2435] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:37:27 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:37:27.485338 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff115dd-a3f5-4423-8758-d7154f6dfebd admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:27.496925 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff115dd-a3f5-4423-8758-d7154f6dfebd admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:27.502712 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:27.577854 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc153b-0233-4a01-adba-96e4d9f32bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:27.578471 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc153b-0233-4a01-adba-96e4d9f32bbb admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:27.578759 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc153b-0233-4a01-adba-96e4d9f32bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:27.579040 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc153b-0233-4a01-adba-96e4d9f32bbb admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:27.579681 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc153b-0233-4a01-adba-96e4d9f32bbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:27.581628 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc153b-0233-4a01-adba-96e4d9f32bbb admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:27.606773 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1222/2436] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:37:27 2022] POST /identity/v3/users => generated 292 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:37:27.608053 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114422e1-79bc-421f-abdb-a9113aad9661 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:27.619063 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114422e1-79bc-421f-abdb-a9113aad9661 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:27.623967 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f102f-87c5-4d40-9abc-b8895b0789a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:27.624733 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f102f-87c5-4d40-9abc-b8895b0789a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:27.625078 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f102f-87c5-4d40-9abc-b8895b0789a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:27.625416 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f102f-87c5-4d40-9abc-b8895b0789a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:27.626133 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f102f-87c5-4d40-9abc-b8895b0789a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:27.627782 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f102f-87c5-4d40-9abc-b8895b0789a3 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:27.638407 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1215/2437] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:37:27.642370 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc153b-0233-4a01-adba-96e4d9f32bbb admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:27.652633 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc153b-0233-4a01-adba-96e4d9f32bbb admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:27.657970 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f20c97-142e-4965-ad3c-60909fb97494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:27.658577 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f20c97-142e-4965-ad3c-60909fb97494 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:27.658855 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f20c97-142e-4965-ad3c-60909fb97494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:27.659258 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f20c97-142e-4965-ad3c-60909fb97494 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:27.660522 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f20c97-142e-4965-ad3c-60909fb97494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:27.661539 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f20c97-142e-4965-ad3c-60909fb97494 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:27.672760 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1223/2438] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:37:27.677323 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f102f-87c5-4d40-9abc-b8895b0789a3 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:27.687332 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f102f-87c5-4d40-9abc-b8895b0789a3 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:27.692902 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1ed71-326a-4fbe-a5fc-087068cf698d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:27.693632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1ed71-326a-4fbe-a5fc-087068cf698d admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:27.693931 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1ed71-326a-4fbe-a5fc-087068cf698d admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:27.694212 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1ed71-326a-4fbe-a5fc-087068cf698d admin admin] PATH_INFO: `/v3/projects/3433184f71e94c95a90af73792f7d95f/users/fa6b0e88bbf84c0491318c45b95b6670/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:27.709043 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1ed71-326a-4fbe-a5fc-087068cf698d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3433184f71e94c95a90af73792f7d95f, user_id=fa6b0e88bbf84c0491318c45b95b6670, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:27.711718 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1ed71-326a-4fbe-a5fc-087068cf698d admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:27.726987 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1216/2439] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:37:27 2022] PUT /identity/v3/projects/3433184f71e94c95a90af73792f7d95f/users/fa6b0e88bbf84c0491318c45b95b6670/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:27.739183 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afed8c-4861-4117-87d2-89980ffcc7c6 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:27.739528 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afed8c-4861-4117-87d2-89980ffcc7c6 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:27.739817 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afed8c-4861-4117-87d2-89980ffcc7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:27.786296 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-d4afed8c-4861-4117-87d2-89980ffcc7c6 None None] MFA Rules not processed for user `fa6b0e88bbf84c0491318c45b95b6670`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:27.787910 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-d4afed8c-4861-4117-87d2-89980ffcc7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:27.797801 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d720c7a-1d4f-4054-9d86-06ecfe1e63f0 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:27.798088 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d720c7a-1d4f-4054-9d86-06ecfe1e63f0 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:27.798364 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d720c7a-1d4f-4054-9d86-06ecfe1e63f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:27.830198 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-2d720c7a-1d4f-4054-9d86-06ecfe1e63f0 None None] MFA Rules not processed for user `400b9e78ed3445f884992d3a5a379e44`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:27.831618 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-2d720c7a-1d4f-4054-9d86-06ecfe1e63f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:27.860630 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:27.873010 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1224/2440] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:27.877523 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afed8c-4861-4117-87d2-89980ffcc7c6 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:27.928810 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1217/2441] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:27 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:37:27.960254 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afed8c-4861-4117-87d2-89980ffcc7c6 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:27.965343 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828780a-02aa-466b-b19b-01f01a93c2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:27.966069 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828780a-02aa-466b-b19b-01f01a93c2b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:27.966463 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828780a-02aa-466b-b19b-01f01a93c2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:27.967030 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828780a-02aa-466b-b19b-01f01a93c2b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:27.967610 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828780a-02aa-466b-b19b-01f01a93c2b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:27.969672 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828780a-02aa-466b-b19b-01f01a93c2b4 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:28.000018 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1225/2442] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:37:27 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:37:28.004888 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d720c7a-1d4f-4054-9d86-06ecfe1e63f0 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:28.015841 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d720c7a-1d4f-4054-9d86-06ecfe1e63f0 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:28.075025 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6375438-f387-470f-82a3-4e219a721f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:28.075816 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6375438-f387-470f-82a3-4e219a721f26 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:28.076071 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6375438-f387-470f-82a3-4e219a721f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:28.076358 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6375438-f387-470f-82a3-4e219a721f26 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:28.077064 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6375438-f387-470f-82a3-4e219a721f26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:28.078997 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6375438-f387-470f-82a3-4e219a721f26 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:28.101648 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1218/2443] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:37:28 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:37:28.105698 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828780a-02aa-466b-b19b-01f01a93c2b4 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:28.111418 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:28.117808 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828780a-02aa-466b-b19b-01f01a93c2b4 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:28.123791 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37714d18-4e3b-4877-8979-49254d5a069d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:28.124386 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37714d18-4e3b-4877-8979-49254d5a069d admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:28.124704 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37714d18-4e3b-4877-8979-49254d5a069d admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:28.124989 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37714d18-4e3b-4877-8979-49254d5a069d admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:28.125641 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37714d18-4e3b-4877-8979-49254d5a069d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:28.127315 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37714d18-4e3b-4877-8979-49254d5a069d admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:28.141177 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1226/2444] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:37:28.142622 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6375438-f387-470f-82a3-4e219a721f26 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:28.152991 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6375438-f387-470f-82a3-4e219a721f26 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:28.157831 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43450f78-cc70-4ce1-8819-b3c90a0c2688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:28.158480 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43450f78-cc70-4ce1-8819-b3c90a0c2688 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:28.158769 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43450f78-cc70-4ce1-8819-b3c90a0c2688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:28.159048 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43450f78-cc70-4ce1-8819-b3c90a0c2688 admin admin] PATH_INFO: `/v3/projects/e0c03485f338442cb2bf01c727b0346e/users/b379302690ab4732a9ac769eb35e5b61/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:28.178637 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43450f78-cc70-4ce1-8819-b3c90a0c2688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0c03485f338442cb2bf01c727b0346e, user_id=b379302690ab4732a9ac769eb35e5b61, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:28.181355 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43450f78-cc70-4ce1-8819-b3c90a0c2688 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:28.194762 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1219/2445] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:37:28 2022] PUT /identity/v3/projects/e0c03485f338442cb2bf01c727b0346e/users/b379302690ab4732a9ac769eb35e5b61/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:28.198787 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37714d18-4e3b-4877-8979-49254d5a069d admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:28.208714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37714d18-4e3b-4877-8979-49254d5a069d admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:28.267880 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa2e69-5c5b-43aa-accc-77af92ebdeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:28.268505 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa2e69-5c5b-43aa-accc-77af92ebdeae admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:28.268864 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa2e69-5c5b-43aa-accc-77af92ebdeae admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:28.269154 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa2e69-5c5b-43aa-accc-77af92ebdeae admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:28.270032 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa2e69-5c5b-43aa-accc-77af92ebdeae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:28.271637 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa2e69-5c5b-43aa-accc-77af92ebdeae admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:28.287264 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1227/2446] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:37:28.288228 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43450f78-cc70-4ce1-8819-b3c90a0c2688 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:28.302508 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43450f78-cc70-4ce1-8819-b3c90a0c2688 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:28.307374 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd66d74-7ada-4fa3-916b-32657a98e525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:28.308040 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd66d74-7ada-4fa3-916b-32657a98e525 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:28.308331 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd66d74-7ada-4fa3-916b-32657a98e525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:28.308641 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd66d74-7ada-4fa3-916b-32657a98e525 admin admin] PATH_INFO: `/v3/projects/e0c03485f338442cb2bf01c727b0346e/users/b379302690ab4732a9ac769eb35e5b61/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:28.310622 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd66d74-7ada-4fa3-916b-32657a98e525 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0c03485f338442cb2bf01c727b0346e, user_id=b379302690ab4732a9ac769eb35e5b61, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:28.313301 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd66d74-7ada-4fa3-916b-32657a98e525 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:28.325146 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1220/2447] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:37:28 2022] PUT /identity/v3/projects/e0c03485f338442cb2bf01c727b0346e/users/b379302690ab4732a9ac769eb35e5b61/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:37:28.396143 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4f120-31ce-466b-99d7-9a07ca7ff000 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:28.396723 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4f120-31ce-466b-99d7-9a07ca7ff000 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:28.396723 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4f120-31ce-466b-99d7-9a07ca7ff000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:28.427695 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-b1f4f120-31ce-466b-99d7-9a07ca7ff000 None None] MFA Rules not processed for user `b379302690ab4732a9ac769eb35e5b61`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:28.428511 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-b1f4f120-31ce-466b-99d7-9a07ca7ff000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:28.541847 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1228/2448] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:28 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:28.554048 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd66d74-7ada-4fa3-916b-32657a98e525 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:28.555756 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-ecd66d74-7ada-4fa3-916b-32657a98e525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:28.616527 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd66d74-7ada-4fa3-916b-32657a98e525 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:28.620398 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdcc65-c8e9-413e-9440-9141d51d4a3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:28.621098 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdcc65-c8e9-413e-9440-9141d51d4a3d service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:28.621378 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdcc65-c8e9-413e-9440-9141d51d4a3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:28.621648 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdcc65-c8e9-413e-9440-9141d51d4a3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:28.631115 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cdcc65-c8e9-413e-9440-9141d51d4a3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:28.632536 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cdcc65-c8e9-413e-9440-9141d51d4a3d service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:28.642052 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1221/2449] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:37:28.754907 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4f120-31ce-466b-99d7-9a07ca7ff000 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:28.765281 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4f120-31ce-466b-99d7-9a07ca7ff000 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:28.768933 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b364a9-82f9-4a10-b0fb-a0b87200e859 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:28.770137 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b364a9-82f9-4a10-b0fb-a0b87200e859 service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:28.770431 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b364a9-82f9-4a10-b0fb-a0b87200e859 service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:28.770710 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b364a9-82f9-4a10-b0fb-a0b87200e859 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:28.829275 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b364a9-82f9-4a10-b0fb-a0b87200e859 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:28.830724 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b364a9-82f9-4a10-b0fb-a0b87200e859 service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:28.840498 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1229/2450] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:37:29.055106 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdcc65-c8e9-413e-9440-9141d51d4a3d service cinder] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:29.057038 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-b7cdcc65-c8e9-413e-9440-9141d51d4a3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:29.080485 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:29.130251 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdcc65-c8e9-413e-9440-9141d51d4a3d service cinder] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:29.136146 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07a0a8-5f7a-4623-b79b-48073e396052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:29.136917 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07a0a8-5f7a-4623-b79b-48073e396052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:29.137156 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07a0a8-5f7a-4623-b79b-48073e396052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:29.137468 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07a0a8-5f7a-4623-b79b-48073e396052 admin admin] PATH_INFO: `/v3/users/219367083bd041eeb4f10e6dd70e4cfc` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:29.138946 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07a0a8-5f7a-4623-b79b-48073e396052 admin admin] RBAC: Authorizing `identity:delete_user(user_id=219367083bd041eeb4f10e6dd70e4cfc)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:29.152587 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07a0a8-5f7a-4623-b79b-48073e396052 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:29.200808 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-8c07a0a8-5f7a-4623-b79b-48073e396052 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '219367083bd041eeb4f10e6dd70e4cfc'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:29.201578 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-8c07a0a8-5f7a-4623-b79b-48073e396052 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '219367083bd041eeb4f10e6dd70e4cfc'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:29.214797 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-8c07a0a8-5f7a-4623-b79b-48073e396052 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '219367083bd041eeb4f10e6dd70e4cfc'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:29.215524 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-8c07a0a8-5f7a-4623-b79b-48073e396052 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '219367083bd041eeb4f10e6dd70e4cfc'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:29.223632 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-8c07a0a8-5f7a-4623-b79b-48073e396052 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '219367083bd041eeb4f10e6dd70e4cfc'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:29.235751 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1222/2451] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:37:29 2022] DELETE /identity/v3/users/219367083bd041eeb4f10e6dd70e4cfc => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:29.411367 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b364a9-82f9-4a10-b0fb-a0b87200e859 service cinder] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:29.426074 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b364a9-82f9-4a10-b0fb-a0b87200e859 service cinder] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:29.435062 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:29.489243 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1016ca2-ff31-4a95-93a0-1acc522c3e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:29.489919 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1016ca2-ff31-4a95-93a0-1acc522c3e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:29.490205 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1016ca2-ff31-4a95-93a0-1acc522c3e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:29.490486 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1016ca2-ff31-4a95-93a0-1acc522c3e77 admin admin] PATH_INFO: `/v3/projects/6e8f24e1b6924b69a2258ab0b93429d9` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:29.491637 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1016ca2-ff31-4a95-93a0-1acc522c3e77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e8f24e1b6924b69a2258ab0b93429d9)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:29.493647 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1016ca2-ff31-4a95-93a0-1acc522c3e77 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:29.541322 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-e1016ca2-ff31-4a95-93a0-1acc522c3e77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e8f24e1b6924b69a2258ab0b93429d9', 'request_id': 'req-e1016ca2-ff31-4a95-93a0-1acc522c3e77'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:29.547799 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-e1016ca2-ff31-4a95-93a0-1acc522c3e77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e8f24e1b6924b69a2258ab0b93429d9', 'request_id': 'req-e1016ca2-ff31-4a95-93a0-1acc522c3e77'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:29.555357 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-e1016ca2-ff31-4a95-93a0-1acc522c3e77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e8f24e1b6924b69a2258ab0b93429d9', 'request_id': 'req-e1016ca2-ff31-4a95-93a0-1acc522c3e77'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:29.567451 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-e1016ca2-ff31-4a95-93a0-1acc522c3e77 admin admin] The token cache is being invalidate because project 6e8f24e1b6924b69a2258ab0b93429d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:37:29.567747 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-e1016ca2-ff31-4a95-93a0-1acc522c3e77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:29.568407 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-e1016ca2-ff31-4a95-93a0-1acc522c3e77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:29.569937 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1230/2452] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:37:29 2022] DELETE /identity/v3/projects/6e8f24e1b6924b69a2258ab0b93429d9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:29.574005 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07a0a8-5f7a-4623-b79b-48073e396052 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:29.575803 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-8c07a0a8-5f7a-4623-b79b-48073e396052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:29.589813 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07a0a8-5f7a-4623-b79b-48073e396052 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:29.648850 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279e3bc-0280-46dc-867d-18773e688bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:29.649492 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279e3bc-0280-46dc-867d-18773e688bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:29.649778 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279e3bc-0280-46dc-867d-18773e688bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:29.650529 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279e3bc-0280-46dc-867d-18773e688bf3 admin admin] PATH_INFO: `/v3/users/400b9e78ed3445f884992d3a5a379e44` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:29.651258 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7279e3bc-0280-46dc-867d-18773e688bf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=400b9e78ed3445f884992d3a5a379e44)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:29.653348 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7279e3bc-0280-46dc-867d-18773e688bf3 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:29.695570 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:29.701640 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-7279e3bc-0280-46dc-867d-18773e688bf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '400b9e78ed3445f884992d3a5a379e44'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:29.702803 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-7279e3bc-0280-46dc-867d-18773e688bf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '400b9e78ed3445f884992d3a5a379e44'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:29.716716 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-7279e3bc-0280-46dc-867d-18773e688bf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '400b9e78ed3445f884992d3a5a379e44'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:29.717406 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-7279e3bc-0280-46dc-867d-18773e688bf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '400b9e78ed3445f884992d3a5a379e44'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:29.725507 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-7279e3bc-0280-46dc-867d-18773e688bf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '400b9e78ed3445f884992d3a5a379e44'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:29.738490 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1223/2453] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:37:29 2022] DELETE /identity/v3/users/400b9e78ed3445f884992d3a5a379e44 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:37:29.930978 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1016ca2-ff31-4a95-93a0-1acc522c3e77 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:29.932568 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-e1016ca2-ff31-4a95-93a0-1acc522c3e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:29.948693 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1016ca2-ff31-4a95-93a0-1acc522c3e77 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:30.008261 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4926a7-de15-44d9-9cec-13ced38aa974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:30.008932 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4926a7-de15-44d9-9cec-13ced38aa974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:30.009221 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4926a7-de15-44d9-9cec-13ced38aa974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:30.009504 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4926a7-de15-44d9-9cec-13ced38aa974 admin admin] PATH_INFO: `/v3/projects/6a5b8886fdae48368c6124d82c9b78f1` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:30.010629 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4926a7-de15-44d9-9cec-13ced38aa974 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a5b8886fdae48368c6124d82c9b78f1)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:30.012523 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4926a7-de15-44d9-9cec-13ced38aa974 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:30.054618 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:30.058513 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-6c4926a7-de15-44d9-9cec-13ced38aa974 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a5b8886fdae48368c6124d82c9b78f1', 'request_id': 'req-6c4926a7-de15-44d9-9cec-13ced38aa974'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:30.065748 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-6c4926a7-de15-44d9-9cec-13ced38aa974 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a5b8886fdae48368c6124d82c9b78f1', 'request_id': 'req-6c4926a7-de15-44d9-9cec-13ced38aa974'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:30.073108 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-6c4926a7-de15-44d9-9cec-13ced38aa974 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a5b8886fdae48368c6124d82c9b78f1', 'request_id': 'req-6c4926a7-de15-44d9-9cec-13ced38aa974'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:30.083821 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-6c4926a7-de15-44d9-9cec-13ced38aa974 admin admin] The token cache is being invalidate because project 6a5b8886fdae48368c6124d82c9b78f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:37:30.084117 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-6c4926a7-de15-44d9-9cec-13ced38aa974 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:30.084789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-6c4926a7-de15-44d9-9cec-13ced38aa974 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:30.086281 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1231/2454] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:37:29 2022] DELETE /identity/v3/projects/6a5b8886fdae48368c6124d82c9b78f1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:30.091277 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d2830-a190-4336-8217-455e8a8edd42 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:30.091566 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d2830-a190-4336-8217-455e8a8edd42 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:30.091879 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d2830-a190-4336-8217-455e8a8edd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:30.111329 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-cc9d2830-a190-4336-8217-455e8a8edd42 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:30.112530 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-cc9d2830-a190-4336-8217-455e8a8edd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:30.172098 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1224/2455] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:30.181732 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b3201-ddbd-41ba-98da-b748e8773b8e None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:30.182164 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b3201-ddbd-41ba-98da-b748e8773b8e None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:30.182448 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b3201-ddbd-41ba-98da-b748e8773b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:30.202705 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-1a9b3201-ddbd-41ba-98da-b748e8773b8e None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:30.203892 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-1a9b3201-ddbd-41ba-98da-b748e8773b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:30.212500 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1232/2456] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:30.216818 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d2830-a190-4336-8217-455e8a8edd42 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:30.226859 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d2830-a190-4336-8217-455e8a8edd42 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:30.232272 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108fea3-b964-43ca-9f70-2bffb54644d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:30.232915 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108fea3-b964-43ca-9f70-2bffb54644d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:30.233202 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108fea3-b964-43ca-9f70-2bffb54644d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:30.233501 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108fea3-b964-43ca-9f70-2bffb54644d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:30.234319 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108fea3-b964-43ca-9f70-2bffb54644d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:37:30.234651 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108fea3-b964-43ca-9f70-2bffb54644d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:30.236327 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108fea3-b964-43ca-9f70-2bffb54644d7 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:30.249062 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1225/2457] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:37:30.256889 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b3201-ddbd-41ba-98da-b748e8773b8e None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:30.264438 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b3201-ddbd-41ba-98da-b748e8773b8e None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:30.269261 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174a54f-13d9-46c7-b704-5c72b91b67bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:30.269935 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174a54f-13d9-46c7-b704-5c72b91b67bd admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:30.270215 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174a54f-13d9-46c7-b704-5c72b91b67bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:30.270486 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174a54f-13d9-46c7-b704-5c72b91b67bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:30.271114 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174a54f-13d9-46c7-b704-5c72b91b67bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:30.273048 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174a54f-13d9-46c7-b704-5c72b91b67bd admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:30.302789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1233/2458] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:37:30 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:37:30.307084 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108fea3-b964-43ca-9f70-2bffb54644d7 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:30.327198 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108fea3-b964-43ca-9f70-2bffb54644d7 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:30.388593 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e7fab-7234-4fdb-9280-d1b628858709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:30.389278 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e7fab-7234-4fdb-9280-d1b628858709 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:30.389570 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e7fab-7234-4fdb-9280-d1b628858709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:30.389856 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e7fab-7234-4fdb-9280-d1b628858709 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:30.390522 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e7fab-7234-4fdb-9280-d1b628858709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:30.392445 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e7fab-7234-4fdb-9280-d1b628858709 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:30.415595 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1226/2459] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:37:30 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:37:30.419871 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174a54f-13d9-46c7-b704-5c72b91b67bd admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:30.432198 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174a54f-13d9-46c7-b704-5c72b91b67bd admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:30.437306 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd938a-c7b4-4344-9067-578573d533b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:30.437944 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd938a-c7b4-4344-9067-578573d533b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:30.438232 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd938a-c7b4-4344-9067-578573d533b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:30.438515 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd938a-c7b4-4344-9067-578573d533b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:30.439172 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd938a-c7b4-4344-9067-578573d533b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:30.440857 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd938a-c7b4-4344-9067-578573d533b0 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:30.451018 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1234/2460] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:37:30.455359 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e7fab-7234-4fdb-9280-d1b628858709 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:30.465606 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e7fab-7234-4fdb-9280-d1b628858709 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:30.470348 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167f9ce-571e-41b9-9f8b-5ff98f3c369f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:30.471224 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167f9ce-571e-41b9-9f8b-5ff98f3c369f admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:30.471559 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167f9ce-571e-41b9-9f8b-5ff98f3c369f admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:30.471838 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167f9ce-571e-41b9-9f8b-5ff98f3c369f admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:30.473213 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167f9ce-571e-41b9-9f8b-5ff98f3c369f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:30.475028 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167f9ce-571e-41b9-9f8b-5ff98f3c369f admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:30.485906 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1227/2461] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:37:30.490610 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd938a-c7b4-4344-9067-578573d533b0 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:30.500617 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd938a-c7b4-4344-9067-578573d533b0 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:30.505567 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23071974-da00-4d5e-ad54-304ed23677ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:30.506216 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23071974-da00-4d5e-ad54-304ed23677ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:30.506498 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23071974-da00-4d5e-ad54-304ed23677ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:30.506775 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23071974-da00-4d5e-ad54-304ed23677ca admin admin] PATH_INFO: `/v3/projects/b8e098abf26c4dba95566fb1065e5ca0/users/facebba8a3734c38a571d4c732ced8bf/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:30.522678 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23071974-da00-4d5e-ad54-304ed23677ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e098abf26c4dba95566fb1065e5ca0, user_id=facebba8a3734c38a571d4c732ced8bf, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:30.525828 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23071974-da00-4d5e-ad54-304ed23677ca admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:30.539127 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1235/2462] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:37:30 2022] PUT /identity/v3/projects/b8e098abf26c4dba95566fb1065e5ca0/users/facebba8a3734c38a571d4c732ced8bf/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:30.549872 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9d6da-bd17-4e88-addc-21202cb6059a None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:30.550214 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9d6da-bd17-4e88-addc-21202cb6059a None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:30.550444 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9d6da-bd17-4e88-addc-21202cb6059a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:30.578695 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-efd9d6da-bd17-4e88-addc-21202cb6059a None None] MFA Rules not processed for user `facebba8a3734c38a571d4c732ced8bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:30.579905 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-efd9d6da-bd17-4e88-addc-21202cb6059a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:30.589128 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:30.651163 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1228/2463] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:30.655811 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23071974-da00-4d5e-ad54-304ed23677ca admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:30.717966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23071974-da00-4d5e-ad54-304ed23677ca admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:30.723458 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9bc57-6bac-48a7-b858-9fab2805bec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:30.724057 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9bc57-6bac-48a7-b858-9fab2805bec0 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:30.724337 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9bc57-6bac-48a7-b858-9fab2805bec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:30.724643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9bc57-6bac-48a7-b858-9fab2805bec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:30.725278 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9bc57-6bac-48a7-b858-9fab2805bec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:30.727156 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9bc57-6bac-48a7-b858-9fab2805bec0 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:30.752221 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1236/2464] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:37:30 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:37:30.756370 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9d6da-bd17-4e88-addc-21202cb6059a None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:30.768366 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9d6da-bd17-4e88-addc-21202cb6059a None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:30.824918 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f3eca-3949-4180-ac60-a4bd1db15cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:30.825523 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f3eca-3949-4180-ac60-a4bd1db15cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:30.825839 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f3eca-3949-4180-ac60-a4bd1db15cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:30.826121 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f3eca-3949-4180-ac60-a4bd1db15cf9 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:30.826759 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f3eca-3949-4180-ac60-a4bd1db15cf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:30.828693 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f3eca-3949-4180-ac60-a4bd1db15cf9 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:30.848762 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1229/2465] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:37:30 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:37:30.852634 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9bc57-6bac-48a7-b858-9fab2805bec0 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:30.862703 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9bc57-6bac-48a7-b858-9fab2805bec0 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:30.867725 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd620016-cd38-4125-a4af-c7250dc8af8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:30.868318 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd620016-cd38-4125-a4af-c7250dc8af8c admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:30.868631 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd620016-cd38-4125-a4af-c7250dc8af8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:30.868907 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd620016-cd38-4125-a4af-c7250dc8af8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:30.869573 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd620016-cd38-4125-a4af-c7250dc8af8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:30.871150 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd620016-cd38-4125-a4af-c7250dc8af8c admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:30.883077 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1237/2466] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:37:30.887045 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f3eca-3949-4180-ac60-a4bd1db15cf9 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:30.896963 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f3eca-3949-4180-ac60-a4bd1db15cf9 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:30.901542 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d1bbd-66d9-49e7-b0f4-6b642c704ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:30.902174 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d1bbd-66d9-49e7-b0f4-6b642c704ba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:30.902455 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d1bbd-66d9-49e7-b0f4-6b642c704ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:30.902729 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d1bbd-66d9-49e7-b0f4-6b642c704ba6 admin admin] PATH_INFO: `/v3/projects/a53c30f4e5d6430a96f7fa5631f88712/users/a4487ba7d39a497d8276592f2d2468cc/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:30.917135 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d1bbd-66d9-49e7-b0f4-6b642c704ba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a53c30f4e5d6430a96f7fa5631f88712, user_id=a4487ba7d39a497d8276592f2d2468cc, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:30.920119 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d1bbd-66d9-49e7-b0f4-6b642c704ba6 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:30.934942 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1230/2467] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:37:30 2022] PUT /identity/v3/projects/a53c30f4e5d6430a96f7fa5631f88712/users/a4487ba7d39a497d8276592f2d2468cc/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:30.939051 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd620016-cd38-4125-a4af-c7250dc8af8c admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:30.950411 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd620016-cd38-4125-a4af-c7250dc8af8c admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:30.991245 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:31.009842 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05119d50-a6b6-4c9d-b30e-1c9def070df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:31.010456 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05119d50-a6b6-4c9d-b30e-1c9def070df6 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:31.010743 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05119d50-a6b6-4c9d-b30e-1c9def070df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:31.011026 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05119d50-a6b6-4c9d-b30e-1c9def070df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:31.011677 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05119d50-a6b6-4c9d-b30e-1c9def070df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:31.013292 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05119d50-a6b6-4c9d-b30e-1c9def070df6 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:31.023234 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1238/2468] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:37:31.027253 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d1bbd-66d9-49e7-b0f4-6b642c704ba6 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:31.039684 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d1bbd-66d9-49e7-b0f4-6b642c704ba6 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:31.044288 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25d6f8-9fd6-4fba-b1f4-080b27979252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:31.044998 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25d6f8-9fd6-4fba-b1f4-080b27979252 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:31.045268 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25d6f8-9fd6-4fba-b1f4-080b27979252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:31.045539 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25d6f8-9fd6-4fba-b1f4-080b27979252 admin admin] PATH_INFO: `/v3/projects/a53c30f4e5d6430a96f7fa5631f88712/users/a4487ba7d39a497d8276592f2d2468cc/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:31.047420 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc25d6f8-9fd6-4fba-b1f4-080b27979252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a53c30f4e5d6430a96f7fa5631f88712, user_id=a4487ba7d39a497d8276592f2d2468cc, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:31.050078 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc25d6f8-9fd6-4fba-b1f4-080b27979252 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:31.061411 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1231/2469] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:37:31 2022] PUT /identity/v3/projects/a53c30f4e5d6430a96f7fa5631f88712/users/a4487ba7d39a497d8276592f2d2468cc/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:31.073943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61b669-91c6-494f-89dc-a123084e5dc8 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:31.074274 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61b669-91c6-494f-89dc-a123084e5dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:31.074594 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61b669-91c6-494f-89dc-a123084e5dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:31.110883 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-8d61b669-91c6-494f-89dc-a123084e5dc8 None None] MFA Rules not processed for user `a4487ba7d39a497d8276592f2d2468cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:31.112340 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-8d61b669-91c6-494f-89dc-a123084e5dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:31.183263 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1239/2470] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:37:31.194658 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25d6f8-9fd6-4fba-b1f4-080b27979252 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:31.196419 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-bc25d6f8-9fd6-4fba-b1f4-080b27979252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:31.257890 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25d6f8-9fd6-4fba-b1f4-080b27979252 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:31.261544 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931dc68-f11d-471f-8690-f8079b5e863e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:31.262142 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931dc68-f11d-471f-8690-f8079b5e863e service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:31.262426 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931dc68-f11d-471f-8690-f8079b5e863e service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:31.262693 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931dc68-f11d-471f-8690-f8079b5e863e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:31.271883 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931dc68-f11d-471f-8690-f8079b5e863e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:31.273441 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931dc68-f11d-471f-8690-f8079b5e863e service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:31.283349 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1232/2471] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:37:31.465071 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61b669-91c6-494f-89dc-a123084e5dc8 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:31.466607 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-8d61b669-91c6-494f-89dc-a123084e5dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:31.537321 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61b669-91c6-494f-89dc-a123084e5dc8 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:31.541960 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2221b8-f7ed-45a4-8fc0-fab7c388f40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:31.542598 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2221b8-f7ed-45a4-8fc0-fab7c388f40f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:31.542881 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2221b8-f7ed-45a4-8fc0-fab7c388f40f admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:31.543232 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2221b8-f7ed-45a4-8fc0-fab7c388f40f admin admin] PATH_INFO: `/v3/users/fa6b0e88bbf84c0491318c45b95b6670` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:31.547373 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2221b8-f7ed-45a4-8fc0-fab7c388f40f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa6b0e88bbf84c0491318c45b95b6670)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:31.549316 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2221b8-f7ed-45a4-8fc0-fab7c388f40f admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:31.605503 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0e2221b8-f7ed-45a4-8fc0-fab7c388f40f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa6b0e88bbf84c0491318c45b95b6670'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:31.606181 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0e2221b8-f7ed-45a4-8fc0-fab7c388f40f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa6b0e88bbf84c0491318c45b95b6670'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:31.613692 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0e2221b8-f7ed-45a4-8fc0-fab7c388f40f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa6b0e88bbf84c0491318c45b95b6670'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:31.614303 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0e2221b8-f7ed-45a4-8fc0-fab7c388f40f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa6b0e88bbf84c0491318c45b95b6670'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:31.621596 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:31.628768 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-0e2221b8-f7ed-45a4-8fc0-fab7c388f40f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa6b0e88bbf84c0491318c45b95b6670'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:31.642558 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1240/2472] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:37:31 2022] DELETE /identity/v3/users/fa6b0e88bbf84c0491318c45b95b6670 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:31.647624 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51060daa-6f3d-4b78-9494-acd2c72e8430 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:31.648103 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51060daa-6f3d-4b78-9494-acd2c72e8430 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:31.648416 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51060daa-6f3d-4b78-9494-acd2c72e8430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:31.662648 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:31.669794 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-51060daa-6f3d-4b78-9494-acd2c72e8430 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:31.671072 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-51060daa-6f3d-4b78-9494-acd2c72e8430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:31.687117 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2221b8-f7ed-45a4-8fc0-fab7c388f40f admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:31.688618 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-0e2221b8-f7ed-45a4-8fc0-fab7c388f40f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:31.735758 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1233/2473] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:31.745762 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51060daa-6f3d-4b78-9494-acd2c72e8430 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:31.747114 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-51060daa-6f3d-4b78-9494-acd2c72e8430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:31.755519 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2221b8-f7ed-45a4-8fc0-fab7c388f40f admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:31.760253 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8fd90-09ef-49f7-bba0-0b8dadd9fd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:31.760957 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8fd90-09ef-49f7-bba0-0b8dadd9fd31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:31.761239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8fd90-09ef-49f7-bba0-0b8dadd9fd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:31.761517 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8fd90-09ef-49f7-bba0-0b8dadd9fd31 admin admin] PATH_INFO: `/v3/users/facebba8a3734c38a571d4c732ced8bf` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:31.762639 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8fd90-09ef-49f7-bba0-0b8dadd9fd31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=facebba8a3734c38a571d4c732ced8bf)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:31.764533 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8fd90-09ef-49f7-bba0-0b8dadd9fd31 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:31.806011 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51060daa-6f3d-4b78-9494-acd2c72e8430 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:31.809604 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f0778-4ecd-42c7-afa6-436860075356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:31.810206 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f0778-4ecd-42c7-afa6-436860075356 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:31.810487 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f0778-4ecd-42c7-afa6-436860075356 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:31.810762 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f0778-4ecd-42c7-afa6-436860075356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:31.811657 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-cbd8fd90-09ef-49f7-bba0-0b8dadd9fd31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'facebba8a3734c38a571d4c732ced8bf'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:31.812329 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-cbd8fd90-09ef-49f7-bba0-0b8dadd9fd31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'facebba8a3734c38a571d4c732ced8bf'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:31.820895 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f0778-4ecd-42c7-afa6-436860075356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:31.821338 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-cbd8fd90-09ef-49f7-bba0-0b8dadd9fd31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'facebba8a3734c38a571d4c732ced8bf'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:31.822105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-cbd8fd90-09ef-49f7-bba0-0b8dadd9fd31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'facebba8a3734c38a571d4c732ced8bf'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:31.822393 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f0778-4ecd-42c7-afa6-436860075356 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:31.834093 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1234/2474] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:37:31.836142 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-cbd8fd90-09ef-49f7-bba0-0b8dadd9fd31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'facebba8a3734c38a571d4c732ced8bf'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:31.851539 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1241/2475] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:37:31 2022] DELETE /identity/v3/users/facebba8a3734c38a571d4c732ced8bf => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:37:31.856060 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25046f46-eea9-4460-87c0-611f24344c99 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:31.856354 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25046f46-eea9-4460-87c0-611f24344c99 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:31.856664 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25046f46-eea9-4460-87c0-611f24344c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:31.875525 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-25046f46-eea9-4460-87c0-611f24344c99 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:31.876683 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-25046f46-eea9-4460-87c0-611f24344c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:31.937042 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1235/2476] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:31.947599 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8fd90-09ef-49f7-bba0-0b8dadd9fd31 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:31.949180 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-cbd8fd90-09ef-49f7-bba0-0b8dadd9fd31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:32.011338 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8fd90-09ef-49f7-bba0-0b8dadd9fd31 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:32.015105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5463ef-dbfe-4935-a6e2-bb1802043a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:32.015714 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5463ef-dbfe-4935-a6e2-bb1802043a21 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:32.016013 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5463ef-dbfe-4935-a6e2-bb1802043a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:32.016271 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5463ef-dbfe-4935-a6e2-bb1802043a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:32.025957 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5463ef-dbfe-4935-a6e2-bb1802043a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:32.027395 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5463ef-dbfe-4935-a6e2-bb1802043a21 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:32.036955 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1242/2477] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:37:32.155445 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25046f46-eea9-4460-87c0-611f24344c99 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:32.157077 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-25046f46-eea9-4460-87c0-611f24344c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:32.173861 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25046f46-eea9-4460-87c0-611f24344c99 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:32.181556 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31cf85-f7d1-47e4-b42c-0bda94d0f91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:32.182469 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31cf85-f7d1-47e4-b42c-0bda94d0f91f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:32.182966 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31cf85-f7d1-47e4-b42c-0bda94d0f91f admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:32.183801 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31cf85-f7d1-47e4-b42c-0bda94d0f91f admin admin] PATH_INFO: `/v3/projects/3433184f71e94c95a90af73792f7d95f` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:32.185918 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e31cf85-f7d1-47e4-b42c-0bda94d0f91f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3433184f71e94c95a90af73792f7d95f)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:32.188609 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e31cf85-f7d1-47e4-b42c-0bda94d0f91f admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:32.243039 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:32.246427 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-6e31cf85-f7d1-47e4-b42c-0bda94d0f91f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3433184f71e94c95a90af73792f7d95f', 'request_id': 'req-6e31cf85-f7d1-47e4-b42c-0bda94d0f91f'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:32.254902 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-6e31cf85-f7d1-47e4-b42c-0bda94d0f91f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3433184f71e94c95a90af73792f7d95f', 'request_id': 'req-6e31cf85-f7d1-47e4-b42c-0bda94d0f91f'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:32.263871 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-6e31cf85-f7d1-47e4-b42c-0bda94d0f91f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3433184f71e94c95a90af73792f7d95f', 'request_id': 'req-6e31cf85-f7d1-47e4-b42c-0bda94d0f91f'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:32.278378 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-6e31cf85-f7d1-47e4-b42c-0bda94d0f91f admin admin] The token cache is being invalidate because project 3433184f71e94c95a90af73792f7d95f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:37:32.278739 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-6e31cf85-f7d1-47e4-b42c-0bda94d0f91f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:32.279502 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-6e31cf85-f7d1-47e4-b42c-0bda94d0f91f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:32.281548 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1236/2478] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:37:32 2022] DELETE /identity/v3/projects/3433184f71e94c95a90af73792f7d95f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:32.285788 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5463ef-dbfe-4935-a6e2-bb1802043a21 service neutron] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:32.292093 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:32.296466 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5463ef-dbfe-4935-a6e2-bb1802043a21 service neutron] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:32.359093 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38527e7-3b30-4297-b0fd-1033ca639ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:32.359738 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38527e7-3b30-4297-b0fd-1033ca639ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:32.360026 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38527e7-3b30-4297-b0fd-1033ca639ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:32.360314 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38527e7-3b30-4297-b0fd-1033ca639ad3 admin admin] PATH_INFO: `/v3/users/b379302690ab4732a9ac769eb35e5b61` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:32.361698 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38527e7-3b30-4297-b0fd-1033ca639ad3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b379302690ab4732a9ac769eb35e5b61)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:32.364257 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38527e7-3b30-4297-b0fd-1033ca639ad3 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:32.389693 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31cf85-f7d1-47e4-b42c-0bda94d0f91f admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:32.391277 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-6e31cf85-f7d1-47e4-b42c-0bda94d0f91f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:32.404412 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31cf85-f7d1-47e4-b42c-0bda94d0f91f admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:32.409217 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2d5e5-e4d2-441f-bc4c-b32382b2e94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:32.410043 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2d5e5-e4d2-441f-bc4c-b32382b2e94c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:32.410335 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2d5e5-e4d2-441f-bc4c-b32382b2e94c admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:32.410744 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2d5e5-e4d2-441f-bc4c-b32382b2e94c admin admin] PATH_INFO: `/v3/projects/b8e098abf26c4dba95566fb1065e5ca0` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:32.411946 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2d5e5-e4d2-441f-bc4c-b32382b2e94c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8e098abf26c4dba95566fb1065e5ca0)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:32.413886 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2d5e5-e4d2-441f-bc4c-b32382b2e94c admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:32.422862 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-d38527e7-3b30-4297-b0fd-1033ca639ad3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b379302690ab4732a9ac769eb35e5b61'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:32.423571 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-d38527e7-3b30-4297-b0fd-1033ca639ad3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b379302690ab4732a9ac769eb35e5b61'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:32.431738 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-d38527e7-3b30-4297-b0fd-1033ca639ad3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b379302690ab4732a9ac769eb35e5b61'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:32.432423 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-d38527e7-3b30-4297-b0fd-1033ca639ad3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b379302690ab4732a9ac769eb35e5b61'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:32.446176 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-d38527e7-3b30-4297-b0fd-1033ca639ad3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b379302690ab4732a9ac769eb35e5b61'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:32.461570 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1243/2479] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:37:32 2022] DELETE /identity/v3/users/b379302690ab4732a9ac769eb35e5b61 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:37:32.467068 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-84d2d5e5-e4d2-441f-bc4c-b32382b2e94c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8e098abf26c4dba95566fb1065e5ca0', 'request_id': 'req-84d2d5e5-e4d2-441f-bc4c-b32382b2e94c'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:32.474336 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-84d2d5e5-e4d2-441f-bc4c-b32382b2e94c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8e098abf26c4dba95566fb1065e5ca0', 'request_id': 'req-84d2d5e5-e4d2-441f-bc4c-b32382b2e94c'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:32.481114 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-84d2d5e5-e4d2-441f-bc4c-b32382b2e94c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8e098abf26c4dba95566fb1065e5ca0', 'request_id': 'req-84d2d5e5-e4d2-441f-bc4c-b32382b2e94c'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:32.494858 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-84d2d5e5-e4d2-441f-bc4c-b32382b2e94c admin admin] The token cache is being invalidate because project b8e098abf26c4dba95566fb1065e5ca0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:37:32.495164 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-84d2d5e5-e4d2-441f-bc4c-b32382b2e94c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:32.495970 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-84d2d5e5-e4d2-441f-bc4c-b32382b2e94c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:32.497988 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1237/2480] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:37:32 2022] DELETE /identity/v3/projects/b8e098abf26c4dba95566fb1065e5ca0 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:37:32.502486 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38527e7-3b30-4297-b0fd-1033ca639ad3 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:32.505003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-d38527e7-3b30-4297-b0fd-1033ca639ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:32.576856 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38527e7-3b30-4297-b0fd-1033ca639ad3 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:32.581587 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9cff1-fd0b-4a69-b348-4be1d54c6367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:32.582254 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9cff1-fd0b-4a69-b348-4be1d54c6367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:32.582540 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9cff1-fd0b-4a69-b348-4be1d54c6367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:32.582817 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9cff1-fd0b-4a69-b348-4be1d54c6367 admin admin] PATH_INFO: `/v3/users/a4487ba7d39a497d8276592f2d2468cc` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:32.583950 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9cff1-fd0b-4a69-b348-4be1d54c6367 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4487ba7d39a497d8276592f2d2468cc)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:32.585899 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9cff1-fd0b-4a69-b348-4be1d54c6367 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:32.618615 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:32.641776 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-1fc9cff1-fd0b-4a69-b348-4be1d54c6367 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4487ba7d39a497d8276592f2d2468cc'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:32.642506 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-1fc9cff1-fd0b-4a69-b348-4be1d54c6367 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4487ba7d39a497d8276592f2d2468cc'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:32.649449 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-1fc9cff1-fd0b-4a69-b348-4be1d54c6367 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4487ba7d39a497d8276592f2d2468cc'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:32.650116 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-1fc9cff1-fd0b-4a69-b348-4be1d54c6367 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4487ba7d39a497d8276592f2d2468cc'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:32.662810 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-1fc9cff1-fd0b-4a69-b348-4be1d54c6367 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4487ba7d39a497d8276592f2d2468cc'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:32.676411 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1244/2481] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:37:32 2022] DELETE /identity/v3/users/a4487ba7d39a497d8276592f2d2468cc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:32.743970 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2d5e5-e4d2-441f-bc4c-b32382b2e94c admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:32.745464 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-84d2d5e5-e4d2-441f-bc4c-b32382b2e94c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:32.818331 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2d5e5-e4d2-441f-bc4c-b32382b2e94c admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:32.882761 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021bcc7-c372-43c4-b02a-57a69841f251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:32.883395 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021bcc7-c372-43c4-b02a-57a69841f251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:32.883677 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021bcc7-c372-43c4-b02a-57a69841f251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:32.883957 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021bcc7-c372-43c4-b02a-57a69841f251 admin admin] PATH_INFO: `/v3/projects/e0c03485f338442cb2bf01c727b0346e` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:32.885110 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021bcc7-c372-43c4-b02a-57a69841f251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0c03485f338442cb2bf01c727b0346e)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:32.887065 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021bcc7-c372-43c4-b02a-57a69841f251 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:32.893486 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:32.938251 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-3021bcc7-c372-43c4-b02a-57a69841f251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0c03485f338442cb2bf01c727b0346e', 'request_id': 'req-3021bcc7-c372-43c4-b02a-57a69841f251'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:32.944863 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-3021bcc7-c372-43c4-b02a-57a69841f251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0c03485f338442cb2bf01c727b0346e', 'request_id': 'req-3021bcc7-c372-43c4-b02a-57a69841f251'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:32.951877 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-3021bcc7-c372-43c4-b02a-57a69841f251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0c03485f338442cb2bf01c727b0346e', 'request_id': 'req-3021bcc7-c372-43c4-b02a-57a69841f251'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:32.963615 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9cff1-fd0b-4a69-b348-4be1d54c6367 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:32.964331 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-3021bcc7-c372-43c4-b02a-57a69841f251 admin admin] The token cache is being invalidate because project e0c03485f338442cb2bf01c727b0346e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:37:32.964719 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-3021bcc7-c372-43c4-b02a-57a69841f251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:32.965034 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-1fc9cff1-fd0b-4a69-b348-4be1d54c6367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:32.965539 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-3021bcc7-c372-43c4-b02a-57a69841f251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:32.967294 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1238/2482] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:37:32 2022] DELETE /identity/v3/projects/e0c03485f338442cb2bf01c727b0346e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:32.972011 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c985452-075b-4584-8c32-4e952a8fc3e4 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:32.972385 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c985452-075b-4584-8c32-4e952a8fc3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:32.972791 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c985452-075b-4584-8c32-4e952a8fc3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:32.980776 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9cff1-fd0b-4a69-b348-4be1d54c6367 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:32.994114 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-2c985452-075b-4584-8c32-4e952a8fc3e4 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:32.995356 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-2c985452-075b-4584-8c32-4e952a8fc3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:33.039550 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9126b0d-a241-405f-86c9-fdb44767151e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:33.040322 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9126b0d-a241-405f-86c9-fdb44767151e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:33.040618 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9126b0d-a241-405f-86c9-fdb44767151e admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:33.040894 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9126b0d-a241-405f-86c9-fdb44767151e admin admin] PATH_INFO: `/v3/projects/a53c30f4e5d6430a96f7fa5631f88712` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:33.042039 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9126b0d-a241-405f-86c9-fdb44767151e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a53c30f4e5d6430a96f7fa5631f88712)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:33.043936 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9126b0d-a241-405f-86c9-fdb44767151e admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:33.055903 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1239/2483] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:37:33.063597 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7c8fc-959a-4c24-af05-5813ca5679b3 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:33.063997 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7c8fc-959a-4c24-af05-5813ca5679b3 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:33.064370 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7c8fc-959a-4c24-af05-5813ca5679b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:33.084652 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-96e7c8fc-959a-4c24-af05-5813ca5679b3 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:33.085858 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-96e7c8fc-959a-4c24-af05-5813ca5679b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:33.092986 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-b9126b0d-a241-405f-86c9-fdb44767151e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a53c30f4e5d6430a96f7fa5631f88712', 'request_id': 'req-b9126b0d-a241-405f-86c9-fdb44767151e'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:33.100042 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-b9126b0d-a241-405f-86c9-fdb44767151e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a53c30f4e5d6430a96f7fa5631f88712', 'request_id': 'req-b9126b0d-a241-405f-86c9-fdb44767151e'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:33.108109 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-b9126b0d-a241-405f-86c9-fdb44767151e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a53c30f4e5d6430a96f7fa5631f88712', 'request_id': 'req-b9126b0d-a241-405f-86c9-fdb44767151e'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:33.121024 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-b9126b0d-a241-405f-86c9-fdb44767151e admin admin] The token cache is being invalidate because project a53c30f4e5d6430a96f7fa5631f88712 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:37:33.121433 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-b9126b0d-a241-405f-86c9-fdb44767151e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:33.122076 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-b9126b0d-a241-405f-86c9-fdb44767151e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:33.123587 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1245/2484] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:37:32 2022] DELETE /identity/v3/projects/a53c30f4e5d6430a96f7fa5631f88712 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:37:33.128635 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a08f7f-4e21-420b-aa57-11b36222f796 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:33.129685 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a08f7f-4e21-420b-aa57-11b36222f796 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:33.129966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a08f7f-4e21-420b-aa57-11b36222f796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:33.147689 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1240/2485] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:37:33.149043 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-70a08f7f-4e21-420b-aa57-11b36222f796 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:33.150225 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-70a08f7f-4e21-420b-aa57-11b36222f796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:33.151933 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7c8fc-959a-4c24-af05-5813ca5679b3 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:33.158167 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1246/2486] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:37:33.161043 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7c8fc-959a-4c24-af05-5813ca5679b3 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:33.165752 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307ecff-dfd4-4e60-870c-97744a24e96e None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:33.165885 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e65774-3e9d-4a3d-9a16-a74616b9a61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:33.166037 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307ecff-dfd4-4e60-870c-97744a24e96e None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:33.166310 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307ecff-dfd4-4e60-870c-97744a24e96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:33.166410 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e65774-3e9d-4a3d-9a16-a74616b9a61e admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:33.166679 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e65774-3e9d-4a3d-9a16-a74616b9a61e admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:33.166956 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e65774-3e9d-4a3d-9a16-a74616b9a61e admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:33.167605 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e65774-3e9d-4a3d-9a16-a74616b9a61e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:37:33.167914 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e65774-3e9d-4a3d-9a16-a74616b9a61e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:33.169528 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e65774-3e9d-4a3d-9a16-a74616b9a61e admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:33.185073 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1241/2487] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:37:33.186025 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e65774-3e9d-4a3d-9a16-a74616b9a61e admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:33.189217 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-8307ecff-dfd4-4e60-870c-97744a24e96e None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:33.190414 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-8307ecff-dfd4-4e60-870c-97744a24e96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:33.196028 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e65774-3e9d-4a3d-9a16-a74616b9a61e admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:33.199129 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1247/2488] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:37:33.200677 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953124e1-d873-4605-b6e3-c2227286b81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:33.201249 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953124e1-d873-4605-b6e3-c2227286b81d admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:33.201533 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953124e1-d873-4605-b6e3-c2227286b81d admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:33.201855 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953124e1-d873-4605-b6e3-c2227286b81d admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:33.202513 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953124e1-d873-4605-b6e3-c2227286b81d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:33.203009 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307ecff-dfd4-4e60-870c-97744a24e96e None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:33.204376 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953124e1-d873-4605-b6e3-c2227286b81d admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:33.212380 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307ecff-dfd4-4e60-870c-97744a24e96e None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:33.217063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237c5b5-c314-4aa4-9ff9-e9e2b54eaec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:33.217653 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237c5b5-c314-4aa4-9ff9-e9e2b54eaec1 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:33.217933 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237c5b5-c314-4aa4-9ff9-e9e2b54eaec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:33.218205 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237c5b5-c314-4aa4-9ff9-e9e2b54eaec1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:33.218849 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237c5b5-c314-4aa4-9ff9-e9e2b54eaec1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:37:33.219154 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237c5b5-c314-4aa4-9ff9-e9e2b54eaec1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:33.220833 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237c5b5-c314-4aa4-9ff9-e9e2b54eaec1 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:33.226688 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:33.235934 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1242/2490] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:37:33 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:37:33.239242 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1248/2489] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 20:37:33.240519 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237c5b5-c314-4aa4-9ff9-e9e2b54eaec1 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:33.240752 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953124e1-d873-4605-b6e3-c2227286b81d admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:33.250387 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237c5b5-c314-4aa4-9ff9-e9e2b54eaec1 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:33.254792 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:33.305700 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953124e1-d873-4605-b6e3-c2227286b81d admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:33.310636 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294a924-a2e7-4a4a-9362-c129bd90d5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:33.311301 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294a924-a2e7-4a4a-9362-c129bd90d5bf admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:33.311674 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294a924-a2e7-4a4a-9362-c129bd90d5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:33.311795 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221861ee-caf5-4f5d-9ccf-ff08d1224060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:33.312311 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221861ee-caf5-4f5d-9ccf-ff08d1224060 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:33.312508 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294a924-a2e7-4a4a-9362-c129bd90d5bf admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:33.312661 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221861ee-caf5-4f5d-9ccf-ff08d1224060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:33.312910 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221861ee-caf5-4f5d-9ccf-ff08d1224060 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:33.313342 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294a924-a2e7-4a4a-9362-c129bd90d5bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:33.313551 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221861ee-caf5-4f5d-9ccf-ff08d1224060 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:33.315432 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221861ee-caf5-4f5d-9ccf-ff08d1224060 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:33.315555 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294a924-a2e7-4a4a-9362-c129bd90d5bf admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:33.343582 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1243/2491] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:37:33 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:37:33.345059 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294a924-a2e7-4a4a-9362-c129bd90d5bf admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:33.356325 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1249/2492] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:37:33 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:37:33.357689 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221861ee-caf5-4f5d-9ccf-ff08d1224060 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:33.361518 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294a924-a2e7-4a4a-9362-c129bd90d5bf admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:33.425395 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221861ee-caf5-4f5d-9ccf-ff08d1224060 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:33.434855 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621eba8-a218-4d2b-a672-e3a3ae9064ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:33.435462 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621eba8-a218-4d2b-a672-e3a3ae9064ad admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:33.435885 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621eba8-a218-4d2b-a672-e3a3ae9064ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:33.436167 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621eba8-a218-4d2b-a672-e3a3ae9064ad admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:33.436838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621eba8-a218-4d2b-a672-e3a3ae9064ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:33.438866 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b1ff1-ddfd-4260-adc2-b082043dc1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:33.439060 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621eba8-a218-4d2b-a672-e3a3ae9064ad admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:33.439486 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b1ff1-ddfd-4260-adc2-b082043dc1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:33.439772 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b1ff1-ddfd-4260-adc2-b082043dc1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:33.440054 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b1ff1-ddfd-4260-adc2-b082043dc1f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:33.440794 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b1ff1-ddfd-4260-adc2-b082043dc1f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:33.442931 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b1ff1-ddfd-4260-adc2-b082043dc1f9 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:33.456176 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1244/2493] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:37:33.457805 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b1ff1-ddfd-4260-adc2-b082043dc1f9 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:33.465202 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1250/2494] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:37:33 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:37:33.466167 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621eba8-a218-4d2b-a672-e3a3ae9064ad admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:33.467575 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b1ff1-ddfd-4260-adc2-b082043dc1f9 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:33.472570 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c112c9-4b90-4504-bb9e-ea3f4a179363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:33.473169 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c112c9-4b90-4504-bb9e-ea3f4a179363 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:33.473451 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c112c9-4b90-4504-bb9e-ea3f4a179363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:33.473732 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c112c9-4b90-4504-bb9e-ea3f4a179363 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:33.474376 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c112c9-4b90-4504-bb9e-ea3f4a179363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:33.475982 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c112c9-4b90-4504-bb9e-ea3f4a179363 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:33.477086 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621eba8-a218-4d2b-a672-e3a3ae9064ad admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:33.481868 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ea1df-13be-4574-9aae-0efbb47dda8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:33.482458 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ea1df-13be-4574-9aae-0efbb47dda8c admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:33.482750 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ea1df-13be-4574-9aae-0efbb47dda8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:33.483028 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ea1df-13be-4574-9aae-0efbb47dda8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:33.483697 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ea1df-13be-4574-9aae-0efbb47dda8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:33.485335 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ea1df-13be-4574-9aae-0efbb47dda8c admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:33.486858 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1245/2495] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:37:33.491104 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c112c9-4b90-4504-bb9e-ea3f4a179363 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:33.495724 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1251/2496] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:37:33.499452 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ea1df-13be-4574-9aae-0efbb47dda8c admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:33.501296 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c112c9-4b90-4504-bb9e-ea3f4a179363 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:33.506603 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af34183-a102-4e2b-9964-78789ded3dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:33.507391 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af34183-a102-4e2b-9964-78789ded3dbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:33.507733 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af34183-a102-4e2b-9964-78789ded3dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:33.508077 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af34183-a102-4e2b-9964-78789ded3dbf admin admin] PATH_INFO: `/v3/projects/afa7ed53cb3c4b1994e04e34985ab464/users/2b332ff7d0ea477c8b18eb0c3f53890d/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:33.509873 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ea1df-13be-4574-9aae-0efbb47dda8c admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:33.514520 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7571baea-1d4a-45da-be6b-2238b311e071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:33.515116 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571baea-1d4a-45da-be6b-2238b311e071 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:33.515403 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571baea-1d4a-45da-be6b-2238b311e071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:33.515681 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571baea-1d4a-45da-be6b-2238b311e071 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:33.516317 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7571baea-1d4a-45da-be6b-2238b311e071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:33.517977 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7571baea-1d4a-45da-be6b-2238b311e071 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:33.532929 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1252/2497] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:37:33.533108 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af34183-a102-4e2b-9964-78789ded3dbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=afa7ed53cb3c4b1994e04e34985ab464, user_id=2b332ff7d0ea477c8b18eb0c3f53890d, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:33.533993 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7571baea-1d4a-45da-be6b-2238b311e071 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:33.534421 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af34183-a102-4e2b-9964-78789ded3dbf admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:33.545265 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7571baea-1d4a-45da-be6b-2238b311e071 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:33.548912 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1246/2498] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:37:33 2022] PUT /identity/v3/projects/afa7ed53cb3c4b1994e04e34985ab464/users/2b332ff7d0ea477c8b18eb0c3f53890d/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:33.559191 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b62b8f-9eab-4c79-98dc-05ba12cbc4fe None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:33.559481 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b62b8f-9eab-4c79-98dc-05ba12cbc4fe None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:33.559899 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b62b8f-9eab-4c79-98dc-05ba12cbc4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:33.589165 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-80b62b8f-9eab-4c79-98dc-05ba12cbc4fe None None] MFA Rules not processed for user `2b332ff7d0ea477c8b18eb0c3f53890d`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:33.590391 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-80b62b8f-9eab-4c79-98dc-05ba12cbc4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:33.609456 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235d4f7-99d7-4773-8461-d1e4936c3111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:33.610126 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235d4f7-99d7-4773-8461-d1e4936c3111 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:33.610412 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235d4f7-99d7-4773-8461-d1e4936c3111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:33.610693 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235d4f7-99d7-4773-8461-d1e4936c3111 admin admin] PATH_INFO: `/v3/projects/5521e4a5eae9431ca2b81b36e874bc6b/users/971cd3f09d6f44509b83b5fc1a7379e6/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:33.612971 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:33.628085 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235d4f7-99d7-4773-8461-d1e4936c3111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5521e4a5eae9431ca2b81b36e874bc6b, user_id=971cd3f09d6f44509b83b5fc1a7379e6, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:33.630816 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235d4f7-99d7-4773-8461-d1e4936c3111 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:33.637809 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:33.647400 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1253/2499] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:37:33 2022] PUT /identity/v3/projects/5521e4a5eae9431ca2b81b36e874bc6b/users/971cd3f09d6f44509b83b5fc1a7379e6/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:37:33.657819 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc153c8b-2a39-43ec-99c6-5e0e23b2e3fa None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:33.658172 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc153c8b-2a39-43ec-99c6-5e0e23b2e3fa None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:33.658455 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc153c8b-2a39-43ec-99c6-5e0e23b2e3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:33.671439 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1247/2500] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:33.682068 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b62b8f-9eab-4c79-98dc-05ba12cbc4fe None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:33.683420 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-80b62b8f-9eab-4c79-98dc-05ba12cbc4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:33.687037 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-fc153c8b-2a39-43ec-99c6-5e0e23b2e3fa None None] MFA Rules not processed for user `971cd3f09d6f44509b83b5fc1a7379e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:33.688214 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-fc153c8b-2a39-43ec-99c6-5e0e23b2e3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:33.741122 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b62b8f-9eab-4c79-98dc-05ba12cbc4fe None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:33.754768 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1254/2501] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:37:33.759305 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc153c8b-2a39-43ec-99c6-5e0e23b2e3fa None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:33.792773 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb65a91-35a1-41a1-a5f9-12a731225694 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:33.793529 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb65a91-35a1-41a1-a5f9-12a731225694 service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:33.793876 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb65a91-35a1-41a1-a5f9-12a731225694 service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:33.794210 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb65a91-35a1-41a1-a5f9-12a731225694 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:33.821616 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc153c8b-2a39-43ec-99c6-5e0e23b2e3fa None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:33.826423 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8b8fe-875b-4e3f-b231-7009b4e42318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:33.827105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8b8fe-875b-4e3f-b231-7009b4e42318 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:33.827385 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8b8fe-875b-4e3f-b231-7009b4e42318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:33.827659 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8b8fe-875b-4e3f-b231-7009b4e42318 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:33.828298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8b8fe-875b-4e3f-b231-7009b4e42318 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:33.830282 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8b8fe-875b-4e3f-b231-7009b4e42318 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:33.853545 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb65a91-35a1-41a1-a5f9-12a731225694 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:33.855034 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb65a91-35a1-41a1-a5f9-12a731225694 service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:33.859848 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1255/2502] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:37:33 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:37:33.863693 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8b8fe-875b-4e3f-b231-7009b4e42318 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:33.866003 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1248/2503] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 20:37:33.922986 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:33.926695 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8b8fe-875b-4e3f-b231-7009b4e42318 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:33.932502 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa75b02-cf5e-4768-a415-424e269ec20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:33.933200 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa75b02-cf5e-4768-a415-424e269ec20e admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:33.933686 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa75b02-cf5e-4768-a415-424e269ec20e admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:33.933914 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa75b02-cf5e-4768-a415-424e269ec20e admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:33.934525 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa75b02-cf5e-4768-a415-424e269ec20e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:33.936446 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa75b02-cf5e-4768-a415-424e269ec20e admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:33.957085 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1256/2504] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:37:33 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:37:33.961573 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb65a91-35a1-41a1-a5f9-12a731225694 service cinder] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:33.972343 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb65a91-35a1-41a1-a5f9-12a731225694 service cinder] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:33.977752 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e3398-cffa-4204-9c9e-6ef23884e823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:33.978299 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e3398-cffa-4204-9c9e-6ef23884e823 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:33.978584 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e3398-cffa-4204-9c9e-6ef23884e823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:33.978870 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e3398-cffa-4204-9c9e-6ef23884e823 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:33.979490 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e3398-cffa-4204-9c9e-6ef23884e823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:33.981096 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e3398-cffa-4204-9c9e-6ef23884e823 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:33.991733 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1249/2505] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:37:33.996401 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa75b02-cf5e-4768-a415-424e269ec20e admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:34.007527 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa75b02-cf5e-4768-a415-424e269ec20e admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:34.012341 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfed5f3-e293-433e-b4b4-94cfc143914f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:34.013030 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfed5f3-e293-433e-b4b4-94cfc143914f admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:34.013312 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfed5f3-e293-433e-b4b4-94cfc143914f admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:34.013593 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfed5f3-e293-433e-b4b4-94cfc143914f admin admin] PATH_INFO: `/v3/projects/6fb2ed12906b4b2b9a5668e5a1aca8d2/users/b658cc1e4b324570bf3788188018938b/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:34.032203 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfed5f3-e293-433e-b4b4-94cfc143914f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fb2ed12906b4b2b9a5668e5a1aca8d2, user_id=b658cc1e4b324570bf3788188018938b, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:34.035010 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfed5f3-e293-433e-b4b4-94cfc143914f admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:34.048606 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1257/2506] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:37:33 2022] PUT /identity/v3/projects/6fb2ed12906b4b2b9a5668e5a1aca8d2/users/b658cc1e4b324570bf3788188018938b/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:37:34.052527 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e3398-cffa-4204-9c9e-6ef23884e823 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:34.062821 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e3398-cffa-4204-9c9e-6ef23884e823 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:34.108499 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=100 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:34.132441 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e3cef-a243-4ab4-a655-11e689e6892a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:34.133179 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e3cef-a243-4ab4-a655-11e689e6892a admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:34.133643 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e3cef-a243-4ab4-a655-11e689e6892a admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:34.134090 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e3cef-a243-4ab4-a655-11e689e6892a admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:34.135010 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e3cef-a243-4ab4-a655-11e689e6892a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:34.137129 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e3cef-a243-4ab4-a655-11e689e6892a admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:34.150503 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1250/2507] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:37:34.154360 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfed5f3-e293-433e-b4b4-94cfc143914f admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:34.167574 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfed5f3-e293-433e-b4b4-94cfc143914f admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:34.172398 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97723b82-4b14-4fd1-935f-2b992ea94404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:34.173233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97723b82-4b14-4fd1-935f-2b992ea94404 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:34.173454 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97723b82-4b14-4fd1-935f-2b992ea94404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:34.173728 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97723b82-4b14-4fd1-935f-2b992ea94404 admin admin] PATH_INFO: `/v3/projects/6fb2ed12906b4b2b9a5668e5a1aca8d2/users/b658cc1e4b324570bf3788188018938b/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:34.175661 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97723b82-4b14-4fd1-935f-2b992ea94404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fb2ed12906b4b2b9a5668e5a1aca8d2, user_id=b658cc1e4b324570bf3788188018938b, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:34.178308 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97723b82-4b14-4fd1-935f-2b992ea94404 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:34.189407 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1258/2508] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:37:34 2022] PUT /identity/v3/projects/6fb2ed12906b4b2b9a5668e5a1aca8d2/users/b658cc1e4b324570bf3788188018938b/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:34.201072 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1cef4-ec02-4f55-a932-3c754e7422c8 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:34.201468 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1cef4-ec02-4f55-a932-3c754e7422c8 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:34.201875 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1cef4-ec02-4f55-a932-3c754e7422c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:34.231057 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-52f1cef4-ec02-4f55-a932-3c754e7422c8 None None] MFA Rules not processed for user `b658cc1e4b324570bf3788188018938b`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:34.232352 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-52f1cef4-ec02-4f55-a932-3c754e7422c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:34.299579 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1251/2509] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:34.312033 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97723b82-4b14-4fd1-935f-2b992ea94404 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:34.367241 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97723b82-4b14-4fd1-935f-2b992ea94404 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:34.370924 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012b373-581b-406a-b8f8-ded4ed86684e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:34.371531 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012b373-581b-406a-b8f8-ded4ed86684e service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:34.371843 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012b373-581b-406a-b8f8-ded4ed86684e service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:34.372155 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012b373-581b-406a-b8f8-ded4ed86684e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:34.381687 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012b373-581b-406a-b8f8-ded4ed86684e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:34.383104 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012b373-581b-406a-b8f8-ded4ed86684e service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:34.392496 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1259/2510] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:34 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:37:34.460136 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1cef4-ec02-4f55-a932-3c754e7422c8 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:34.525984 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1cef4-ec02-4f55-a932-3c754e7422c8 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:34.531962 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06fcae6-38c2-4bbe-9ee2-49595fde33e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:34.532817 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fcae6-38c2-4bbe-9ee2-49595fde33e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:34.533102 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fcae6-38c2-4bbe-9ee2-49595fde33e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:34.533525 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fcae6-38c2-4bbe-9ee2-49595fde33e8 admin admin] PATH_INFO: `/v3/users/971cd3f09d6f44509b83b5fc1a7379e6` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:34.534921 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06fcae6-38c2-4bbe-9ee2-49595fde33e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=971cd3f09d6f44509b83b5fc1a7379e6)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:34.537497 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06fcae6-38c2-4bbe-9ee2-49595fde33e8 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:34.587481 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-c06fcae6-38c2-4bbe-9ee2-49595fde33e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '971cd3f09d6f44509b83b5fc1a7379e6'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:34.588135 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-c06fcae6-38c2-4bbe-9ee2-49595fde33e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '971cd3f09d6f44509b83b5fc1a7379e6'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:34.599682 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:34.600933 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-c06fcae6-38c2-4bbe-9ee2-49595fde33e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '971cd3f09d6f44509b83b5fc1a7379e6'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:34.601553 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-c06fcae6-38c2-4bbe-9ee2-49595fde33e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '971cd3f09d6f44509b83b5fc1a7379e6'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:34.609262 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-c06fcae6-38c2-4bbe-9ee2-49595fde33e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '971cd3f09d6f44509b83b5fc1a7379e6'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:34.621508 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1252/2511] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:37:34 2022] DELETE /identity/v3/users/971cd3f09d6f44509b83b5fc1a7379e6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:34.625940 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55a394-0405-4719-9913-4c075159ecaa None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:34.626418 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55a394-0405-4719-9913-4c075159ecaa None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:34.626518 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55a394-0405-4719-9913-4c075159ecaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:34.646141 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-db55a394-0405-4719-9913-4c075159ecaa None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:34.647340 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-db55a394-0405-4719-9913-4c075159ecaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:34.706512 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1260/2512] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:34.716675 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06fcae6-38c2-4bbe-9ee2-49595fde33e8 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:34.718098 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-c06fcae6-38c2-4bbe-9ee2-49595fde33e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:34.780291 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06fcae6-38c2-4bbe-9ee2-49595fde33e8 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:34.784134 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4174795-06fa-415e-94c2-2ca8029f12af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:34.784914 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4174795-06fa-415e-94c2-2ca8029f12af service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:34.785559 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4174795-06fa-415e-94c2-2ca8029f12af service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:34.786905 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4174795-06fa-415e-94c2-2ca8029f12af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:34.795857 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4174795-06fa-415e-94c2-2ca8029f12af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:34.797328 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4174795-06fa-415e-94c2-2ca8029f12af service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:34.806983 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1253/2513] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:37:35.067871 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55a394-0405-4719-9913-4c075159ecaa None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:35.069290 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-db55a394-0405-4719-9913-4c075159ecaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:35.083239 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55a394-0405-4719-9913-4c075159ecaa None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:35.087959 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e9566-a9d5-4199-91f3-15c21dd73f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:35.088621 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e9566-a9d5-4199-91f3-15c21dd73f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:35.088903 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e9566-a9d5-4199-91f3-15c21dd73f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:35.089179 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e9566-a9d5-4199-91f3-15c21dd73f6d admin admin] PATH_INFO: `/v3/projects/5521e4a5eae9431ca2b81b36e874bc6b` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:35.090368 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e9566-a9d5-4199-91f3-15c21dd73f6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5521e4a5eae9431ca2b81b36e874bc6b)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:35.092982 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e9566-a9d5-4199-91f3-15c21dd73f6d admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:35.138761 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:35.140201 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8c9e9566-a9d5-4199-91f3-15c21dd73f6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5521e4a5eae9431ca2b81b36e874bc6b', 'request_id': 'req-8c9e9566-a9d5-4199-91f3-15c21dd73f6d'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:35.148059 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8c9e9566-a9d5-4199-91f3-15c21dd73f6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5521e4a5eae9431ca2b81b36e874bc6b', 'request_id': 'req-8c9e9566-a9d5-4199-91f3-15c21dd73f6d'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:35.155075 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8c9e9566-a9d5-4199-91f3-15c21dd73f6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5521e4a5eae9431ca2b81b36e874bc6b', 'request_id': 'req-8c9e9566-a9d5-4199-91f3-15c21dd73f6d'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:35.165347 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8c9e9566-a9d5-4199-91f3-15c21dd73f6d admin admin] The token cache is being invalidate because project 5521e4a5eae9431ca2b81b36e874bc6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:37:35.165640 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8c9e9566-a9d5-4199-91f3-15c21dd73f6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:35.166261 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-8c9e9566-a9d5-4199-91f3-15c21dd73f6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:35.167730 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1261/2514] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:37:35 2022] DELETE /identity/v3/projects/5521e4a5eae9431ca2b81b36e874bc6b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:37:35.171904 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4174795-06fa-415e-94c2-2ca8029f12af service neutron] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:35.181969 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4174795-06fa-415e-94c2-2ca8029f12af service neutron] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:35.237990 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0d0a3-d99f-45aa-a47a-33a59e393aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:35.239216 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0d0a3-d99f-45aa-a47a-33a59e393aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:35.239581 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0d0a3-d99f-45aa-a47a-33a59e393aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:35.239960 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0d0a3-d99f-45aa-a47a-33a59e393aaf admin admin] PATH_INFO: `/v3/users/b658cc1e4b324570bf3788188018938b` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:35.241146 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0d0a3-d99f-45aa-a47a-33a59e393aaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b658cc1e4b324570bf3788188018938b)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:35.243107 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0d0a3-d99f-45aa-a47a-33a59e393aaf admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:35.292773 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-aca0d0a3-d99f-45aa-a47a-33a59e393aaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b658cc1e4b324570bf3788188018938b'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:35.293439 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-aca0d0a3-d99f-45aa-a47a-33a59e393aaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b658cc1e4b324570bf3788188018938b'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:35.306204 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-aca0d0a3-d99f-45aa-a47a-33a59e393aaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b658cc1e4b324570bf3788188018938b'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:35.306838 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-aca0d0a3-d99f-45aa-a47a-33a59e393aaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b658cc1e4b324570bf3788188018938b'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:35.314178 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-aca0d0a3-d99f-45aa-a47a-33a59e393aaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b658cc1e4b324570bf3788188018938b'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:35.328299 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1254/2515] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:37:35 2022] DELETE /identity/v3/users/b658cc1e4b324570bf3788188018938b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:35.610141 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e9566-a9d5-4199-91f3-15c21dd73f6d admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:35.611625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-8c9e9566-a9d5-4199-91f3-15c21dd73f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:35.625718 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e9566-a9d5-4199-91f3-15c21dd73f6d admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:35.692167 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a408c01-4b22-46af-994d-32d472d7060e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:35.692965 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a408c01-4b22-46af-994d-32d472d7060e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:35.693210 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a408c01-4b22-46af-994d-32d472d7060e admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:35.693476 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a408c01-4b22-46af-994d-32d472d7060e admin admin] PATH_INFO: `/v3/projects/6fb2ed12906b4b2b9a5668e5a1aca8d2` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:35.694613 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a408c01-4b22-46af-994d-32d472d7060e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fb2ed12906b4b2b9a5668e5a1aca8d2)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:35.696502 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a408c01-4b22-46af-994d-32d472d7060e admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:35.748679 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-7a408c01-4b22-46af-994d-32d472d7060e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fb2ed12906b4b2b9a5668e5a1aca8d2', 'request_id': 'req-7a408c01-4b22-46af-994d-32d472d7060e'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:35.754889 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-7a408c01-4b22-46af-994d-32d472d7060e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fb2ed12906b4b2b9a5668e5a1aca8d2', 'request_id': 'req-7a408c01-4b22-46af-994d-32d472d7060e'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:35.762466 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-7a408c01-4b22-46af-994d-32d472d7060e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fb2ed12906b4b2b9a5668e5a1aca8d2', 'request_id': 'req-7a408c01-4b22-46af-994d-32d472d7060e'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:35.773583 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-7a408c01-4b22-46af-994d-32d472d7060e admin admin] The token cache is being invalidate because project 6fb2ed12906b4b2b9a5668e5a1aca8d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:37:35.773905 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-7a408c01-4b22-46af-994d-32d472d7060e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:35.774543 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-7a408c01-4b22-46af-994d-32d472d7060e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:35.776163 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1262/2516] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:37:35 2022] DELETE /identity/v3/projects/6fb2ed12906b4b2b9a5668e5a1aca8d2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:35.781107 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64845cff-9cba-4708-8e6a-036ea68753f8 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:35.781397 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64845cff-9cba-4708-8e6a-036ea68753f8 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:35.781675 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64845cff-9cba-4708-8e6a-036ea68753f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:35.789892 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:35.804151 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-64845cff-9cba-4708-8e6a-036ea68753f8 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:35.805348 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-64845cff-9cba-4708-8e6a-036ea68753f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:35.868182 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1255/2517] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:35.876147 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc8e0c-97b7-4908-8a47-ec51872fafcd None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:35.876436 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc8e0c-97b7-4908-8a47-ec51872fafcd None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:35.876748 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc8e0c-97b7-4908-8a47-ec51872fafcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:35.898195 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-76dc8e0c-97b7-4908-8a47-ec51872fafcd None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:35.899431 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-76dc8e0c-97b7-4908-8a47-ec51872fafcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:35.907744 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1263/2518] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:35.912680 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64845cff-9cba-4708-8e6a-036ea68753f8 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:35.922302 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64845cff-9cba-4708-8e6a-036ea68753f8 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:35.926970 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ddf9b-07c0-4871-9f63-463de616b850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:35.927574 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ddf9b-07c0-4871-9f63-463de616b850 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:35.927847 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ddf9b-07c0-4871-9f63-463de616b850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:35.928124 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ddf9b-07c0-4871-9f63-463de616b850 admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:35.928798 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ddf9b-07c0-4871-9f63-463de616b850 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:37:35.929105 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ddf9b-07c0-4871-9f63-463de616b850 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:35.930698 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ddf9b-07c0-4871-9f63-463de616b850 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:35.942895 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1256/2519] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:37:35.947169 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc8e0c-97b7-4908-8a47-ec51872fafcd None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:35.956457 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc8e0c-97b7-4908-8a47-ec51872fafcd None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:35.961773 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24045f43-7877-4be6-ac27-68135c7a0e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:35.962365 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24045f43-7877-4be6-ac27-68135c7a0e21 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:35.962648 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24045f43-7877-4be6-ac27-68135c7a0e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:35.962925 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24045f43-7877-4be6-ac27-68135c7a0e21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:35.963565 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24045f43-7877-4be6-ac27-68135c7a0e21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:35.965478 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24045f43-7877-4be6-ac27-68135c7a0e21 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:35.994557 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1264/2520] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:37:35 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:37:35.998674 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ddf9b-07c0-4871-9f63-463de616b850 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:36.008568 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ddf9b-07c0-4871-9f63-463de616b850 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:36.064937 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ec469-fbcf-47b6-a570-5117146611ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:36.065562 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ec469-fbcf-47b6-a570-5117146611ee admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:36.065850 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ec469-fbcf-47b6-a570-5117146611ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:36.066130 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ec469-fbcf-47b6-a570-5117146611ee admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:36.066766 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ec469-fbcf-47b6-a570-5117146611ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:36.068713 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ec469-fbcf-47b6-a570-5117146611ee admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:36.089400 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1257/2521] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:37:35 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:37:36.093664 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24045f43-7877-4be6-ac27-68135c7a0e21 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:36.104922 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24045f43-7877-4be6-ac27-68135c7a0e21 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:36.109546 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6332d2e-addd-48d1-a81b-793ae66f0400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:36.110143 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6332d2e-addd-48d1-a81b-793ae66f0400 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:36.110443 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6332d2e-addd-48d1-a81b-793ae66f0400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:36.110708 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6332d2e-addd-48d1-a81b-793ae66f0400 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:36.111375 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6332d2e-addd-48d1-a81b-793ae66f0400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:36.112992 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6332d2e-addd-48d1-a81b-793ae66f0400 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:36.123251 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1265/2522] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:37:36.127128 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ec469-fbcf-47b6-a570-5117146611ee admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:36.137719 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ec469-fbcf-47b6-a570-5117146611ee admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:36.142332 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74edf4a7-521a-4904-ad91-95dc00edf356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:36.142926 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edf4a7-521a-4904-ad91-95dc00edf356 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:36.143215 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edf4a7-521a-4904-ad91-95dc00edf356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:36.143494 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edf4a7-521a-4904-ad91-95dc00edf356 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:36.144164 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74edf4a7-521a-4904-ad91-95dc00edf356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:36.146295 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74edf4a7-521a-4904-ad91-95dc00edf356 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:36.156808 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1258/2523] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:37:36.161522 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6332d2e-addd-48d1-a81b-793ae66f0400 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:36.171393 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6332d2e-addd-48d1-a81b-793ae66f0400 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:36.176095 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3fda0-8a76-48ad-9b59-decafb9724a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:36.176769 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3fda0-8a76-48ad-9b59-decafb9724a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:36.177055 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3fda0-8a76-48ad-9b59-decafb9724a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:36.177332 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3fda0-8a76-48ad-9b59-decafb9724a3 admin admin] PATH_INFO: `/v3/projects/ade0dccf90254f1ca7c28c272face68c/users/11ab8b6e26524eaa86ed8a889c194c6c/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:36.191444 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de3fda0-8a76-48ad-9b59-decafb9724a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ade0dccf90254f1ca7c28c272face68c, user_id=11ab8b6e26524eaa86ed8a889c194c6c, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:36.194115 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de3fda0-8a76-48ad-9b59-decafb9724a3 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:36.206475 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1266/2524] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:37:36 2022] PUT /identity/v3/projects/ade0dccf90254f1ca7c28c272face68c/users/11ab8b6e26524eaa86ed8a889c194c6c/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:36.211947 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12efaf-ae1c-4e89-b051-199695626e87 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:36.212236 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12efaf-ae1c-4e89-b051-199695626e87 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:36.212679 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12efaf-ae1c-4e89-b051-199695626e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:36.231974 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-aa12efaf-ae1c-4e89-b051-199695626e87 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:36.233198 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-aa12efaf-ae1c-4e89-b051-199695626e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:36.290380 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1259/2525] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:37:36.299812 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3fda0-8a76-48ad-9b59-decafb9724a3 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:36.301664 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-2de3fda0-8a76-48ad-9b59-decafb9724a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:36.307005 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:36.360534 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3fda0-8a76-48ad-9b59-decafb9724a3 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:36.364288 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad167d77-5fbc-4004-a7fa-ddda4ebfe559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:36.364929 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad167d77-5fbc-4004-a7fa-ddda4ebfe559 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:36.365210 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad167d77-5fbc-4004-a7fa-ddda4ebfe559 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:36.365489 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad167d77-5fbc-4004-a7fa-ddda4ebfe559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:36.374376 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad167d77-5fbc-4004-a7fa-ddda4ebfe559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:36.375790 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad167d77-5fbc-4004-a7fa-ddda4ebfe559 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:36.385684 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1267/2526] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:37:37.101588 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49b9f4-74af-46ac-9dd1-640f70e86d4c None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:37.102088 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49b9f4-74af-46ac-9dd1-640f70e86d4c None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:37.102229 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49b9f4-74af-46ac-9dd1-640f70e86d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:37.122574 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:37.133737 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-eb49b9f4-74af-46ac-9dd1-640f70e86d4c None None] MFA Rules not processed for user `11ab8b6e26524eaa86ed8a889c194c6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:37.135424 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-eb49b9f4-74af-46ac-9dd1-640f70e86d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:37.213164 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1260/2527] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:37.224446 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad167d77-5fbc-4004-a7fa-ddda4ebfe559 service neutron] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:37.226461 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-ad167d77-5fbc-4004-a7fa-ddda4ebfe559 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:37.290539 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad167d77-5fbc-4004-a7fa-ddda4ebfe559 service neutron] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:37.294394 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31842cc3-7b28-42c2-8df9-75487be68980 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:37.295007 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31842cc3-7b28-42c2-8df9-75487be68980 service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:37.295289 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31842cc3-7b28-42c2-8df9-75487be68980 service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:37.295831 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31842cc3-7b28-42c2-8df9-75487be68980 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:37.304990 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31842cc3-7b28-42c2-8df9-75487be68980 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:37.306638 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31842cc3-7b28-42c2-8df9-75487be68980 service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:37.317356 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1268/2528] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 20:37:38.684493 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a984e1-777b-4e93-a816-98d4727f68c9 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:38.685069 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a984e1-777b-4e93-a816-98d4727f68c9 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:38.685069 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a984e1-777b-4e93-a816-98d4727f68c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:38.704148 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-f1a984e1-777b-4e93-a816-98d4727f68c9 None None] MFA Rules not processed for user `11ab8b6e26524eaa86ed8a889c194c6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:38.705406 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-f1a984e1-777b-4e93-a816-98d4727f68c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:38.712951 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1261/2529] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:38.948522 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31842cc3-7b28-42c2-8df9-75487be68980 service cinder] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:38.949964 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-31842cc3-7b28-42c2-8df9-75487be68980 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:38.961678 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31842cc3-7b28-42c2-8df9-75487be68980 service cinder] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:38.965199 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8420b-84f5-4129-becb-e1720bf06bd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:38.965792 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8420b-84f5-4129-becb-e1720bf06bd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:38.966100 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8420b-84f5-4129-becb-e1720bf06bd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:38.966374 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8420b-84f5-4129-becb-e1720bf06bd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:38.968009 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-fcf8420b-84f5-4129-becb-e1720bf06bd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:38.977338 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8420b-84f5-4129-becb-e1720bf06bd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:38.978738 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8420b-84f5-4129-becb-e1720bf06bd1 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:38.986688 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1269/2530] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 20:37:39.328705 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a984e1-777b-4e93-a816-98d4727f68c9 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:39.330745 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-f1a984e1-777b-4e93-a816-98d4727f68c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:39.351838 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a984e1-777b-4e93-a816-98d4727f68c9 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:39.356903 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a9c0b-8424-45aa-9b02-5bcd0475a132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:39.357798 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a9c0b-8424-45aa-9b02-5bcd0475a132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:39.358239 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a9c0b-8424-45aa-9b02-5bcd0475a132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:39.358625 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a9c0b-8424-45aa-9b02-5bcd0475a132 admin admin] PATH_INFO: `/v3/users/2b332ff7d0ea477c8b18eb0c3f53890d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:39.359906 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a9c0b-8424-45aa-9b02-5bcd0475a132 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b332ff7d0ea477c8b18eb0c3f53890d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:39.362496 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a9c0b-8424-45aa-9b02-5bcd0475a132 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:39.425807 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-df2a9c0b-8424-45aa-9b02-5bcd0475a132 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b332ff7d0ea477c8b18eb0c3f53890d'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:39.426967 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-df2a9c0b-8424-45aa-9b02-5bcd0475a132 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b332ff7d0ea477c8b18eb0c3f53890d'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:39.442524 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-df2a9c0b-8424-45aa-9b02-5bcd0475a132 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b332ff7d0ea477c8b18eb0c3f53890d'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:39.443568 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-df2a9c0b-8424-45aa-9b02-5bcd0475a132 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b332ff7d0ea477c8b18eb0c3f53890d'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:39.452038 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-df2a9c0b-8424-45aa-9b02-5bcd0475a132 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b332ff7d0ea477c8b18eb0c3f53890d'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:39.468302 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1262/2531] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:37:39 2022] DELETE /identity/v3/users/2b332ff7d0ea477c8b18eb0c3f53890d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:39.473259 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3865ba-4e48-4d45-8ed3-259f6e2e886c None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:39.473725 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3865ba-4e48-4d45-8ed3-259f6e2e886c None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:39.474006 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3865ba-4e48-4d45-8ed3-259f6e2e886c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:39.501962 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-7e3865ba-4e48-4d45-8ed3-259f6e2e886c None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:39.503298 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-7e3865ba-4e48-4d45-8ed3-259f6e2e886c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:39.580499 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1270/2532] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:37:39.593774 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a9c0b-8424-45aa-9b02-5bcd0475a132 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:39.595410 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-df2a9c0b-8424-45aa-9b02-5bcd0475a132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:39.662332 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a9c0b-8424-45aa-9b02-5bcd0475a132 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:39.666483 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f078642-ff66-43f2-9f5d-5fbbfc80f354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:39.667358 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f078642-ff66-43f2-9f5d-5fbbfc80f354 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:39.667787 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f078642-ff66-43f2-9f5d-5fbbfc80f354 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:39.668227 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f078642-ff66-43f2-9f5d-5fbbfc80f354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:39.681216 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f078642-ff66-43f2-9f5d-5fbbfc80f354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:39.683179 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f078642-ff66-43f2-9f5d-5fbbfc80f354 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:39.696148 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1263/2533] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:37:39.833141 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3865ba-4e48-4d45-8ed3-259f6e2e886c None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:39.835632 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-7e3865ba-4e48-4d45-8ed3-259f6e2e886c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:39.854559 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3865ba-4e48-4d45-8ed3-259f6e2e886c None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:39.860981 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a18943-e999-4ec6-b08d-ff89186f7c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:39.861889 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a18943-e999-4ec6-b08d-ff89186f7c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:39.862360 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a18943-e999-4ec6-b08d-ff89186f7c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:39.862797 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a18943-e999-4ec6-b08d-ff89186f7c54 admin admin] PATH_INFO: `/v3/users/7f4320aea5034770820eff966a4153fe` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:39.864943 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a18943-e999-4ec6-b08d-ff89186f7c54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f4320aea5034770820eff966a4153fe)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:39.868885 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a18943-e999-4ec6-b08d-ff89186f7c54 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:39.912153 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:39.928790 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-91a18943-e999-4ec6-b08d-ff89186f7c54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f4320aea5034770820eff966a4153fe'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:39.929455 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-91a18943-e999-4ec6-b08d-ff89186f7c54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f4320aea5034770820eff966a4153fe'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:39.937509 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-91a18943-e999-4ec6-b08d-ff89186f7c54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f4320aea5034770820eff966a4153fe'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:39.938530 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-91a18943-e999-4ec6-b08d-ff89186f7c54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f4320aea5034770820eff966a4153fe'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:39.952274 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-91a18943-e999-4ec6-b08d-ff89186f7c54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f4320aea5034770820eff966a4153fe'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:39.971599 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1271/2534] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:37:39 2022] DELETE /identity/v3/users/7f4320aea5034770820eff966a4153fe => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:40.006465 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f078642-ff66-43f2-9f5d-5fbbfc80f354 service neutron] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:40.007961 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-0f078642-ff66-43f2-9f5d-5fbbfc80f354 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:40.021998 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f078642-ff66-43f2-9f5d-5fbbfc80f354 service neutron] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:40.026511 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:40.108195 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4c67c-68f3-47ab-9734-04c6090c4ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:40.108951 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4c67c-68f3-47ab-9734-04c6090c4ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:40.109305 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4c67c-68f3-47ab-9734-04c6090c4ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:40.109654 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4c67c-68f3-47ab-9734-04c6090c4ae7 admin admin] PATH_INFO: `/v3/projects/afa7ed53cb3c4b1994e04e34985ab464` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:40.110888 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a4c67c-68f3-47ab-9734-04c6090c4ae7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afa7ed53cb3c4b1994e04e34985ab464)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:40.112913 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a4c67c-68f3-47ab-9734-04c6090c4ae7 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:40.164446 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-c8a4c67c-68f3-47ab-9734-04c6090c4ae7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afa7ed53cb3c4b1994e04e34985ab464', 'request_id': 'req-c8a4c67c-68f3-47ab-9734-04c6090c4ae7'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:40.171871 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-c8a4c67c-68f3-47ab-9734-04c6090c4ae7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afa7ed53cb3c4b1994e04e34985ab464', 'request_id': 'req-c8a4c67c-68f3-47ab-9734-04c6090c4ae7'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:40.179164 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-c8a4c67c-68f3-47ab-9734-04c6090c4ae7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afa7ed53cb3c4b1994e04e34985ab464', 'request_id': 'req-c8a4c67c-68f3-47ab-9734-04c6090c4ae7'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:40.185041 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a18943-e999-4ec6-b08d-ff89186f7c54 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:40.187018 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-91a18943-e999-4ec6-b08d-ff89186f7c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:40.202556 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a18943-e999-4ec6-b08d-ff89186f7c54 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:40.221546 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-c8a4c67c-68f3-47ab-9734-04c6090c4ae7 admin admin] The token cache is being invalidate because project afa7ed53cb3c4b1994e04e34985ab464 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81402) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:37:40.221848 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-c8a4c67c-68f3-47ab-9734-04c6090c4ae7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:40.222503 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-c8a4c67c-68f3-47ab-9734-04c6090c4ae7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:40.224141 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1264/2535] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:37:40 2022] DELETE /identity/v3/projects/afa7ed53cb3c4b1994e04e34985ab464 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:40.228782 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4aafc2-682b-47c3-94ec-80366b71348c None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:40.229073 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4aafc2-682b-47c3-94ec-80366b71348c None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:40.229350 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4aafc2-682b-47c3-94ec-80366b71348c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:40.251872 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-6f4aafc2-682b-47c3-94ec-80366b71348c None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:40.253488 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-6f4aafc2-682b-47c3-94ec-80366b71348c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:40.269547 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c12bf-9625-417f-87ff-e570ff517cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:40.270907 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c12bf-9625-417f-87ff-e570ff517cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:40.271196 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c12bf-9625-417f-87ff-e570ff517cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:40.271474 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c12bf-9625-417f-87ff-e570ff517cca admin admin] PATH_INFO: `/v3/projects/0cd7b23f081147cba75844a277ff24f3` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:40.272646 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c12bf-9625-417f-87ff-e570ff517cca admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cd7b23f081147cba75844a277ff24f3)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:40.274539 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c12bf-9625-417f-87ff-e570ff517cca admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:40.314898 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1265/2536] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:37:40.323373 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12623d-883c-459a-b3e1-6374635fe007 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:40.323731 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12623d-883c-459a-b3e1-6374635fe007 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:40.324019 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12623d-883c-459a-b3e1-6374635fe007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:40.326650 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-030c12bf-9625-417f-87ff-e570ff517cca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cd7b23f081147cba75844a277ff24f3', 'request_id': 'req-030c12bf-9625-417f-87ff-e570ff517cca'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:40.334675 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-030c12bf-9625-417f-87ff-e570ff517cca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cd7b23f081147cba75844a277ff24f3', 'request_id': 'req-030c12bf-9625-417f-87ff-e570ff517cca'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:40.343407 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-030c12bf-9625-417f-87ff-e570ff517cca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cd7b23f081147cba75844a277ff24f3', 'request_id': 'req-030c12bf-9625-417f-87ff-e570ff517cca'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:40.344865 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-1b12623d-883c-459a-b3e1-6374635fe007 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:40.346424 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-1b12623d-883c-459a-b3e1-6374635fe007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:40.354201 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-030c12bf-9625-417f-87ff-e570ff517cca admin admin] The token cache is being invalidate because project 0cd7b23f081147cba75844a277ff24f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:37:40.354488 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-030c12bf-9625-417f-87ff-e570ff517cca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:40.355116 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-030c12bf-9625-417f-87ff-e570ff517cca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:40.356625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1272/2537] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:37:40 2022] DELETE /identity/v3/projects/0cd7b23f081147cba75844a277ff24f3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:37:40.383068 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:40.418901 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1266/2538] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:40.420399 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c12bf-9625-417f-87ff-e570ff517cca admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:40.431809 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c12bf-9625-417f-87ff-e570ff517cca admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:40.440523 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f4cec-e46a-458a-87b0-8720a573db70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:40.441177 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f4cec-e46a-458a-87b0-8720a573db70 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:40.441459 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f4cec-e46a-458a-87b0-8720a573db70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:40.442365 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f4cec-e46a-458a-87b0-8720a573db70 admin admin] PATH_INFO: `/v3/domains` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:40.443034 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f4cec-e46a-458a-87b0-8720a573db70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:37:40.443343 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f4cec-e46a-458a-87b0-8720a573db70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:40.445044 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f4cec-e46a-458a-87b0-8720a573db70 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:40.462781 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1273/2539] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:37:40.463703 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12623d-883c-459a-b3e1-6374635fe007 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:40.481273 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12623d-883c-459a-b3e1-6374635fe007 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:40.489673 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c8288-8ef1-457b-840e-4e6efca0dadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:40.492706 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c8288-8ef1-457b-840e-4e6efca0dadf admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:40.493397 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c8288-8ef1-457b-840e-4e6efca0dadf admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:40.494932 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c8288-8ef1-457b-840e-4e6efca0dadf admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:40.495893 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c8288-8ef1-457b-840e-4e6efca0dadf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:40.509595 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c8288-8ef1-457b-840e-4e6efca0dadf admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:40.564418 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1267/2540] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:37:40 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:37:40.570054 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f4cec-e46a-458a-87b0-8720a573db70 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:40.581048 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f4cec-e46a-458a-87b0-8720a573db70 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:40.607154 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:40.651107 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0499af-3db1-41c3-a92b-b1b6765a3317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:40.651829 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0499af-3db1-41c3-a92b-b1b6765a3317 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:40.652196 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0499af-3db1-41c3-a92b-b1b6765a3317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:40.652554 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0499af-3db1-41c3-a92b-b1b6765a3317 admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:40.653375 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0499af-3db1-41c3-a92b-b1b6765a3317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:40.655317 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0499af-3db1-41c3-a92b-b1b6765a3317 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:40.680507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1274/2541] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:37:40 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:37:40.682263 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c8288-8ef1-457b-840e-4e6efca0dadf admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:40.693248 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c8288-8ef1-457b-840e-4e6efca0dadf admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:40.698248 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50fc46-2b89-4627-b3d9-17e58823b835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:40.698856 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50fc46-2b89-4627-b3d9-17e58823b835 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:40.699144 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50fc46-2b89-4627-b3d9-17e58823b835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:40.699419 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50fc46-2b89-4627-b3d9-17e58823b835 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:40.700067 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50fc46-2b89-4627-b3d9-17e58823b835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:40.701702 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50fc46-2b89-4627-b3d9-17e58823b835 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:40.713717 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1268/2542] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:37:40.717815 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0499af-3db1-41c3-a92b-b1b6765a3317 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:40.729805 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0499af-3db1-41c3-a92b-b1b6765a3317 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:40.734688 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca81ee3-fdc2-46f8-bcf0-bb574575834e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:40.735403 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca81ee3-fdc2-46f8-bcf0-bb574575834e admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:40.735705 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca81ee3-fdc2-46f8-bcf0-bb574575834e admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:40.736010 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca81ee3-fdc2-46f8-bcf0-bb574575834e admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:40.736796 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca81ee3-fdc2-46f8-bcf0-bb574575834e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:40.739884 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca81ee3-fdc2-46f8-bcf0-bb574575834e admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:40.752104 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1275/2543] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:37:40.756740 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50fc46-2b89-4627-b3d9-17e58823b835 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:40.769993 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50fc46-2b89-4627-b3d9-17e58823b835 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:40.777303 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a883a-849d-45b0-b7a3-2837ae84aaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:40.777982 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a883a-849d-45b0-b7a3-2837ae84aaf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:40.778267 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a883a-849d-45b0-b7a3-2837ae84aaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:40.778548 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a883a-849d-45b0-b7a3-2837ae84aaf0 admin admin] PATH_INFO: `/v3/projects/97c17458def1419f9db8b3e72d9dbfb2/users/c99b1aa405b84217a91aea59dee0e0c9/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:40.795352 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a883a-849d-45b0-b7a3-2837ae84aaf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97c17458def1419f9db8b3e72d9dbfb2, user_id=c99b1aa405b84217a91aea59dee0e0c9, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:40.798526 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a883a-849d-45b0-b7a3-2837ae84aaf0 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:40.813304 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1269/2544] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:37:40 2022] PUT /identity/v3/projects/97c17458def1419f9db8b3e72d9dbfb2/users/c99b1aa405b84217a91aea59dee0e0c9/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:40.824007 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f2943-90ad-4549-915b-aaa458f233fa None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:40.824323 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f2943-90ad-4549-915b-aaa458f233fa None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:40.824637 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f2943-90ad-4549-915b-aaa458f233fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:40.857654 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-746f2943-90ad-4549-915b-aaa458f233fa None None] MFA Rules not processed for user `c99b1aa405b84217a91aea59dee0e0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:40.858925 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-746f2943-90ad-4549-915b-aaa458f233fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:40.923847 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1276/2545] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:40.929039 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a883a-849d-45b0-b7a3-2837ae84aaf0 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:40.993296 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a883a-849d-45b0-b7a3-2837ae84aaf0 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:40.998269 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d697139-cca9-4a82-9f0b-399b3305b9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:40.998948 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d697139-cca9-4a82-9f0b-399b3305b9be admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:40.999234 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d697139-cca9-4a82-9f0b-399b3305b9be admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:40.999513 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d697139-cca9-4a82-9f0b-399b3305b9be admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:41.000150 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d697139-cca9-4a82-9f0b-399b3305b9be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:41.002268 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d697139-cca9-4a82-9f0b-399b3305b9be admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:41.030135 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1270/2546] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:37:40 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:37:41.034162 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f2943-90ad-4549-915b-aaa458f233fa None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:41.045903 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f2943-90ad-4549-915b-aaa458f233fa None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:41.102412 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb86ce8-9147-457d-bd1c-2e5aa285426b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:41.103059 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb86ce8-9147-457d-bd1c-2e5aa285426b admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:41.103346 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb86ce8-9147-457d-bd1c-2e5aa285426b admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:41.103625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb86ce8-9147-457d-bd1c-2e5aa285426b admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:41.104268 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb86ce8-9147-457d-bd1c-2e5aa285426b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:41.106230 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb86ce8-9147-457d-bd1c-2e5aa285426b admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:41.130812 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1277/2547] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:37:41 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:37:41.132286 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d697139-cca9-4a82-9f0b-399b3305b9be admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:41.143077 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d697139-cca9-4a82-9f0b-399b3305b9be admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:41.148570 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f236f4-8183-49b9-9bf6-c2fd8b85eb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:41.149228 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f236f4-8183-49b9-9bf6-c2fd8b85eb78 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:41.149513 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f236f4-8183-49b9-9bf6-c2fd8b85eb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:41.149786 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f236f4-8183-49b9-9bf6-c2fd8b85eb78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:41.150433 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f236f4-8183-49b9-9bf6-c2fd8b85eb78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:41.152076 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f236f4-8183-49b9-9bf6-c2fd8b85eb78 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:41.163146 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1271/2548] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:37:41.167602 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb86ce8-9147-457d-bd1c-2e5aa285426b admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:41.178983 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb86ce8-9147-457d-bd1c-2e5aa285426b admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:41.184185 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0d206-3e9d-4ac1-9d20-6302509334b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:41.184848 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0d206-3e9d-4ac1-9d20-6302509334b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:41.185131 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0d206-3e9d-4ac1-9d20-6302509334b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:41.185406 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0d206-3e9d-4ac1-9d20-6302509334b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:41.186059 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0d206-3e9d-4ac1-9d20-6302509334b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:41.187996 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0d206-3e9d-4ac1-9d20-6302509334b8 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:41.201237 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1278/2549] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:37:41.202381 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f236f4-8183-49b9-9bf6-c2fd8b85eb78 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:41.212778 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f236f4-8183-49b9-9bf6-c2fd8b85eb78 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:41.217366 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5135bf0-06d1-4d2e-a350-f801afa0f23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:41.218012 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5135bf0-06d1-4d2e-a350-f801afa0f23f admin admin] REQUEST_METHOD: `PUT` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:41.218291 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5135bf0-06d1-4d2e-a350-f801afa0f23f admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:41.218588 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5135bf0-06d1-4d2e-a350-f801afa0f23f admin admin] PATH_INFO: `/v3/projects/d7c3a2f4a8f345cfb446d3e3feffd0a3/users/856676852bd64b8d815ea0a628bb4caa/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:41.237018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5135bf0-06d1-4d2e-a350-f801afa0f23f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c3a2f4a8f345cfb446d3e3feffd0a3, user_id=856676852bd64b8d815ea0a628bb4caa, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:41.240110 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5135bf0-06d1-4d2e-a350-f801afa0f23f admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:41.253036 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1272/2550] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:37:41 2022] PUT /identity/v3/projects/d7c3a2f4a8f345cfb446d3e3feffd0a3/users/856676852bd64b8d815ea0a628bb4caa/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:41.264407 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161d9d4-ac31-4eb5-8b25-fd7b98545cc6 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:41.264734 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161d9d4-ac31-4eb5-8b25-fd7b98545cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:41.265013 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161d9d4-ac31-4eb5-8b25-fd7b98545cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:41.288645 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:41.296746 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-6161d9d4-ac31-4eb5-8b25-fd7b98545cc6 None None] MFA Rules not processed for user `856676852bd64b8d815ea0a628bb4caa`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:41.298715 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-6161d9d4-ac31-4eb5-8b25-fd7b98545cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:41.369739 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1279/2551] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:41.374327 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5135bf0-06d1-4d2e-a350-f801afa0f23f admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:41.408254 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:41.439136 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5135bf0-06d1-4d2e-a350-f801afa0f23f admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:41.446491 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05768d-a6ca-410b-84c7-0bf32daf609e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:41.447313 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05768d-a6ca-410b-84c7-0bf32daf609e admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:41.447614 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05768d-a6ca-410b-84c7-0bf32daf609e admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:41.447872 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05768d-a6ca-410b-84c7-0bf32daf609e admin admin] PATH_INFO: `/v3/projects` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:41.448811 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05768d-a6ca-410b-84c7-0bf32daf609e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:41.450996 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05768d-a6ca-410b-84c7-0bf32daf609e admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:41.481103 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1273/2552] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:37:41 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:37:41.484910 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6161d9d4-ac31-4eb5-8b25-fd7b98545cc6 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:41.495702 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6161d9d4-ac31-4eb5-8b25-fd7b98545cc6 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:41.555717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f188eef-5c58-4de5-86f2-8398c3c5b88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:41.556463 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f188eef-5c58-4de5-86f2-8398c3c5b88b admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:41.556786 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f188eef-5c58-4de5-86f2-8398c3c5b88b admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:41.557070 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f188eef-5c58-4de5-86f2-8398c3c5b88b admin admin] PATH_INFO: `/v3/users` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:41.557717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f188eef-5c58-4de5-86f2-8398c3c5b88b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:41.559631 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f188eef-5c58-4de5-86f2-8398c3c5b88b admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:41.585113 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1280/2553] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:37:41 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:37:41.589099 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05768d-a6ca-410b-84c7-0bf32daf609e admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:41.600683 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05768d-a6ca-410b-84c7-0bf32daf609e admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:41.606181 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19dca89-1686-4723-b9da-e13ae14fd329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:41.606848 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19dca89-1686-4723-b9da-e13ae14fd329 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:41.607127 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19dca89-1686-4723-b9da-e13ae14fd329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:41.607401 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19dca89-1686-4723-b9da-e13ae14fd329 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:41.608049 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19dca89-1686-4723-b9da-e13ae14fd329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:41.609675 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19dca89-1686-4723-b9da-e13ae14fd329 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:41.622171 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1274/2554] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:37:41.624868 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f188eef-5c58-4de5-86f2-8398c3c5b88b admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:41.636327 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f188eef-5c58-4de5-86f2-8398c3c5b88b admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:41.641420 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb740f-041b-4cc1-90d6-be43283c6d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:41.642622 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb740f-041b-4cc1-90d6-be43283c6d06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:41.642622 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb740f-041b-4cc1-90d6-be43283c6d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:41.642622 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb740f-041b-4cc1-90d6-be43283c6d06 admin admin] PATH_INFO: `/v3/projects/900b745bce314bf698179c5c5c6b44ac/users/0b3c5fd8bd0c452faefd0f90a5e778b5/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:41.662512 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb740f-041b-4cc1-90d6-be43283c6d06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=900b745bce314bf698179c5c5c6b44ac, user_id=0b3c5fd8bd0c452faefd0f90a5e778b5, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:41.665821 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb740f-041b-4cc1-90d6-be43283c6d06 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:41.683824 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1281/2555] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:37:41 2022] PUT /identity/v3/projects/900b745bce314bf698179c5c5c6b44ac/users/0b3c5fd8bd0c452faefd0f90a5e778b5/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 20:37:41.687674 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19dca89-1686-4723-b9da-e13ae14fd329 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:41.700571 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19dca89-1686-4723-b9da-e13ae14fd329 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:41.762030 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436c12f-0b52-4ca0-9316-f6416d6af0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:41.762568 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436c12f-0b52-4ca0-9316-f6416d6af0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:41.762854 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436c12f-0b52-4ca0-9316-f6416d6af0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:41.763132 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436c12f-0b52-4ca0-9316-f6416d6af0c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:41.763903 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436c12f-0b52-4ca0-9316-f6416d6af0c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:41.765543 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436c12f-0b52-4ca0-9316-f6416d6af0c5 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:41.779725 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1275/2556] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:37:41.781216 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb740f-041b-4cc1-90d6-be43283c6d06 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:41.792121 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb740f-041b-4cc1-90d6-be43283c6d06 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:41.796742 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b57c2-0a30-4823-96fd-6386a940fc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:41.797430 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b57c2-0a30-4823-96fd-6386a940fc38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:41.797711 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b57c2-0a30-4823-96fd-6386a940fc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:41.798003 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b57c2-0a30-4823-96fd-6386a940fc38 admin admin] PATH_INFO: `/v3/projects/900b745bce314bf698179c5c5c6b44ac/users/0b3c5fd8bd0c452faefd0f90a5e778b5/roles/bca2e686aa5e4fdc844fc679a4c41939` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:41.799921 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b57c2-0a30-4823-96fd-6386a940fc38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=900b745bce314bf698179c5c5c6b44ac, user_id=0b3c5fd8bd0c452faefd0f90a5e778b5, role_id=bca2e686aa5e4fdc844fc679a4c41939)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:41.802567 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b57c2-0a30-4823-96fd-6386a940fc38 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:41.813678 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1282/2557] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:37:41 2022] PUT /identity/v3/projects/900b745bce314bf698179c5c5c6b44ac/users/0b3c5fd8bd0c452faefd0f90a5e778b5/roles/bca2e686aa5e4fdc844fc679a4c41939 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:41.824496 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7a56b-3dbd-4e70-a5b0-82ee3e1ed9ce None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:41.825083 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7a56b-3dbd-4e70-a5b0-82ee3e1ed9ce None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:41.825488 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7a56b-3dbd-4e70-a5b0-82ee3e1ed9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:41.855517 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-0ca7a56b-3dbd-4e70-a5b0-82ee3e1ed9ce None None] MFA Rules not processed for user `0b3c5fd8bd0c452faefd0f90a5e778b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:41.856822 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-0ca7a56b-3dbd-4e70-a5b0-82ee3e1ed9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:41.941037 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1276/2558] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:37:41.955673 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b57c2-0a30-4823-96fd-6386a940fc38 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:41.957471 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-542b57c2-0a30-4823-96fd-6386a940fc38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:42.019508 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b57c2-0a30-4823-96fd-6386a940fc38 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:42.023565 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89103599-58f1-44a9-b4eb-70900417991f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:42.024208 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89103599-58f1-44a9-b4eb-70900417991f service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:42.024522 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89103599-58f1-44a9-b4eb-70900417991f service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:42.024857 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89103599-58f1-44a9-b4eb-70900417991f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:42.032253 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:42.102681 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89103599-58f1-44a9-b4eb-70900417991f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:42.104124 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89103599-58f1-44a9-b4eb-70900417991f service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:42.113875 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1283/2559] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:37:43.627018 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7a56b-3dbd-4e70-a5b0-82ee3e1ed9ce None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:43.628477 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-0ca7a56b-3dbd-4e70-a5b0-82ee3e1ed9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:43.640790 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7a56b-3dbd-4e70-a5b0-82ee3e1ed9ce None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:43.644253 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f6a8f-48c9-412b-8e78-93b6d8b45aad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:43.644877 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f6a8f-48c9-412b-8e78-93b6d8b45aad service cinder] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:43.645159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f6a8f-48c9-412b-8e78-93b6d8b45aad service cinder] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:43.645431 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f6a8f-48c9-412b-8e78-93b6d8b45aad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:43.669846 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:43.704947 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f6a8f-48c9-412b-8e78-93b6d8b45aad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:43.706397 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f6a8f-48c9-412b-8e78-93b6d8b45aad service cinder] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:43.715592 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1277/2560] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:37:44.293580 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89103599-58f1-44a9-b4eb-70900417991f service cinder] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:44.302833 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89103599-58f1-44a9-b4eb-70900417991f service cinder] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:44.306732 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342277b2-ed72-48d5-8470-7816d3234b2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:44.307335 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342277b2-ed72-48d5-8470-7816d3234b2a service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:44.307618 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342277b2-ed72-48d5-8470-7816d3234b2a service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:44.307920 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342277b2-ed72-48d5-8470-7816d3234b2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:44.317554 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342277b2-ed72-48d5-8470-7816d3234b2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:44.318966 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342277b2-ed72-48d5-8470-7816d3234b2a service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:44.330321 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1284/2561] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:37:48.185673 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f6a8f-48c9-412b-8e78-93b6d8b45aad service cinder] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:48.247517 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f6a8f-48c9-412b-8e78-93b6d8b45aad service cinder] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:48.251984 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3e387-8160-402e-8f9d-94cfe57e54a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:48.252658 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3e387-8160-402e-8f9d-94cfe57e54a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:48.252936 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3e387-8160-402e-8f9d-94cfe57e54a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:48.253207 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3e387-8160-402e-8f9d-94cfe57e54a9 admin admin] PATH_INFO: `/v3/users/c99b1aa405b84217a91aea59dee0e0c9` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:48.254294 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3e387-8160-402e-8f9d-94cfe57e54a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c99b1aa405b84217a91aea59dee0e0c9)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:48.256224 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3e387-8160-402e-8f9d-94cfe57e54a9 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:48.300118 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-72a3e387-8160-402e-8f9d-94cfe57e54a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c99b1aa405b84217a91aea59dee0e0c9'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:48.300792 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-72a3e387-8160-402e-8f9d-94cfe57e54a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c99b1aa405b84217a91aea59dee0e0c9'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:48.312960 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-72a3e387-8160-402e-8f9d-94cfe57e54a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c99b1aa405b84217a91aea59dee0e0c9'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:48.313603 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-72a3e387-8160-402e-8f9d-94cfe57e54a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c99b1aa405b84217a91aea59dee0e0c9'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:48.320325 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-72a3e387-8160-402e-8f9d-94cfe57e54a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c99b1aa405b84217a91aea59dee0e0c9'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:48.333190 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1278/2562] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:37:48 2022] DELETE /identity/v3/users/c99b1aa405b84217a91aea59dee0e0c9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:48.337763 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d32de-e5ef-4332-a65d-e51ab45bb1c6 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:48.338288 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d32de-e5ef-4332-a65d-e51ab45bb1c6 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:48.338397 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d32de-e5ef-4332-a65d-e51ab45bb1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:48.357737 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-b07d32de-e5ef-4332-a65d-e51ab45bb1c6 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:48.358942 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-b07d32de-e5ef-4332-a65d-e51ab45bb1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:48.416071 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1285/2563] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:37:48.425646 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3e387-8160-402e-8f9d-94cfe57e54a9 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:48.427660 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-72a3e387-8160-402e-8f9d-94cfe57e54a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:48.473061 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:48.486329 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3e387-8160-402e-8f9d-94cfe57e54a9 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:48.491050 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea61cf4-fdf7-4405-91b4-bdc744623f02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:48.491652 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea61cf4-fdf7-4405-91b4-bdc744623f02 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:48.491933 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea61cf4-fdf7-4405-91b4-bdc744623f02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:48.492211 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea61cf4-fdf7-4405-91b4-bdc744623f02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:48.501187 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea61cf4-fdf7-4405-91b4-bdc744623f02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:48.502649 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea61cf4-fdf7-4405-91b4-bdc744623f02 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:48.512399 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1279/2564] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:37:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:37:48.777467 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d32de-e5ef-4332-a65d-e51ab45bb1c6 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:48.778855 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-b07d32de-e5ef-4332-a65d-e51ab45bb1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:48.794410 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d32de-e5ef-4332-a65d-e51ab45bb1c6 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:48.799435 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d02cf-5fd7-48a0-9e43-5b086349fe85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:48.799865 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d02cf-5fd7-48a0-9e43-5b086349fe85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:48.800443 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d02cf-5fd7-48a0-9e43-5b086349fe85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:48.800855 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d02cf-5fd7-48a0-9e43-5b086349fe85 admin admin] PATH_INFO: `/v3/projects/97c17458def1419f9db8b3e72d9dbfb2` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:48.802276 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d02cf-5fd7-48a0-9e43-5b086349fe85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97c17458def1419f9db8b3e72d9dbfb2)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:48.804675 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d02cf-5fd7-48a0-9e43-5b086349fe85 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:48.859476 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-2f3d02cf-5fd7-48a0-9e43-5b086349fe85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97c17458def1419f9db8b3e72d9dbfb2', 'request_id': 'req-2f3d02cf-5fd7-48a0-9e43-5b086349fe85'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:48.866855 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-2f3d02cf-5fd7-48a0-9e43-5b086349fe85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97c17458def1419f9db8b3e72d9dbfb2', 'request_id': 'req-2f3d02cf-5fd7-48a0-9e43-5b086349fe85'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:48.876709 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-2f3d02cf-5fd7-48a0-9e43-5b086349fe85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97c17458def1419f9db8b3e72d9dbfb2', 'request_id': 'req-2f3d02cf-5fd7-48a0-9e43-5b086349fe85'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:48.887733 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-2f3d02cf-5fd7-48a0-9e43-5b086349fe85 admin admin] The token cache is being invalidate because project 97c17458def1419f9db8b3e72d9dbfb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:37:48.888022 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-2f3d02cf-5fd7-48a0-9e43-5b086349fe85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:48.888720 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-2f3d02cf-5fd7-48a0-9e43-5b086349fe85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:48.890241 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1286/2565] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:37:48 2022] DELETE /identity/v3/projects/97c17458def1419f9db8b3e72d9dbfb2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:48.894437 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea61cf4-fdf7-4405-91b4-bdc744623f02 service neutron] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:48.904956 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea61cf4-fdf7-4405-91b4-bdc744623f02 service neutron] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:48.965381 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba1a55-3c4d-425d-9611-e6dcaf918e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:48.965937 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba1a55-3c4d-425d-9611-e6dcaf918e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:48.966257 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba1a55-3c4d-425d-9611-e6dcaf918e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:48.966534 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba1a55-3c4d-425d-9611-e6dcaf918e28 admin admin] PATH_INFO: `/v3/users/856676852bd64b8d815ea0a628bb4caa` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:48.967694 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba1a55-3c4d-425d-9611-e6dcaf918e28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=856676852bd64b8d815ea0a628bb4caa)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:48.969721 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba1a55-3c4d-425d-9611-e6dcaf918e28 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:49.018090 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-39ba1a55-3c4d-425d-9611-e6dcaf918e28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '856676852bd64b8d815ea0a628bb4caa'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:49.018759 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-39ba1a55-3c4d-425d-9611-e6dcaf918e28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '856676852bd64b8d815ea0a628bb4caa'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:49.031879 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-39ba1a55-3c4d-425d-9611-e6dcaf918e28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '856676852bd64b8d815ea0a628bb4caa'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:49.032638 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-39ba1a55-3c4d-425d-9611-e6dcaf918e28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '856676852bd64b8d815ea0a628bb4caa'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:49.039798 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-39ba1a55-3c4d-425d-9611-e6dcaf918e28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '856676852bd64b8d815ea0a628bb4caa'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:49.055754 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1280/2566] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:37:48 2022] DELETE /identity/v3/users/856676852bd64b8d815ea0a628bb4caa => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:49.341536 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d02cf-5fd7-48a0-9e43-5b086349fe85 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:49.343090 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-2f3d02cf-5fd7-48a0-9e43-5b086349fe85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:49.358326 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d02cf-5fd7-48a0-9e43-5b086349fe85 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:49.376318 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:49.421981 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30667bec-bcfa-4130-8116-c924c215ce11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:49.422614 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30667bec-bcfa-4130-8116-c924c215ce11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:49.422901 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30667bec-bcfa-4130-8116-c924c215ce11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:49.423181 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30667bec-bcfa-4130-8116-c924c215ce11 admin admin] PATH_INFO: `/v3/projects/d7c3a2f4a8f345cfb446d3e3feffd0a3` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:49.424293 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30667bec-bcfa-4130-8116-c924c215ce11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7c3a2f4a8f345cfb446d3e3feffd0a3)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:49.426241 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30667bec-bcfa-4130-8116-c924c215ce11 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:49.472185 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-30667bec-bcfa-4130-8116-c924c215ce11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7c3a2f4a8f345cfb446d3e3feffd0a3', 'request_id': 'req-30667bec-bcfa-4130-8116-c924c215ce11'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:49.478307 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-30667bec-bcfa-4130-8116-c924c215ce11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7c3a2f4a8f345cfb446d3e3feffd0a3', 'request_id': 'req-30667bec-bcfa-4130-8116-c924c215ce11'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:49.485516 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-30667bec-bcfa-4130-8116-c924c215ce11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7c3a2f4a8f345cfb446d3e3feffd0a3', 'request_id': 'req-30667bec-bcfa-4130-8116-c924c215ce11'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:49.496195 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-30667bec-bcfa-4130-8116-c924c215ce11 admin admin] The token cache is being invalidate because project d7c3a2f4a8f345cfb446d3e3feffd0a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:37:49.496489 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-30667bec-bcfa-4130-8116-c924c215ce11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:49.497145 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-30667bec-bcfa-4130-8116-c924c215ce11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:49.498633 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1287/2567] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:37:49 2022] DELETE /identity/v3/projects/d7c3a2f4a8f345cfb446d3e3feffd0a3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:49.502724 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba1a55-3c4d-425d-9611-e6dcaf918e28 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:49.504123 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-39ba1a55-3c4d-425d-9611-e6dcaf918e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:49.517594 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba1a55-3c4d-425d-9611-e6dcaf918e28 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:49.574089 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fd16f-ee3a-4c46-b7e2-0a9e30db5e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:49.574719 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fd16f-ee3a-4c46-b7e2-0a9e30db5e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:49.574999 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fd16f-ee3a-4c46-b7e2-0a9e30db5e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:49.575276 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fd16f-ee3a-4c46-b7e2-0a9e30db5e01 admin admin] PATH_INFO: `/v3/users/0b3c5fd8bd0c452faefd0f90a5e778b5` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:49.576368 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6fd16f-ee3a-4c46-b7e2-0a9e30db5e01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b3c5fd8bd0c452faefd0f90a5e778b5)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:49.578319 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6fd16f-ee3a-4c46-b7e2-0a9e30db5e01 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:49.583526 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:49.624723 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-aa6fd16f-ee3a-4c46-b7e2-0a9e30db5e01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b3c5fd8bd0c452faefd0f90a5e778b5'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:49.625370 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-aa6fd16f-ee3a-4c46-b7e2-0a9e30db5e01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b3c5fd8bd0c452faefd0f90a5e778b5'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:49.637727 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-aa6fd16f-ee3a-4c46-b7e2-0a9e30db5e01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b3c5fd8bd0c452faefd0f90a5e778b5'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:49.638361 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-aa6fd16f-ee3a-4c46-b7e2-0a9e30db5e01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b3c5fd8bd0c452faefd0f90a5e778b5'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:49.645257 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-aa6fd16f-ee3a-4c46-b7e2-0a9e30db5e01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b3c5fd8bd0c452faefd0f90a5e778b5'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:49.658056 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1281/2568] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:37:49 2022] DELETE /identity/v3/users/0b3c5fd8bd0c452faefd0f90a5e778b5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:49.941055 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30667bec-bcfa-4130-8116-c924c215ce11 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:37:49.942869 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-30667bec-bcfa-4130-8116-c924c215ce11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:49.957407 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30667bec-bcfa-4130-8116-c924c215ce11 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:37:50.017043 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57efe47-6b2d-4e8d-be48-430fc0b6bb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:37:50.017584 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57efe47-6b2d-4e8d-be48-430fc0b6bb1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:50.017862 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57efe47-6b2d-4e8d-be48-430fc0b6bb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:50.018138 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57efe47-6b2d-4e8d-be48-430fc0b6bb1b admin admin] PATH_INFO: `/v3/projects/900b745bce314bf698179c5c5c6b44ac` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:50.019260 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57efe47-6b2d-4e8d-be48-430fc0b6bb1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=900b745bce314bf698179c5c5c6b44ac)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:37:50.021223 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57efe47-6b2d-4e8d-be48-430fc0b6bb1b admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:37:50.071995 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-e57efe47-6b2d-4e8d-be48-430fc0b6bb1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '900b745bce314bf698179c5c5c6b44ac', 'request_id': 'req-e57efe47-6b2d-4e8d-be48-430fc0b6bb1b'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:50.073500 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:37:50.080373 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-e57efe47-6b2d-4e8d-be48-430fc0b6bb1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '900b745bce314bf698179c5c5c6b44ac', 'request_id': 'req-e57efe47-6b2d-4e8d-be48-430fc0b6bb1b'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:50.089828 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-e57efe47-6b2d-4e8d-be48-430fc0b6bb1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '900b745bce314bf698179c5c5c6b44ac', 'request_id': 'req-e57efe47-6b2d-4e8d-be48-430fc0b6bb1b'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:50.102038 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-e57efe47-6b2d-4e8d-be48-430fc0b6bb1b admin admin] The token cache is being invalidate because project 900b745bce314bf698179c5c5c6b44ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:37:50.102335 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-e57efe47-6b2d-4e8d-be48-430fc0b6bb1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:50.102975 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-e57efe47-6b2d-4e8d-be48-430fc0b6bb1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:37:50.104957 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1288/2569] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:37:49 2022] DELETE /identity/v3/projects/900b745bce314bf698179c5c5c6b44ac => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:37:54.347213 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dde0cc-4711-4046-a073-6e9c9e396c77 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:37:54.347699 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dde0cc-4711-4046-a073-6e9c9e396c77 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:37:54.347811 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dde0cc-4711-4046-a073-6e9c9e396c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:37:54.367656 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-a0dde0cc-4711-4046-a073-6e9c9e396c77 None None] MFA Rules not processed for user `11ab8b6e26524eaa86ed8a889c194c6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:37:54.368875 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-a0dde0cc-4711-4046-a073-6e9c9e396c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:37:54.421334 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1282/2570] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:37:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:38:00.098454 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=6,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:38:03.536645 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57efe47-6b2d-4e8d-be48-430fc0b6bb1b admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:38:03.538335 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-e57efe47-6b2d-4e8d-be48-430fc0b6bb1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:38:03.614825 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57efe47-6b2d-4e8d-be48-430fc0b6bb1b admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:38:03.620155 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ee80b-0efc-4f3e-8670-1537760caf39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:38:03.621273 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ee80b-0efc-4f3e-8670-1537760caf39 service neutron] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:03.621696 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ee80b-0efc-4f3e-8670-1537760caf39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:03.622077 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ee80b-0efc-4f3e-8670-1537760caf39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:03.625370 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-602ee80b-0efc-4f3e-8670-1537760caf39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:38:03.636131 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ee80b-0efc-4f3e-8670-1537760caf39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:38:03.637695 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ee80b-0efc-4f3e-8670-1537760caf39 service neutron] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:38:03.647502 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1289/2571] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:38:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 20:38:03.738971 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dde0cc-4711-4046-a073-6e9c9e396c77 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:38:03.740595 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-a0dde0cc-4711-4046-a073-6e9c9e396c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:38:03.753550 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dde0cc-4711-4046-a073-6e9c9e396c77 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:38:03.757262 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b153ef0-7a41-4728-8c5b-b4747470ca21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:38:03.757899 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b153ef0-7a41-4728-8c5b-b4747470ca21 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:03.758195 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b153ef0-7a41-4728-8c5b-b4747470ca21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:03.758458 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b153ef0-7a41-4728-8c5b-b4747470ca21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:03.761403 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-8b153ef0-7a41-4728-8c5b-b4747470ca21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:38:03.832086 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b153ef0-7a41-4728-8c5b-b4747470ca21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:38:03.833580 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b153ef0-7a41-4728-8c5b-b4747470ca21 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:38:03.844424 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1283/2572] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:38:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:38:12.331612 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d2109-e3ee-4d0b-a99e-7f89e7bc8fe2 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:12.332208 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d2109-e3ee-4d0b-a99e-7f89e7bc8fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:12.332208 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d2109-e3ee-4d0b-a99e-7f89e7bc8fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:12.374020 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-281d2109-e3ee-4d0b-a99e-7f89e7bc8fe2 None None] MFA Rules not processed for user `66937804f65147f392f4ddfc3e961d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:38:12.375203 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-281d2109-e3ee-4d0b-a99e-7f89e7bc8fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:38:12.466904 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1290/2573] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Nov 2 20:38:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:38:12.515581 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b153ef0-7a41-4728-8c5b-b4747470ca21 service neutron] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:38:12.517137 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-8b153ef0-7a41-4728-8c5b-b4747470ca21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:38:12.535808 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:38:12.652181 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b153ef0-7a41-4728-8c5b-b4747470ca21 service neutron] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:38:12.658965 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb63a3-6296-43c0-88d7-82d0ae247b65 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f22f80ac694e9888c132af1e58e292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:38:12.659582 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb63a3-6296-43c0-88d7-82d0ae247b65 service swift] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:12.659862 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb63a3-6296-43c0-88d7-82d0ae247b65 service swift] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:12.660154 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb63a3-6296-43c0-88d7-82d0ae247b65 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:12.669730 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb63a3-6296-43c0-88d7-82d0ae247b65 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:38:12.671335 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb63a3-6296-43c0-88d7-82d0ae247b65 service swift] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:38:12.680068 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1284/2574] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Nov 2 20:38:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 20:38:19.548067 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d2109-e3ee-4d0b-a99e-7f89e7bc8fe2 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:38:19.550296 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-281d2109-e3ee-4d0b-a99e-7f89e7bc8fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:38:19.628147 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=100 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:38:19.662484 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d2109-e3ee-4d0b-a99e-7f89e7bc8fe2 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:38:19.668993 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee5cdc-34d0-4da4-84bb-ef4f7fd4fe82 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603a9f31ae814003a2cbd02f964f4ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:38:19.670021 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee5cdc-34d0-4da4-84bb-ef4f7fd4fe82 service placement] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:19.670596 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee5cdc-34d0-4da4-84bb-ef4f7fd4fe82 service placement] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:19.670886 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee5cdc-34d0-4da4-84bb-ef4f7fd4fe82 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:19.673337 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-dcee5cdc-34d0-4da4-84bb-ef4f7fd4fe82 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:38:19.691874 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee5cdc-34d0-4da4-84bb-ef4f7fd4fe82 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:38:19.694004 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee5cdc-34d0-4da4-84bb-ef4f7fd4fe82 service placement] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:38:19.709802 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1291/2575] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:38:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 20:38:22.676963 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=47 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:38:27.049622 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c18486-30ce-4833-a625-f22704300f5c None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:27.050182 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c18486-30ce-4833-a625-f22704300f5c None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:27.050182 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c18486-30ce-4833-a625-f22704300f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:27.069608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-b2c18486-30ce-4833-a625-f22704300f5c None None] MFA Rules not processed for user `66937804f65147f392f4ddfc3e961d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:38:27.070799 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-b2c18486-30ce-4833-a625-f22704300f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:38:27.078365 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1285/2576] 10.222.0.23 () {58 vars in 967 bytes} [Wed Nov 2 20:38:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:38:27.090827 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee5cdc-34d0-4da4-84bb-ef4f7fd4fe82 service placement] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:38:27.102383 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee5cdc-34d0-4da4-84bb-ef4f7fd4fe82 service placement] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:38:27.107933 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58775b-b4cc-4f5e-b352-447e949e45a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95f22f80ac694e9888c132af1e58e292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:38:27.108527 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58775b-b4cc-4f5e-b352-447e949e45a5 service swift] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:27.108839 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58775b-b4cc-4f5e-b352-447e949e45a5 service swift] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:27.109137 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58775b-b4cc-4f5e-b352-447e949e45a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:27.117063 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c58775b-b4cc-4f5e-b352-447e949e45a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:38:27.118632 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c58775b-b4cc-4f5e-b352-447e949e45a5 service swift] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:38:27.126564 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1292/2577] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Nov 2 20:38:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 20:38:29.031636 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c18486-30ce-4833-a625-f22704300f5c None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:38:29.033195 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-b2c18486-30ce-4833-a625-f22704300f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:38:29.129226 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c18486-30ce-4833-a625-f22704300f5c None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:38:29.133698 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6429ae-7a7e-44fc-b0e1-898b4fc0c2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:38:29.134323 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6429ae-7a7e-44fc-b0e1-898b4fc0c2d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:29.134634 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6429ae-7a7e-44fc-b0e1-898b4fc0c2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:29.134909 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6429ae-7a7e-44fc-b0e1-898b4fc0c2d8 admin admin] PATH_INFO: `/v3/users/11ab8b6e26524eaa86ed8a889c194c6c` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:29.136038 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6429ae-7a7e-44fc-b0e1-898b4fc0c2d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11ab8b6e26524eaa86ed8a889c194c6c)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:38:29.138175 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6429ae-7a7e-44fc-b0e1-898b4fc0c2d8 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:38:29.184971 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-dc6429ae-7a7e-44fc-b0e1-898b4fc0c2d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11ab8b6e26524eaa86ed8a889c194c6c'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:38:29.185626 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-dc6429ae-7a7e-44fc-b0e1-898b4fc0c2d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11ab8b6e26524eaa86ed8a889c194c6c'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:38:29.199449 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-dc6429ae-7a7e-44fc-b0e1-898b4fc0c2d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11ab8b6e26524eaa86ed8a889c194c6c'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:38:29.200157 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-dc6429ae-7a7e-44fc-b0e1-898b4fc0c2d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11ab8b6e26524eaa86ed8a889c194c6c'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:38:29.207929 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-dc6429ae-7a7e-44fc-b0e1-898b4fc0c2d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11ab8b6e26524eaa86ed8a889c194c6c'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:38:29.221425 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1286/2578] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:38:29 2022] DELETE /identity/v3/users/11ab8b6e26524eaa86ed8a889c194c6c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:38:29.388849 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58775b-b4cc-4f5e-b352-447e949e45a5 service swift] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:38:29.400116 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58775b-b4cc-4f5e-b352-447e949e45a5 service swift] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:38:29.464019 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4b304-f513-4788-a444-fe10939194ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:38:29.464699 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4b304-f513-4788-a444-fe10939194ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:29.464986 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4b304-f513-4788-a444-fe10939194ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:29.465266 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4b304-f513-4788-a444-fe10939194ac admin admin] PATH_INFO: `/v3/projects/ade0dccf90254f1ca7c28c272face68c` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:29.466404 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef4b304-f513-4788-a444-fe10939194ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=ade0dccf90254f1ca7c28c272face68c)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:38:29.468294 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef4b304-f513-4788-a444-fe10939194ac admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:38:29.515233 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-5ef4b304-f513-4788-a444-fe10939194ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ade0dccf90254f1ca7c28c272face68c', 'request_id': 'req-5ef4b304-f513-4788-a444-fe10939194ac'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:38:29.521977 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-5ef4b304-f513-4788-a444-fe10939194ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ade0dccf90254f1ca7c28c272face68c', 'request_id': 'req-5ef4b304-f513-4788-a444-fe10939194ac'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:38:29.529440 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-5ef4b304-f513-4788-a444-fe10939194ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ade0dccf90254f1ca7c28c272face68c', 'request_id': 'req-5ef4b304-f513-4788-a444-fe10939194ac'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:38:29.539932 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-5ef4b304-f513-4788-a444-fe10939194ac admin admin] The token cache is being invalidate because project ade0dccf90254f1ca7c28c272face68c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:38:29.540226 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-5ef4b304-f513-4788-a444-fe10939194ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:38:29.540869 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-5ef4b304-f513-4788-a444-fe10939194ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:38:29.542875 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1293/2579] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:38:29 2022] DELETE /identity/v3/projects/ade0dccf90254f1ca7c28c272face68c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:38:29.547693 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96074c-b3c1-4898-bdd1-48940fb10109 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:29.548010 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96074c-b3c1-4898-bdd1-48940fb10109 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:29.548347 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96074c-b3c1-4898-bdd1-48940fb10109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:29.604712 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-2c96074c-b3c1-4898-bdd1-48940fb10109 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:38:29.605973 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-2c96074c-b3c1-4898-bdd1-48940fb10109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:38:29.614405 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:38:29.665812 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1287/2580] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:38:29.728752 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd0f21-95a2-4e12-8b4e-38246dd050df None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:29.729068 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd0f21-95a2-4e12-8b4e-38246dd050df None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:29.729876 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd0f21-95a2-4e12-8b4e-38246dd050df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:29.750535 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-dfdd0f21-95a2-4e12-8b4e-38246dd050df None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:38:29.751751 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-dfdd0f21-95a2-4e12-8b4e-38246dd050df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:38:29.759702 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1294/2581] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:38:29.763903 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96074c-b3c1-4898-bdd1-48940fb10109 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:38:29.773449 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96074c-b3c1-4898-bdd1-48940fb10109 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:38:29.778638 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d3182-c424-4024-9b79-4abd4a43bbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:38:29.779224 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d3182-c424-4024-9b79-4abd4a43bbbb admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:29.779505 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d3182-c424-4024-9b79-4abd4a43bbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:29.779779 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d3182-c424-4024-9b79-4abd4a43bbbb admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:29.780422 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d3182-c424-4024-9b79-4abd4a43bbbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:38:29.780749 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d3182-c424-4024-9b79-4abd4a43bbbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:38:29.782338 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d3182-c424-4024-9b79-4abd4a43bbbb admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:38:29.794318 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1288/2582] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:38:29.798555 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd0f21-95a2-4e12-8b4e-38246dd050df None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:38:29.808272 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd0f21-95a2-4e12-8b4e-38246dd050df None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:38:29.812906 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10620021-1002-493f-b84f-961a76faf2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:38:29.813497 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10620021-1002-493f-b84f-961a76faf2d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:29.813780 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10620021-1002-493f-b84f-961a76faf2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:29.814069 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10620021-1002-493f-b84f-961a76faf2d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:29.814704 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10620021-1002-493f-b84f-961a76faf2d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:38:29.816594 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10620021-1002-493f-b84f-961a76faf2d7 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:38:29.849427 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1295/2583] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:38:29 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:38:29.850608 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d3182-c424-4024-9b79-4abd4a43bbbb admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:38:29.861165 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d3182-c424-4024-9b79-4abd4a43bbbb admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:38:29.918176 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13440b47-5163-497f-b3f8-73b0346bec71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:38:29.918702 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13440b47-5163-497f-b3f8-73b0346bec71 admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:29.918983 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13440b47-5163-497f-b3f8-73b0346bec71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:29.919256 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13440b47-5163-497f-b3f8-73b0346bec71 admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:29.919875 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13440b47-5163-497f-b3f8-73b0346bec71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:38:29.921872 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13440b47-5163-497f-b3f8-73b0346bec71 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:38:29.942218 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1289/2584] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:38:29 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 20:38:29.946429 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10620021-1002-493f-b84f-961a76faf2d7 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:38:29.956602 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10620021-1002-493f-b84f-961a76faf2d7 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:38:29.961496 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446e2a2-a489-4bff-9086-1124e9bc382e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:38:29.962082 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446e2a2-a489-4bff-9086-1124e9bc382e admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:29.962361 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446e2a2-a489-4bff-9086-1124e9bc382e admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:29.962635 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446e2a2-a489-4bff-9086-1124e9bc382e admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:29.963269 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446e2a2-a489-4bff-9086-1124e9bc382e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:38:29.965388 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446e2a2-a489-4bff-9086-1124e9bc382e admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:38:29.975717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1296/2585] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:38:29.980134 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13440b47-5163-497f-b3f8-73b0346bec71 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:38:29.989905 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13440b47-5163-497f-b3f8-73b0346bec71 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:38:29.994435 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d0116-6101-4345-ad0e-6e56fe89e316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:38:29.995019 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d0116-6101-4345-ad0e-6e56fe89e316 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:29.995302 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d0116-6101-4345-ad0e-6e56fe89e316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:29.995577 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d0116-6101-4345-ad0e-6e56fe89e316 admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:29.996216 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d0116-6101-4345-ad0e-6e56fe89e316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:38:29.998098 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d0116-6101-4345-ad0e-6e56fe89e316 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:38:30.008588 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1290/2586] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:38:30.012666 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446e2a2-a489-4bff-9086-1124e9bc382e admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:38:30.022804 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446e2a2-a489-4bff-9086-1124e9bc382e admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:38:30.027952 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0599a3-8c97-43f4-bc20-dcfc473d63ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:38:30.028642 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0599a3-8c97-43f4-bc20-dcfc473d63ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:30.028929 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0599a3-8c97-43f4-bc20-dcfc473d63ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:30.029206 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0599a3-8c97-43f4-bc20-dcfc473d63ac admin admin] PATH_INFO: `/v3/projects/69b19bf9c38340f3979fb3026ca56e7b/users/23deba85bc9441c88d90a95e908a2c93/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:30.037156 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:38:30.045360 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0599a3-8c97-43f4-bc20-dcfc473d63ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b19bf9c38340f3979fb3026ca56e7b, user_id=23deba85bc9441c88d90a95e908a2c93, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:38:30.048468 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0599a3-8c97-43f4-bc20-dcfc473d63ac admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:38:30.061366 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1297/2587] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:38:30 2022] PUT /identity/v3/projects/69b19bf9c38340f3979fb3026ca56e7b/users/23deba85bc9441c88d90a95e908a2c93/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:38:30.071500 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d85aaf-68d9-42df-8660-e8f62b676721 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:30.072006 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d85aaf-68d9-42df-8660-e8f62b676721 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:30.072109 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d85aaf-68d9-42df-8660-e8f62b676721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:30.099847 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-32d85aaf-68d9-42df-8660-e8f62b676721 None None] MFA Rules not processed for user `23deba85bc9441c88d90a95e908a2c93`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:38:30.101091 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-32d85aaf-68d9-42df-8660-e8f62b676721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:38:30.162863 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1291/2588] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:38:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:38:30.174372 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0599a3-8c97-43f4-bc20-dcfc473d63ac admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:38:30.176087 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-7d0599a3-8c97-43f4-bc20-dcfc473d63ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:38:30.231915 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0599a3-8c97-43f4-bc20-dcfc473d63ac admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:38:30.235529 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf90b3-256a-40aa-9885-53c1b8d9bca5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:38:30.236131 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf90b3-256a-40aa-9885-53c1b8d9bca5 service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:30.236413 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf90b3-256a-40aa-9885-53c1b8d9bca5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:30.236727 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf90b3-256a-40aa-9885-53c1b8d9bca5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:30.245431 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf90b3-256a-40aa-9885-53c1b8d9bca5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:38:30.246838 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf90b3-256a-40aa-9885-53c1b8d9bca5 service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:38:30.255438 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1298/2589] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:38:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:38:32.799782 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d85aaf-68d9-42df-8660-e8f62b676721 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:38:32.809838 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:38:32.861923 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d85aaf-68d9-42df-8660-e8f62b676721 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:38:32.866363 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ae782-e55e-414b-8cf4-882d63b9fc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:38:32.866980 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ae782-e55e-414b-8cf4-882d63b9fc15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:32.867261 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ae782-e55e-414b-8cf4-882d63b9fc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:32.867540 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ae782-e55e-414b-8cf4-882d63b9fc15 admin admin] PATH_INFO: `/v3/users/23deba85bc9441c88d90a95e908a2c93` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:32.868666 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ae782-e55e-414b-8cf4-882d63b9fc15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23deba85bc9441c88d90a95e908a2c93)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:38:32.871291 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ae782-e55e-414b-8cf4-882d63b9fc15 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:38:32.915737 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-0a1ae782-e55e-414b-8cf4-882d63b9fc15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23deba85bc9441c88d90a95e908a2c93'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:38:32.916387 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-0a1ae782-e55e-414b-8cf4-882d63b9fc15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23deba85bc9441c88d90a95e908a2c93'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:38:32.927970 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-0a1ae782-e55e-414b-8cf4-882d63b9fc15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23deba85bc9441c88d90a95e908a2c93'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:38:32.928627 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-0a1ae782-e55e-414b-8cf4-882d63b9fc15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23deba85bc9441c88d90a95e908a2c93'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:38:32.935873 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-0a1ae782-e55e-414b-8cf4-882d63b9fc15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23deba85bc9441c88d90a95e908a2c93'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:38:32.947897 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1292/2590] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:38:32 2022] DELETE /identity/v3/users/23deba85bc9441c88d90a95e908a2c93 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:38:32.953009 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf81b6d-2187-4cea-9600-908fd119f4f6 None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:32.953490 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf81b6d-2187-4cea-9600-908fd119f4f6 None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:32.953593 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf81b6d-2187-4cea-9600-908fd119f4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:32.972153 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-acf81b6d-2187-4cea-9600-908fd119f4f6 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:38:32.973643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-acf81b6d-2187-4cea-9600-908fd119f4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:38:33.030702 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1299/2591] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 20:38:33.040514 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ae782-e55e-414b-8cf4-882d63b9fc15 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:38:33.042005 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-0a1ae782-e55e-414b-8cf4-882d63b9fc15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:38:33.118804 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ae782-e55e-414b-8cf4-882d63b9fc15 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:38:33.123110 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b13f9-c16e-4325-b9eb-227f89c0e870 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:38:33.123715 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b13f9-c16e-4325-b9eb-227f89c0e870 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:33.124000 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b13f9-c16e-4325-b9eb-227f89c0e870 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:33.124278 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b13f9-c16e-4325-b9eb-227f89c0e870 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:33.133145 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b13f9-c16e-4325-b9eb-227f89c0e870 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:38:33.134602 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b13f9-c16e-4325-b9eb-227f89c0e870 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:38:33.143990 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1293/2592] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:38:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:38:33.407350 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf81b6d-2187-4cea-9600-908fd119f4f6 None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:38:33.408911 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-acf81b6d-2187-4cea-9600-908fd119f4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:38:33.421392 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf81b6d-2187-4cea-9600-908fd119f4f6 None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:38:33.428951 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad7886-089c-4280-a207-e38bf81af3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:38:33.429604 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad7886-089c-4280-a207-e38bf81af3fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:33.429889 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad7886-089c-4280-a207-e38bf81af3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:33.430174 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad7886-089c-4280-a207-e38bf81af3fd admin admin] PATH_INFO: `/v3/projects/69b19bf9c38340f3979fb3026ca56e7b` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:33.431335 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad7886-089c-4280-a207-e38bf81af3fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=69b19bf9c38340f3979fb3026ca56e7b)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:38:33.433822 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad7886-089c-4280-a207-e38bf81af3fd admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:38:33.480086 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-efad7886-089c-4280-a207-e38bf81af3fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69b19bf9c38340f3979fb3026ca56e7b', 'request_id': 'req-efad7886-089c-4280-a207-e38bf81af3fd'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:38:33.486249 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-efad7886-089c-4280-a207-e38bf81af3fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69b19bf9c38340f3979fb3026ca56e7b', 'request_id': 'req-efad7886-089c-4280-a207-e38bf81af3fd'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:38:33.494161 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-efad7886-089c-4280-a207-e38bf81af3fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69b19bf9c38340f3979fb3026ca56e7b', 'request_id': 'req-efad7886-089c-4280-a207-e38bf81af3fd'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:38:33.505427 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-efad7886-089c-4280-a207-e38bf81af3fd admin admin] The token cache is being invalidate because project 69b19bf9c38340f3979fb3026ca56e7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:38:33.505721 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-efad7886-089c-4280-a207-e38bf81af3fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:38:33.506350 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-efad7886-089c-4280-a207-e38bf81af3fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:38:33.507870 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1300/2593] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:38:33 2022] DELETE /identity/v3/projects/69b19bf9c38340f3979fb3026ca56e7b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:38:33.513343 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1990aec-f8f7-4adc-a872-37c47144be67 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:33.513635 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1990aec-f8f7-4adc-a872-37c47144be67 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:33.513917 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1990aec-f8f7-4adc-a872-37c47144be67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:33.533466 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-d1990aec-f8f7-4adc-a872-37c47144be67 None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:38:33.534727 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-d1990aec-f8f7-4adc-a872-37c47144be67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:38:33.539897 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:38:33.594511 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1294/2594] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:38:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:38:33.602445 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d76b5e-e009-49c8-817e-1b634aecd38e None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:33.602742 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d76b5e-e009-49c8-817e-1b634aecd38e None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:33.603062 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d76b5e-e009-49c8-817e-1b634aecd38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:33.623783 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-c9d76b5e-e009-49c8-817e-1b634aecd38e None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:38:33.625042 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-c9d76b5e-e009-49c8-817e-1b634aecd38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:38:33.632900 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1301/2595] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:38:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:38:33.637620 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1990aec-f8f7-4adc-a872-37c47144be67 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:38:33.647159 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1990aec-f8f7-4adc-a872-37c47144be67 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:38:33.651723 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb11083-7f75-4656-84ee-90e574999924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:38:33.652314 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb11083-7f75-4656-84ee-90e574999924 admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:33.652627 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb11083-7f75-4656-84ee-90e574999924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:33.652908 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb11083-7f75-4656-84ee-90e574999924 admin admin] PATH_INFO: `/v3/domains` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:33.653550 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb11083-7f75-4656-84ee-90e574999924 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81402) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 20:38:33.653856 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb11083-7f75-4656-84ee-90e574999924 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:38:33.655441 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb11083-7f75-4656-84ee-90e574999924 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:38:33.666733 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1295/2596] 10.222.0.23 () {58 vars in 1153 bytes} [Wed Nov 2 20:38:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 20:38:33.671105 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d76b5e-e009-49c8-817e-1b634aecd38e None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:38:33.680389 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d76b5e-e009-49c8-817e-1b634aecd38e None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:38:33.685643 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4bf16-6b05-465b-800c-73db3698f239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:38:33.686243 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4bf16-6b05-465b-800c-73db3698f239 admin admin] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:33.686529 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4bf16-6b05-465b-800c-73db3698f239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:33.686810 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4bf16-6b05-465b-800c-73db3698f239 admin admin] PATH_INFO: `/v3/projects` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:33.687448 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d4bf16-6b05-465b-800c-73db3698f239 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:38:33.689407 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d4bf16-6b05-465b-800c-73db3698f239 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:38:33.693824 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:38:33.718055 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1302/2597] 10.222.0.23 () {60 vars in 1153 bytes} [Wed Nov 2 20:38:33 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:38:33.722086 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb11083-7f75-4656-84ee-90e574999924 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:38:33.732022 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb11083-7f75-4656-84ee-90e574999924 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:38:33.787228 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a8f26-47d3-4793-a6da-d85f7355171d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:38:33.787739 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a8f26-47d3-4793-a6da-d85f7355171d admin admin] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:33.788022 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a8f26-47d3-4793-a6da-d85f7355171d admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:33.788294 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a8f26-47d3-4793-a6da-d85f7355171d admin admin] PATH_INFO: `/v3/users` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:33.788952 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a8f26-47d3-4793-a6da-d85f7355171d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:38:33.790859 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a8f26-47d3-4793-a6da-d85f7355171d admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:38:33.812085 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1296/2598] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Nov 2 20:38:33 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 20:38:33.816397 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4bf16-6b05-465b-800c-73db3698f239 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:38:33.826570 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4bf16-6b05-465b-800c-73db3698f239 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:38:33.831156 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340db45-af60-4b8b-9b93-7bbd97be4ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:38:33.831748 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340db45-af60-4b8b-9b93-7bbd97be4ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:33.832029 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340db45-af60-4b8b-9b93-7bbd97be4ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:33.832303 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340db45-af60-4b8b-9b93-7bbd97be4ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:33.832984 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340db45-af60-4b8b-9b93-7bbd97be4ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:38:33.834561 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340db45-af60-4b8b-9b93-7bbd97be4ff8 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:38:33.844749 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1303/2599] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 20:38:33.848837 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a8f26-47d3-4793-a6da-d85f7355171d admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:38:33.858975 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a8f26-47d3-4793-a6da-d85f7355171d admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:38:33.863532 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49559934-7837-466a-87c9-05fcdad7a78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:38:33.864111 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49559934-7837-466a-87c9-05fcdad7a78c admin admin] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:33.864390 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49559934-7837-466a-87c9-05fcdad7a78c admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:33.864707 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49559934-7837-466a-87c9-05fcdad7a78c admin admin] PATH_INFO: `/v3/roles` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:33.865343 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49559934-7837-466a-87c9-05fcdad7a78c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:38:33.866904 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49559934-7837-466a-87c9-05fcdad7a78c admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:38:33.877170 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1297/2600] 10.222.0.23 () {58 vars in 1122 bytes} [Wed Nov 2 20:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 20:38:33.881055 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340db45-af60-4b8b-9b93-7bbd97be4ff8 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:38:33.891585 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340db45-af60-4b8b-9b93-7bbd97be4ff8 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:38:33.896178 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e97cc-115e-45a3-a3fa-d881a0f4b76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:38:33.896846 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e97cc-115e-45a3-a3fa-d881a0f4b76b admin admin] REQUEST_METHOD: `PUT` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:33.897130 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e97cc-115e-45a3-a3fa-d881a0f4b76b admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:33.897406 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e97cc-115e-45a3-a3fa-d881a0f4b76b admin admin] PATH_INFO: `/v3/projects/04e3a7f9f474477fa5ceab33a442c420/users/64370754f05f49d5a3ff8fd4fa6e4034/roles/a1e0072f698b484b8cde5a22e350c67d` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:33.911986 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e97cc-115e-45a3-a3fa-d881a0f4b76b admin admin] RBAC: Authorizing `identity:create_grant(project_id=04e3a7f9f474477fa5ceab33a442c420, user_id=64370754f05f49d5a3ff8fd4fa6e4034, role_id=a1e0072f698b484b8cde5a22e350c67d)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:38:33.914651 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e97cc-115e-45a3-a3fa-d881a0f4b76b admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:38:33.927050 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1304/2601] 10.222.0.23 () {60 vars in 1483 bytes} [Wed Nov 2 20:38:33 2022] PUT /identity/v3/projects/04e3a7f9f474477fa5ceab33a442c420/users/64370754f05f49d5a3ff8fd4fa6e4034/roles/a1e0072f698b484b8cde5a22e350c67d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:38:33.938428 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2665c1a-d55f-4d85-9722-3f42c73df2b2 None None] REQUEST_METHOD: `POST` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:33.938744 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2665c1a-d55f-4d85-9722-3f42c73df2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:33.939020 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2665c1a-d55f-4d85-9722-3f42c73df2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:33.966970 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.auth.core [None req-e2665c1a-d55f-4d85-9722-3f42c73df2b2 None None] MFA Rules not processed for user `64370754f05f49d5a3ff8fd4fa6e4034`. Rule list: `[]` (Enabled: `True`). {{(pid=81402) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:38:33.968211 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-e2665c1a-d55f-4d85-9722-3f42c73df2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:38:34.033413 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1298/2602] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:38:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:38:34.044376 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e97cc-115e-45a3-a3fa-d881a0f4b76b admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:38:34.046112 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-636e97cc-115e-45a3-a3fa-d881a0f4b76b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:38:34.124769 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e97cc-115e-45a3-a3fa-d881a0f4b76b admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:38:34.128373 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464535e-4154-43b5-af27-aa0dd14379dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860ca67d4c446ac9d7617fb4608408f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:38:34.129018 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464535e-4154-43b5-af27-aa0dd14379dc service cinder] REQUEST_METHOD: `GET` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:34.129300 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464535e-4154-43b5-af27-aa0dd14379dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:34.129575 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464535e-4154-43b5-af27-aa0dd14379dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:34.138047 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464535e-4154-43b5-af27-aa0dd14379dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:38:34.139507 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464535e-4154-43b5-af27-aa0dd14379dc service cinder] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:38:34.148445 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1305/2603] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:38:34 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:38:44.030544 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=94,keystone:INSERT=3 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:38:44.144268 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=56,keystone:INSERT=2 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:38:44.358792 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2665c1a-d55f-4d85-9722-3f42c73df2b2 None None] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:38:44.421862 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2665c1a-d55f-4d85-9722-3f42c73df2b2 None None] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:38:44.426412 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74843266-ebd7-42a0-abcc-bbe76376a5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:38:44.427037 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74843266-ebd7-42a0-abcc-bbe76376a5f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:44.427323 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74843266-ebd7-42a0-abcc-bbe76376a5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:44.427609 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74843266-ebd7-42a0-abcc-bbe76376a5f6 admin admin] PATH_INFO: `/v3/users/64370754f05f49d5a3ff8fd4fa6e4034` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:44.428751 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74843266-ebd7-42a0-abcc-bbe76376a5f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64370754f05f49d5a3ff8fd4fa6e4034)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:38:44.430664 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74843266-ebd7-42a0-abcc-bbe76376a5f6 admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:38:44.478453 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-74843266-ebd7-42a0-abcc-bbe76376a5f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64370754f05f49d5a3ff8fd4fa6e4034'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:38:44.479122 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-74843266-ebd7-42a0-abcc-bbe76376a5f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64370754f05f49d5a3ff8fd4fa6e4034'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:38:44.491915 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-74843266-ebd7-42a0-abcc-bbe76376a5f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64370754f05f49d5a3ff8fd4fa6e4034'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:38:44.492624 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-74843266-ebd7-42a0-abcc-bbe76376a5f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64370754f05f49d5a3ff8fd4fa6e4034'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:38:44.500035 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-74843266-ebd7-42a0-abcc-bbe76376a5f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64370754f05f49d5a3ff8fd4fa6e4034'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:38:44.512838 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1299/2604] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:38:44 2022] DELETE /identity/v3/users/64370754f05f49d5a3ff8fd4fa6e4034 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:38:44.517433 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd33f23-41f0-4409-b695-230605cd054b None None] REQUEST_METHOD: `POST` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:44.517793 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd33f23-41f0-4409-b695-230605cd054b None None] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:44.518142 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd33f23-41f0-4409-b695-230605cd054b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:44.537282 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.auth.core [None req-ddd33f23-41f0-4409-b695-230605cd054b None None] MFA Rules not processed for user `8da8f4c56d9b4bd0a6e3eaa2f4387ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 20:38:44.538522 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-ddd33f23-41f0-4409-b695-230605cd054b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:38:44.596903 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1306/2605] 10.222.0.23 () {58 vars in 958 bytes} [Wed Nov 2 20:38:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 20:38:44.607226 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74843266-ebd7-42a0-abcc-bbe76376a5f6 admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:38:44.608639 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-74843266-ebd7-42a0-abcc-bbe76376a5f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:38:44.664285 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74843266-ebd7-42a0-abcc-bbe76376a5f6 admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:38:44.668615 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bacdf-6e96-4e7f-b6be-1409f6b5d373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdb57cba49ce43ad95096047859dfe1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:38:44.669226 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bacdf-6e96-4e7f-b6be-1409f6b5d373 service neutron] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:44.669511 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bacdf-6e96-4e7f-b6be-1409f6b5d373 service neutron] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:44.669790 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bacdf-6e96-4e7f-b6be-1409f6b5d373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:44.679717 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075bacdf-6e96-4e7f-b6be-1409f6b5d373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:38:44.681277 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075bacdf-6e96-4e7f-b6be-1409f6b5d373 service neutron] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:38:44.691910 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1300/2606] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:38:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:38:44.964025 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd33f23-41f0-4409-b695-230605cd054b None None] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:38:44.965957 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-ddd33f23-41f0-4409-b695-230605cd054b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:38:44.978345 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd33f23-41f0-4409-b695-230605cd054b None None] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:38:44.983813 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a4cb97-a59d-40f9-b638-1bd09de19307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:38:44.984446 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4cb97-a59d-40f9-b638-1bd09de19307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:38:44.984772 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4cb97-a59d-40f9-b638-1bd09de19307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:38:44.985047 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4cb97-a59d-40f9-b638-1bd09de19307 admin admin] PATH_INFO: `/v3/projects/04e3a7f9f474477fa5ceab33a442c420` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:38:44.986150 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a4cb97-a59d-40f9-b638-1bd09de19307 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04e3a7f9f474477fa5ceab33a442c420)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:38:44.988038 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a4cb97-a59d-40f9-b638-1bd09de19307 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:38:45.034876 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-91a4cb97-a59d-40f9-b638-1bd09de19307 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04e3a7f9f474477fa5ceab33a442c420', 'request_id': 'req-91a4cb97-a59d-40f9-b638-1bd09de19307'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:38:45.041160 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-91a4cb97-a59d-40f9-b638-1bd09de19307 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04e3a7f9f474477fa5ceab33a442c420', 'request_id': 'req-91a4cb97-a59d-40f9-b638-1bd09de19307'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:38:45.049022 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-91a4cb97-a59d-40f9-b638-1bd09de19307 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04e3a7f9f474477fa5ceab33a442c420', 'request_id': 'req-91a4cb97-a59d-40f9-b638-1bd09de19307'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:38:45.059476 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-91a4cb97-a59d-40f9-b638-1bd09de19307 admin admin] The token cache is being invalidate because project 04e3a7f9f474477fa5ceab33a442c420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:38:45.059766 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-91a4cb97-a59d-40f9-b638-1bd09de19307 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:38:45.060393 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-91a4cb97-a59d-40f9-b638-1bd09de19307 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:38:45.061924 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1307/2607] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:38:44 2022] DELETE /identity/v3/projects/04e3a7f9f474477fa5ceab33a442c420 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:38:54.687633 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:38:55.056375 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:39:37.324920 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bacdf-6e96-4e7f-b6be-1409f6b5d373 service neutron] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:39:37.326563 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-075bacdf-6e96-4e7f-b6be-1409f6b5d373 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:39:37.343529 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bacdf-6e96-4e7f-b6be-1409f6b5d373 service neutron] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:39:37.400846 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53197cd-378f-46e0-9a45-c789dbe5622b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:39:37.401411 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53197cd-378f-46e0-9a45-c789dbe5622b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:39:37.401696 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53197cd-378f-46e0-9a45-c789dbe5622b admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:39:37.401974 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53197cd-378f-46e0-9a45-c789dbe5622b admin admin] PATH_INFO: `/v3/users/b5ed8544b1964c5ab7795abbb9f5c27a` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:39:37.403107 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53197cd-378f-46e0-9a45-c789dbe5622b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5ed8544b1964c5ab7795abbb9f5c27a)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:39:37.405593 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53197cd-378f-46e0-9a45-c789dbe5622b admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:39:37.450601 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-d53197cd-378f-46e0-9a45-c789dbe5622b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5ed8544b1964c5ab7795abbb9f5c27a'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:39:37.451247 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-d53197cd-378f-46e0-9a45-c789dbe5622b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5ed8544b1964c5ab7795abbb9f5c27a'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:39:37.465667 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-d53197cd-378f-46e0-9a45-c789dbe5622b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5ed8544b1964c5ab7795abbb9f5c27a'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:39:37.466886 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-d53197cd-378f-46e0-9a45-c789dbe5622b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5ed8544b1964c5ab7795abbb9f5c27a'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:39:37.474130 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-d53197cd-378f-46e0-9a45-c789dbe5622b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5ed8544b1964c5ab7795abbb9f5c27a'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:39:37.487848 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1301/2608] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:39:37 2022] DELETE /identity/v3/users/b5ed8544b1964c5ab7795abbb9f5c27a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:39:37.670281 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a4cb97-a59d-40f9-b638-1bd09de19307 admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:39:37.672077 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-91a4cb97-a59d-40f9-b638-1bd09de19307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:39:37.686723 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a4cb97-a59d-40f9-b638-1bd09de19307 admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:39:37.744058 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f5ae3-6eac-49be-b86a-a4fcb8a49dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:39:37.744726 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f5ae3-6eac-49be-b86a-a4fcb8a49dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:39:37.745007 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f5ae3-6eac-49be-b86a-a4fcb8a49dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:39:37.745280 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f5ae3-6eac-49be-b86a-a4fcb8a49dda admin admin] PATH_INFO: `/v3/projects/7d3c307e18e14232af08674a06513195` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:39:37.746439 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f5ae3-6eac-49be-b86a-a4fcb8a49dda admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d3c307e18e14232af08674a06513195)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:39:37.748367 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f5ae3-6eac-49be-b86a-a4fcb8a49dda admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:39:37.795678 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-c39f5ae3-6eac-49be-b86a-a4fcb8a49dda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d3c307e18e14232af08674a06513195', 'request_id': 'req-c39f5ae3-6eac-49be-b86a-a4fcb8a49dda'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:39:37.801962 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-c39f5ae3-6eac-49be-b86a-a4fcb8a49dda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d3c307e18e14232af08674a06513195', 'request_id': 'req-c39f5ae3-6eac-49be-b86a-a4fcb8a49dda'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:39:37.808902 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-c39f5ae3-6eac-49be-b86a-a4fcb8a49dda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d3c307e18e14232af08674a06513195', 'request_id': 'req-c39f5ae3-6eac-49be-b86a-a4fcb8a49dda'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:39:37.819070 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-c39f5ae3-6eac-49be-b86a-a4fcb8a49dda admin admin] The token cache is being invalidate because project 7d3c307e18e14232af08674a06513195 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:39:37.819365 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-c39f5ae3-6eac-49be-b86a-a4fcb8a49dda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:39:37.820020 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-c39f5ae3-6eac-49be-b86a-a4fcb8a49dda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:39:37.821818 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1308/2609] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:39:37 2022] DELETE /identity/v3/projects/7d3c307e18e14232af08674a06513195 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:39:37.826308 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53197cd-378f-46e0-9a45-c789dbe5622b admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:39:37.827834 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-d53197cd-378f-46e0-9a45-c789dbe5622b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:39:37.840472 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53197cd-378f-46e0-9a45-c789dbe5622b admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:39:37.895861 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32980f11-06fc-4e68-af80-27c66bbea67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:39:37.896514 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32980f11-06fc-4e68-af80-27c66bbea67c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:39:37.896826 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32980f11-06fc-4e68-af80-27c66bbea67c admin admin] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:39:37.897105 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32980f11-06fc-4e68-af80-27c66bbea67c admin admin] PATH_INFO: `/v3/users/614088013d0a47b6a802249488423aaf` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:39:37.898239 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32980f11-06fc-4e68-af80-27c66bbea67c admin admin] RBAC: Authorizing `identity:delete_user(user_id=614088013d0a47b6a802249488423aaf)` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:39:37.900152 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32980f11-06fc-4e68-af80-27c66bbea67c admin admin] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:39:37.920973 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:39:37.943947 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-32980f11-06fc-4e68-af80-27c66bbea67c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '614088013d0a47b6a802249488423aaf'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:39:37.944605 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-32980f11-06fc-4e68-af80-27c66bbea67c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '614088013d0a47b6a802249488423aaf'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:39:37.956887 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-32980f11-06fc-4e68-af80-27c66bbea67c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '614088013d0a47b6a802249488423aaf'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:39:37.957530 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-32980f11-06fc-4e68-af80-27c66bbea67c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '614088013d0a47b6a802249488423aaf'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:39:37.964297 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.notifications [None req-32980f11-06fc-4e68-af80-27c66bbea67c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '614088013d0a47b6a802249488423aaf'} {{(pid=81402) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:39:37.976690 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1302/2610] 10.222.0.23 () {58 vars in 1224 bytes} [Wed Nov 2 20:39:37 2022] DELETE /identity/v3/users/614088013d0a47b6a802249488423aaf => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:39:38.141192 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f5ae3-6eac-49be-b86a-a4fcb8a49dda admin admin] Authenticating user token {{(pid=81403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:39:38.142713 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.fernet_utils [None req-c39f5ae3-6eac-49be-b86a-a4fcb8a49dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:39:38.155717 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f5ae3-6eac-49be-b86a-a4fcb8a49dda admin admin] Validating token access rules against request {{(pid=81403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:39:38.212969 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b22f35-2438-4901-817c-aeafa27a17f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8da8f4c56d9b4bd0a6e3eaa2f4387ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14a9d6ea225146efb4d5d6e0861824b6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:39:38.213529 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b22f35-2438-4901-817c-aeafa27a17f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:39:38.213811 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b22f35-2438-4901-817c-aeafa27a17f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:39:38.214088 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b22f35-2438-4901-817c-aeafa27a17f8 admin admin] PATH_INFO: `/v3/projects/94ca394f37634fe39eca8c151a89ab2f` {{(pid=81403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:39:38.215188 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b22f35-2438-4901-817c-aeafa27a17f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94ca394f37634fe39eca8c151a89ab2f)` {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:39:38.217135 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b22f35-2438-4901-817c-aeafa27a17f8 admin admin] RBAC: Authorization granted {{(pid=81403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:39:38.250625 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:39:38.265185 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-c0b22f35-2438-4901-817c-aeafa27a17f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94ca394f37634fe39eca8c151a89ab2f', 'request_id': 'req-c0b22f35-2438-4901-817c-aeafa27a17f8'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:39:38.271485 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-c0b22f35-2438-4901-817c-aeafa27a17f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94ca394f37634fe39eca8c151a89ab2f', 'request_id': 'req-c0b22f35-2438-4901-817c-aeafa27a17f8'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:39:38.279451 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-c0b22f35-2438-4901-817c-aeafa27a17f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94ca394f37634fe39eca8c151a89ab2f', 'request_id': 'req-c0b22f35-2438-4901-817c-aeafa27a17f8'} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:39:38.289862 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-c0b22f35-2438-4901-817c-aeafa27a17f8 admin admin] The token cache is being invalidate because project 94ca394f37634fe39eca8c151a89ab2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 20:39:38.290159 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-c0b22f35-2438-4901-817c-aeafa27a17f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:39:38.290789 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG keystone.notifications [None req-c0b22f35-2438-4901-817c-aeafa27a17f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 20:39:38.292304 dv-cinder-862365-5-smb devstack@keystone.service[81403]: [pid: 81403|app: 0|req: 1309/2611] 10.222.0.23 () {58 vars in 1233 bytes} [Wed Nov 2 20:39:38 2022] DELETE /identity/v3/projects/94ca394f37634fe39eca8c151a89ab2f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 20:39:47.973028 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:39:48.286831 dv-cinder-862365-5-smb devstack@keystone.service[81403]: DEBUG dbcounter [-] [81403] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 20:43:24.513379 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32980f11-06fc-4e68-af80-27c66bbea67c admin admin] Authenticating user token {{(pid=81402) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 20:43:24.514895 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-32980f11-06fc-4e68-af80-27c66bbea67c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:43:24.585467 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32980f11-06fc-4e68-af80-27c66bbea67c admin admin] Validating token access rules against request {{(pid=81402) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 20:43:24.643462 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a730f8-ad87-4be4-aa5a-e069a4dd2e2f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603a9f31ae814003a2cbd02f964f4ac9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a144e65ce44c44dc99c07a7f5be303b7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81402) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 20:43:24.644069 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a730f8-ad87-4be4-aa5a-e069a4dd2e2f service placement] REQUEST_METHOD: `GET` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 20:43:24.644354 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a730f8-ad87-4be4-aa5a-e069a4dd2e2f service placement] SCRIPT_NAME: `/identity` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 20:43:24.644659 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a730f8-ad87-4be4-aa5a-e069a4dd2e2f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81402) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 20:43:24.646363 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.fernet_utils [None req-15a730f8-ad87-4be4-aa5a-e069a4dd2e2f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81402) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 20:43:24.657363 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a730f8-ad87-4be4-aa5a-e069a4dd2e2f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 20:43:24.658934 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a730f8-ad87-4be4-aa5a-e069a4dd2e2f service placement] RBAC: Authorization granted {{(pid=81402) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 20:43:24.669179 dv-cinder-862365-5-smb devstack@keystone.service[81402]: [pid: 81402|app: 0|req: 1303/2612] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Nov 2 20:43:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 20:43:34.664983 dv-cinder-862365-5-smb devstack@keystone.service[81402]: DEBUG dbcounter [-] [81402] Writing DB stats keystone:SELECT=58 {{(pid=81402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}